thecpc.ac.uk
robots.txt

Robots Exclusion Standard data for thecpc.ac.uk

Resource Scan

Scan Details

Site Domain thecpc.ac.uk
Base Domain thecpc.ac.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan5/18/2025, 4:00:23 AM
Next Scan 8/16/2025, 4:00:23 AM

Last Successful Scan

Scanned1/1/2024, 8:54:08 PM
URL https://thecpc.ac.uk/robots.txt
Redirect https://www.thecpc.ac.uk/robots.txt
Redirect Domain www.thecpc.ac.uk
Redirect Base thecpc.ac.uk
Domain IPs 104.21.13.189, 172.67.133.16, 2606:4700:3033::6815:dbd, 2606:4700:3033::ac43:8510
Redirect IPs 104.21.13.189, 172.67.133.16, 2606:4700:3033::6815:dbd, 2606:4700:3033::ac43:8510
Response IP 172.67.133.16
Found Yes
Hash 7c669b63f2fae3b37fc87e1c614ae4840fc04f937b387405d6e2d4ddcd196c55
SimHash a180fa2884b1

Groups

twitterbot

Rule Path
Disallow *
Allow /images/

linkedinbot

Rule Path
Disallow *
Allow /images/

facebot

Rule Path
Disallow *
Allow /images/

google

Rule Path
Disallow *
Allow /images/

*

Rule Path
Disallow /ckeditor4.4.3/
Disallow /node_modules/
Disallow /mibew/
Disallow /accessDenied.php
Disallow /docs_239657/
Disallow /docs/
Disallow /images/120x120/
Disallow /images/180x110/
Disallow /images/480x320/
Disallow /images/500x335/
Disallow /images/600x315/
Disallow /images/720x480/
Disallow /images/buttons/
Disallow /images/content/
Disallow /images/features/
Disallow /images/icons/
Disallow /images/spend/
Disallow /includes/
Disallow /members/activateMember.php
Disallow /members/declineMember.php
Disallow /members/editContact.php
Disallow /members/editMember.php
Disallow /mycompany/spend/
Disallow /myinstitution/board/
Disallow /myinstitution/contractsManager/
Disallow /myinstitution/cpcintranet/
Disallow /myinstitution/spend/
Disallow /spend/
Disallow /suppliers/addContact.php
Disallow /suppliers/addContact2.php
Disallow /suppliers/deleteContact.php
Disallow /suppliers/editContractDetails.php
Disallow /suppliers/editContractDetails2.php
Disallow /suppliers/contracting-pipeline/delete-framework.php
Disallow /suppliers/contracting-pipeline/add-a-framework.php
Disallow /suppliers/contracting-pipeline/suggested-frameworks.php
Disallow /contactus/team/teammember.php?cmanagerID=33
Disallow /contactus/team/teammember.php?cmanagerID=10
Disallow /contactus/team/teammember.php?cmanagerID=23

Other Records

Field Value
sitemap https://www.thecpc.ac.uk/sitemap.xml