main-source.co.uk
robots.txt

Robots Exclusion Standard data for main-source.co.uk

Resource Scan

Scan Details

Site Domain main-source.co.uk
Base Domain main-source.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan6/1/2025, 3:55:18 AM
Next Scan 7/1/2025, 3:55:18 AM

Last Successful Scan

Scanned4/10/2025, 2:58:27 AM
URL https://www.main-source.co.uk/robots.txt
Domain IPs 104.21.40.228, 172.67.157.144, 2606:4700:3034::ac43:9d90, 2606:4700:3035::6815:28e4
Response IP 104.21.40.228
Found Yes
Hash f45d9a432a9cc2ecc1f6a58a215e357a24875b1905e9ff4d68e3471f7565a3be
SimHash 6794dc1567c4

Groups

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10