chessingtonscouts.org.uk
robots.txt

Robots Exclusion Standard data for chessingtonscouts.org.uk

Resource Scan

Scan Details

Site Domain chessingtonscouts.org.uk
Base Domain chessingtonscouts.org.uk
Scan Status Ok
Last Scan2025-09-05T19:12:10+00:00
Next Scan 2025-10-05T19:12:10+00:00

Last Scan

Scanned2025-09-05T19:12:10+00:00
URL https://chessingtonscouts.org.uk/robots.txt
Domain IPs 185.151.30.206, 2a07:7800::206
Response IP 185.151.30.206
Found Yes
Hash 2ee1e5766ddc7fd5f6c6cda16f2923d96068f123ba334fe8e65d252199fc0982
SimHash 21a88ec3ffb1

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 1

Comments

  • Default robots.txt file (which asks all bots to crawl slowly but still index everything).