theshed.chelseafc.com
robots.txt

Robots Exclusion Standard data for theshed.chelseafc.com

Resource Scan

Scan Details

Site Domain theshed.chelseafc.com
Base Domain chelseafc.com
Scan Status Ok
Last Scan2025-11-20T19:49:00+00:00
Next Scan 2025-12-04T19:49:00+00:00

Last Scan

Scanned2025-11-20T19:49:00+00:00
URL https://theshed.chelseafc.com/robots.txt
Domain IPs 54.216.239.207
Response IP 54.216.239.207
Found Yes
Hash bd0e902ec22cf021941cdfdb97e3533a47cfef1e18203564c15e4d63f90747dc
SimHash 411438417ed3

Groups

*

Rule Path
Disallow *
Allow /bridge/$
Allow /bridge/chat/$
Allow /bridge/media-watch/
Allow /bridge/shot-of-the-day$
Allow /bridge/extras/memorial-wall/$
Allow /bridge/extras/songs/
Allow /bridge/extras/celebrity-fans/
Allow /bridge/on-social/
Allow /chat/forum_combined_classic.shtml
Allow /mobilechat.shtml
Allow /sitemap.xml
Allow /sitemap.rss

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://theshed.chelseafc.com/sitemap.xml
sitemap https://theshed.chelseafc.com/sitemap.rss

Comments

  • robots.txt for https://theshed.chelseafc.com/