derbycityweekend.com
robots.txt

Robots Exclusion Standard data for derbycityweekend.com

Resource Scan

Scan Details

Site Domain derbycityweekend.com
Base Domain derbycityweekend.com
Scan Status Ok
Last Scan2024-11-01T17:23:33+00:00
Next Scan 2024-11-08T17:23:33+00:00

Last Scan

Scanned2024-11-01T17:23:33+00:00
URL https://derbycityweekend.com/robots.txt
Redirect https://www.derbycityweekend.com:443/robots.txt
Redirect Domain www.derbycityweekend.com
Redirect Base derbycityweekend.com
Domain IPs 13.248.189.212, 76.223.50.3
Redirect IPs 184.87.193.81, 184.87.193.85, 2600:1413:b000:13::b857:c18e, 2600:1413:b000:13::b857:c194
Response IP 23.45.207.171
Found Yes
Hash 5777b95c9fe35c6fb0dcf56e458bef5dd569f8c857378aa45bb787f696a1c1de
SimHash 70145850a492

Groups

gptbot
chatgpt-user
google-extended
ccbot
amazonbot
anthropic-ai
bytespider
claudebot
claude-web
facebookbot
omgili
omgilibot
perplexitybot

Rule Path
Disallow /

*

Rule Path
Disallow /*?outputType=apps

Other Records

Field Value
sitemap https://www.derbycityweekend.com/arc/outboundfeeds/sitemap-index/?outputType=xml
sitemap https://www.derbycityweekend.com/arc/outboundfeeds/news-sitemap-index/?outputType=xml
sitemap https://www.derbycityweekend.com/arc/outboundfeeds/video-sitemap/?outputType=xml