whatscookinchicago.com
robots.txt

Robots Exclusion Standard data for whatscookinchicago.com

Resource Scan

Scan Details

Site Domain whatscookinchicago.com
Base Domain whatscookinchicago.com
Scan Status Ok
Last Scan2024-11-11T15:36:32+00:00
Next Scan 2024-11-18T15:36:32+00:00

Last Scan

Scanned2024-11-11T15:36:32+00:00
URL https://whatscookinchicago.com/robots.txt
Domain IPs 104.21.62.195, 172.67.138.191, 2606:4700:3033::6815:3ec3, 2606:4700:3034::ac43:8abf
Response IP 172.67.138.191
Found Yes
Hash 1ed4c55e116599dae0debbfd18c0381dc47144dbe56628e0a33fcc6a60ed7504
SimHash 6a28d8208bb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://whatscookinchicago.com/sitemap.xml
sitemap https://whatscookinchicago.com/sitemap.rss