dc.urbanturf.com
robots.txt

Robots Exclusion Standard data for dc.urbanturf.com

Resource Scan

Scan Details

Site Domain dc.urbanturf.com
Base Domain urbanturf.com
Scan Status Ok
Last Scan2026-01-10T12:55:44+00:00
Next Scan 2026-02-09T12:55:44+00:00

Last Scan

Scanned2026-01-10T12:55:44+00:00
URL https://dc.urbanturf.com/robots.txt
Domain IPs 104.26.10.82, 104.26.11.82, 172.67.71.17, 2606:4700:20::681a:a52, 2606:4700:20::681a:b52, 2606:4700:20::ac43:4711
Response IP 104.26.10.82
Found Yes
Hash 73ab1b314e32b2906813f47ffa962fac79ae4cec139a221394d77a7ee7ae29d0
SimHash 5115dff2c3d1

Groups

oai-searchbot
chatgpt-user
gptbot
amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /newsletter/issue/
Disallow /newsletter
Disallow /media_kit/

Other Records

Field Value
sitemap https://dc.urbanturf.com/sitemap.xml

Comments

  • Block Known AI Bots
  • Allow Public Access