culturunners.com
robots.txt

Robots Exclusion Standard data for culturunners.com

Resource Scan

Scan Details

Site Domain culturunners.com
Base Domain culturunners.com
Scan Status Ok
Last Scan2024-06-04T02:56:30+00:00
Next Scan 2024-06-11T02:56:30+00:00

Last Scan

Scanned2024-06-04T02:56:30+00:00
URL https://culturunners.com/robots.txt
Redirect https://www.culturunners.com/robots.txt
Redirect Domain www.culturunners.com
Redirect Base culturunners.com
Domain IPs 104.21.65.195, 172.67.165.127, 2606:4700:3030::6815:41c3, 2606:4700:3034::ac43:a57f
Redirect IPs 104.21.65.195, 172.67.165.127, 2606:4700:3030::6815:41c3, 2606:4700:3034::ac43:a57f
Response IP 104.21.65.195
Found Yes
Hash b564c9b3c5355d4f41096253a56b3b742b2ce7e9d81b9134550a17daa21d1a30
SimHash e1601d563f11

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.culturunners.com/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.culturunners.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/