advguides.com
robots.txt

Robots Exclusion Standard data for advguides.com

Resource Scan

Scan Details

Site Domain advguides.com
Base Domain advguides.com
Scan Status Ok
Last Scan2025-06-18T18:44:30+00:00
Next Scan 2025-06-25T18:44:30+00:00

Last Scan

Scanned2025-06-18T18:44:30+00:00
URL https://advguides.com/robots.txt
Domain IPs 34.111.179.208
Response IP 34.111.179.208
Found Yes
Hash ba7359c2fc2b5703148b7fd6a8f0a2776c46552055aa75331c32538261aeb172
SimHash 8020cbc4ff01

Groups

*

Rule Path
Allow /
Allow /about
Allow /explore
Allow /road-trip
Allow /weekly-digest
Allow /blog/
Allow /sitemap.xml
Disallow /admin
Disallow /api/
Disallow /dev/

Other Records

Field Value
sitemap https://adventurecollective.replit.app/sitemap.xml

Comments

  • robots.txt for The Adventure Collective
  • Disallow admin routes and any private/development areas
  • Specify the sitemap location