side.quest
robots.txt

Robots Exclusion Standard data for side.quest

Resource Scan

Scan Details

Site Domain side.quest
Base Domain side.quest
Scan Status Ok
Last Scan2025-11-28T02:24:24+00:00
Next Scan 2025-12-05T02:24:24+00:00

Last Scan

Scanned2025-11-28T02:24:24+00:00
URL https://side.quest/robots.txt
Domain IPs 104.21.37.19, 172.67.202.158, 2606:4700:3032::6815:2513, 2606:4700:3037::ac43:ca9e
Response IP 172.67.202.158
Found Yes
Hash 6173cb2ffcbab2cc7a8e26c8d8df5dfb009667ed91e73e6363257827567de9c6
SimHash 44321d134587

Groups

*

Rule Path
Disallow /search/
Disallow /user/*
Disallow /sideload/*

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://sidequestvr.com/sitemap_index.xml

Comments

  • robots.txt for https://sidequestvr.com
  • Controls search engine crawler access and behavior
  • Apply rules to all crawlers
  • Crawl delay to manage server load (3 seconds between requests)
  • Disallow crawling of search results
  • Sitemap location for search engines