dopaverse.org
robots.txt

Robots Exclusion Standard data for dopaverse.org

Resource Scan

Scan Details

Site Domain dopaverse.org
Base Domain dopaverse.org
Scan Status Ok
Last Scan2026-02-02T23:31:17+00:00
Next Scan 2026-03-04T23:31:17+00:00

Last Scan

Scanned2026-02-02T23:31:17+00:00
URL https://dopaverse.org/robots.txt
Domain IPs 104.21.78.121, 172.67.220.247, 2606:4700:3034::ac43:dcf7, 2606:4700:3035::6815:4e79
Response IP 104.21.78.121
Found Yes
Hash df91bf9b37e42c0efb93fc7bb825d2e30a3a320960b1d92f53598896a59cf724
SimHash 610cdf40e4a2

Groups

*

Rule Path
Allow /
Disallow /_next/
Disallow /api/
Disallow /*.json$
Disallow /*?*
Allow /fonts/
Allow /*.jpg$
Allow /*.png$
Allow /*.svg$
Allow /*.webp$

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://dopaverse.org/sitemap.xml

Comments

  • Sitemap location
  • Crawl delay for bots
  • Block unnecessary paths
  • Allow important files