no-px.vercel.app
robots.txt

Robots Exclusion Standard data for no-px.vercel.app

Resource Scan

Scan Details

Site Domain no-px.vercel.app
Base Domain no-px.vercel.app
Scan Status Ok
Last Scan2025-11-07T04:54:44+00:00
Next Scan 2025-11-14T04:54:44+00:00

Last Scan

Scanned2025-11-07T04:54:44+00:00
URL https://no-px.vercel.app/robots.txt
Domain IPs 216.198.79.3, 64.29.17.3
Response IP 216.198.79.195
Found Yes
Hash 629c1c1f380ffebbce80bc0720bc8623fa44482d37b70df7341cd6260c5b20f8
SimHash 421acc22ed23

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0.5

*

Rule Path
Disallow /api/
Allow /puzzles/

Other Records

Field Value
sitemap https://no-px.vercel.app/sitemap.xml

Comments

  • Allow all crawlers
  • Crawl-delay for politeness
  • Sitemap location
  • Disallow admin/api routes if any
  • Allow search engines to crawl all minigame pages