Log In Sign Up

arcadecalc.vercel.app
robots.txt

Robots Exclusion Standard data for arcadecalc.vercel.app

Resource Scan

Scan Details

Site Domain arcadecalc.vercel.app
Base Domain arcadecalc.vercel.app
Scan Status Ok
Last Scan2025-08-14T05:09:55+00:00
Next Scan 2025-09-13T05:09:55+00:00

Last Scan

Scanned2025-08-14T05:09:55+00:00
URL https://arcadecalc.vercel.app/robots.txt
Domain IPs 216.198.79.131, 64.29.17.131
Response IP 216.198.79.195
Found Yes
Hash 1f3cc9637a50ef0f90cf3d94275408b96f592d089fd793a113b1e719a3561982
SimHash 4dacd854c7b6

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/
Disallow /private/
Disallow /.vercel/

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Allow /
Disallow /admin/
Disallow /api/
Disallow /private/
Disallow /.vercel/

bingbot

Rule Path
Allow /
Disallow /admin/
Disallow /api/
Disallow /private/
Disallow /.vercel/
Back to top

Other Records

Field Value
sitemap https://arcadecalc.vercel.app/sitemap.xml
Back to top

Comments

  • ====================================
  • 🤖 General Settings
  • ====================================
  • ✅ Recommended Crawl Delay (some bots may ignore)
  • ====================================
  • 🔍 Googlebot Specific
  • ====================================
  • ====================================
  • 🔍 Bingbot Specific
  • ====================================
  • ====================================
  • 📍 Sitemap & Canonical Path
  • ====================================
Back to top