Log In Sign Up

gobattle.io
robots.txt

Robots Exclusion Standard data for gobattle.io

Resource Scan

Scan Details

Site Domain gobattle.io
Base Domain gobattle.io
Scan Status Ok
Last Scan2025-09-10T23:01:20+00:00
Next Scan 2025-09-17T23:01:20+00:00

Last Scan

Scanned2025-09-10T23:01:20+00:00
URL https://gobattle.io/robots.txt
Domain IPs 104.26.0.241, 104.26.1.241, 172.67.69.243, 2606:4700:20::681a:1f1, 2606:4700:20::681a:f1, 2606:4700:20::ac43:45f3
Response IP 104.26.0.241
Found Yes
Hash 491b38f8253460e9fa7490b901110bd4c991d1c8f6e41d0aa63177d8c1b32756
SimHash 6c140076c721

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /private/

Other Records

Field Value
crawl-delay 10

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

slurp

Rule Path
Disallow /*.php$
Disallow /*.js$
Disallow /*.css$
Disallow /*.xml$
Allow /style104/favicon.png
Allow /style104/luiser.gif
Allow /images/gobattle-icon.png
Allow /images/preview.png
Disallow /*?*
Disallow /*~
Disallow /*
Disallow /*.bak$
Disallow /*.swp$

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://gobattle.io/sitemap.xml
Back to top

Comments

  • Allow search engines to access the sitemap
  • Crawl-delay for all bots
  • Specific rules for major search engines
  • Disallow certain file types
  • Allow access to specific files
  • Disallow access to temporary or development files
Back to top