bots.gg
robots.txt

Robots Exclusion Standard data for bots.gg

Resource Scan

Scan Details

Site Domain bots.gg
Base Domain bots.gg
Scan Status Ok
Last Scan2026-02-15T01:50:52+00:00
Next Scan 2026-03-17T01:50:52+00:00

Last Scan

Scanned2026-02-15T01:50:52+00:00
URL https://bots.gg/robots.txt
Redirect https://discord.bots.gg/robots.txt
Redirect Domain discord.bots.gg
Redirect Base bots.gg
Domain IPs 104.26.12.205, 104.26.13.205, 172.67.74.152, 2606:4700:20::681a:ccd, 2606:4700:20::681a:dcd, 2606:4700:20::ac43:4a98
Redirect IPs 104.26.12.205, 104.26.13.205, 172.67.74.152, 2606:4700:20::681a:ccd, 2606:4700:20::681a:dcd, 2606:4700:20::ac43:4a98
Response IP 104.26.13.205
Found Yes
Hash d58110aba3c716e61fffdb1737dde5203b322c22bbd8efa61d5af18b78460504
SimHash e842db208531

Groups

*

Rule Path
Disallow /profile
Disallow /login
Disallow /logout
Disallow /bots/dashboard
Disallow /api/v1/proxy

*

Rule Path
Allow /profile/*
Allow /bots/*
Disallow /bots/*/edit
Disallow /bots/*/delete
Allow /docs
Allow /docs/*

discordbot

Rule Path
Allow /

Comments

  • Disallow special user pages and proxy
  • Allow profiles
  • Allow documentation (should probably be disallowed)
  • ... but it's on our sitemap
  • Enable embeds on Discord