redbot.org
robots.txt

Robots Exclusion Standard data for redbot.org

Resource Scan

Scan Details

Site Domain redbot.org
Base Domain redbot.org
Scan Status Ok
Last Scan2025-08-17T10:52:36+00:00
Next Scan 2025-09-16T10:52:36+00:00

Last Scan

Scanned2025-08-17T10:52:36+00:00
URL https://redbot.org/robots.txt
Domain IPs 2600:3c01::f03c:92ff:fe89:3e33, 45.79.113.165
Response IP 45.79.113.165
Found Yes
Hash 1f045913eb6c4fe55dd32342f1795d401df415feb0e4c3cf4afbb6560a4797d1
SimHash 5d54d050d755

Groups

femtosearchbot

Rule Path
Disallow *

blexbot

Rule Path
Disallow *

*

Rule Path
Disallow /?
Disallow /webui.py
Disallow /index.cgi
Allow /

Comments

  • Badly behaved
  • Everyone else