botlist.me
robots.txt

Robots Exclusion Standard data for botlist.me

Resource Scan

Scan Details

Site Domain botlist.me
Base Domain botlist.me
Scan Status Ok
Last Scan2025-11-01T21:41:04+00:00
Next Scan 2025-11-08T21:41:04+00:00

Last Scan

Scanned2025-11-01T21:41:04+00:00
URL https://botlist.me/robots.txt
Domain IPs 104.21.54.130, 172.67.138.182, 2606:4700:3035::ac43:8ab6, 2606:4700:3036::6815:3682
Response IP 104.21.54.130
Found Yes
Hash eaeaa8d3511d1622227d89707d995b8b1f0902f5b86fdbe58882d1cef260d4d7
SimHash 4150c1524731

Groups

*

Rule Path
Allow /