botl.org
robots.txt

Robots Exclusion Standard data for botl.org

Resource Scan

Scan Details

Site Domain botl.org
Base Domain botl.org
Scan Status Ok
Last Scan2024-10-25T00:22:10+00:00
Next Scan 2024-11-24T00:22:10+00:00

Last Scan

Scanned2024-10-25T00:22:10+00:00
URL http://botl.org/robots.txt
Redirect http://www.botl.org/robots.txt
Redirect Domain www.botl.org
Redirect Base botl.org
Domain IPs 96.30.49.198
Redirect IPs 96.30.49.198
Response IP 96.30.49.198
Found Yes
Hash add3c883d2c9d3009b10758963766333dcaf2878e8485d1e50a205c8b0dce958
SimHash 6552d5d5d115

Groups

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60