alexbecker.org
robots.txt

Robots Exclusion Standard data for alexbecker.org

Resource Scan

Scan Details

Site Domain alexbecker.org
Base Domain alexbecker.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-10-17T14:47:37+00:00
Next Scan 2025-01-15T14:47:37+00:00

Last Successful Scan

Scanned2023-09-01T12:11:06+00:00
URL https://alexbecker.org/robots.txt
Domain IPs 104.21.93.19, 172.67.202.182, 2606:4700:3033::ac43:cab6, 2606:4700:3034::6815:5d13
Response IP 172.67.202.182
Found Yes
Hash 69f6030ac73d906097765eab34b725d8b6820c637c31523b25032c475d027b4a
SimHash 6518d454e331

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5