dioceseduluth.org
robots.txt

Robots Exclusion Standard data for dioceseduluth.org

Resource Scan

Scan Details

Site Domain dioceseduluth.org
Base Domain dioceseduluth.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-26T00:40:42+00:00
Next Scan 2025-11-25T00:40:42+00:00

Last Successful Scan

Scanned2023-07-16T13:33:05+00:00
URL https://www.dioceseduluth.org/robots.txt
Domain IPs 104.18.205.221, 104.18.206.221, 2606:4700::6812:cddd, 2606:4700::6812:cedd
Response IP 104.18.206.221
Found Yes
Hash b75b96d71c34460d01eeecbe67a64195f352c3f38bd6c74d5087613bb1d69120
SimHash 6550dc546711

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10