dioceseofprovidence.org
robots.txt

Robots Exclusion Standard data for dioceseofprovidence.org

Resource Scan

Scan Details

Site Domain dioceseofprovidence.org
Base Domain dioceseofprovidence.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-19T19:21:13+00:00
Next Scan 2026-04-20T19:21:13+00:00

Last Successful Scan

Scanned2025-11-29T15:53:14+00:00
URL https://dioceseofprovidence.org/robots.txt
Domain IPs 104.16.167.2, 35.171.57.87, 52.21.5.176
Response IP 52.21.5.176
Found Yes
Hash c31f095d9ec70d23bba7fbf3d0de5eb2f20b824003ef6dbd67fed6e52ebd3333
SimHash 6144d8114333

Groups

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow
Allow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://dioceseofprovidence.org/sitemap5523.xml