catholic-community.org
robots.txt

Robots Exclusion Standard data for catholic-community.org

Resource Scan

Scan Details

Site Domain catholic-community.org
Base Domain catholic-community.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-23T07:09:14+00:00
Next Scan 2026-03-24T07:09:14+00:00

Last Successful Scan

Scanned2024-05-10T09:48:42+00:00
URL https://catholic-community.org/robots.txt
Domain IPs 35.171.57.87, 52.21.5.176
Response IP 52.21.5.176
Found Yes
Hash 5f2d54613fe149a7b24e54bb2da2d2103ee22418582d555d9940bad464be852e
SimHash 430cd852c713

Groups

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow
Allow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://catholic-community.org/sitemap2956.xml