diopitt.org
robots.txt

Robots Exclusion Standard data for diopitt.org

Resource Scan

Scan Details

Site Domain diopitt.org
Base Domain diopitt.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-13T11:12:06+00:00
Next Scan 2026-04-14T11:12:06+00:00

Last Successful Scan

Scanned2024-04-01T22:00:45+00:00
URL https://diopitt.org/robots.txt
Domain IPs 52.21.5.176
Response IP 52.21.5.176
Found Yes
Hash 47f45eb47ad98d706645dd69b5478a35379def633490265c05dbe6d1c030d2a9
SimHash 6b04d813c713

Groups

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow
Allow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://diopitt.org/sitemap16469.xml