crafterest.com
robots.txt

Robots Exclusion Standard data for crafterest.com

Resource Scan

Scan Details

Site Domain crafterest.com
Base Domain crafterest.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-13T11:29:33+00:00
Next Scan 2026-03-13T11:29:33+00:00

Last Successful Scan

Scanned2025-01-25T08:35:03+00:00
URL https://crafterest.com/robots.txt
Domain IPs 192.196.157.102
Response IP 192.196.157.102
Found Yes
Hash 0321ec74e753dd1a312f9f34fe9099f7b82d38ed56bb348714dbb9782ddd54d7
SimHash 690008000fb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://crafterest.com/sitemap_index.xml