crispcooking.com
robots.txt

Robots Exclusion Standard data for crispcooking.com

Resource Scan

Scan Details

Site Domain crispcooking.com
Base Domain crispcooking.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-08T13:58:55+00:00
Next Scan 2025-12-08T13:58:55+00:00

Last Successful Scan

Scanned2025-10-09T13:40:30+00:00
URL https://crispcooking.com/robots.txt
Domain IPs 104.21.31.63, 172.67.175.57, 2606:4700:3032::6815:1f3f, 2606:4700:3033::ac43:af39
Response IP 104.21.31.63
Found Yes
Hash a2b07486844a3dddbebd4a4107df674ba624e8cf96288c0cfe0af29d401b8a4a
SimHash 610018008f92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://crispcooking.com/sitemap_index.xml