crispexcel.com
robots.txt

Robots Exclusion Standard data for crispexcel.com

Resource Scan

Scan Details

Site Domain crispexcel.com
Base Domain crispexcel.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-06-22T09:06:15+00:00
Next Scan 2025-08-21T09:06:15+00:00

Last Successful Scan

Scanned2025-04-01T09:05:03+00:00
URL https://crispexcel.com/robots.txt
Redirect https://www.crispexcel.com/robots.txt
Redirect Domain www.crispexcel.com
Redirect Base crispexcel.com
Domain IPs 104.21.74.51, 172.67.155.64, 2606:4700:3031::6815:4a33, 2606:4700:3035::ac43:9b40
Redirect IPs 104.21.74.51, 172.67.155.64, 2606:4700:3031::6815:4a33, 2606:4700:3035::ac43:9b40
Response IP 172.67.155.64
Found Yes
Hash ca3896063fc0cb3f6a1d4ce1b2ae095d095da570c7ea1aa589b844bc42374f63
SimHash 4900d8404bb3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.crispexcel.com/sitemap_index.xml