cookspedia.com
robots.txt

Robots Exclusion Standard data for cookspedia.com

Resource Scan

Scan Details

Site Domain cookspedia.com
Base Domain cookspedia.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-12T12:09:43+00:00
Next Scan 2025-10-10T12:09:43+00:00

Last Successful Scan

Scanned2024-03-20T11:09:25+00:00
URL https://cookspedia.com/robots.txt
Redirect https://www.cookspedia.com/robots.txt
Redirect Domain www.cookspedia.com
Redirect Base cookspedia.com
Domain IPs 104.21.12.129, 172.67.152.79, 2606:4700:3033::ac43:984f, 2606:4700:3034::6815:c81
Redirect IPs 104.21.12.129, 172.67.152.79, 2606:4700:3033::ac43:984f, 2606:4700:3034::6815:c81
Response IP 172.67.152.79
Found Yes
Hash 6b2829df1e71dcecd737c024a340659b63721aa80c13ad4962aeaaf244f1f01a
SimHash 095894f4df33

Groups

*

Rule Path
Allow /
Allow /sitemap.htm

Other Records

Field Value
sitemap https://www.cookspedia.com/sitemap.xml
sitemap https://www.cookspedia.com/sitemap_1.xml
sitemap https://www.cookspedia.com/sitemap_sections.xml