curiofeed.com
robots.txt

Robots Exclusion Standard data for curiofeed.com

Resource Scan

Scan Details

Site Domain curiofeed.com
Base Domain curiofeed.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-09T14:22:38+00:00
Next Scan 2025-06-08T14:22:38+00:00

Last Successful Scan

Scanned2025-04-10T14:21:52+00:00
URL https://curiofeed.com/robots.txt
Domain IPs 104.21.93.214, 172.67.215.77, 2606:4700:3030::6815:5dd6, 2606:4700:3032::ac43:d74d
Response IP 104.21.93.214
Found Yes
Hash 53f351c9bc1ccf3d08076dadd25c74a749cfcc4752b594321a1221aef9e55303
SimHash 49018c4089b3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://curiofeed.com/sitemap_index.xml