cogswell.io
robots.txt

Robots Exclusion Standard data for cogswell.io

Resource Scan

Scan Details

Site Domain cogswell.io
Base Domain cogswell.io
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-01-05T07:23:41+00:00
Next Scan 2026-02-04T07:23:41+00:00

Last Successful Scan

Scanned2025-10-27T12:31:36+00:00
URL https://cogswell.io/robots.txt
Domain IPs 13.248.213.45, 76.223.67.189
Response IP 13.248.213.45
Found Yes
Hash 84f7242b69a0d079d88d20a768e20124979f0499d2b0e5b947cc4b32bc07dff9
SimHash 691989d3c4b1

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap /sitemap.xml

Warnings

  • `llm-policy` is not a known field.