ww.colonist.io
robots.txt

Robots Exclusion Standard data for ww.colonist.io

Resource Scan

Scan Details

Site Domain ww.colonist.io
Base Domain colonist.io
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-30T10:14:49+00:00
Next Scan 2024-07-29T10:14:49+00:00

Last Successful Scan

Scanned2023-06-29T10:12:04+00:00
URL http://ww.colonist.io/robots.txt
Domain IPs 104.131.24.197
Response IP 104.131.24.197
Found Yes
Hash e222c71155f9400e4b48bfba70f8972e37af2048940afc0455ab42e84ac4ba5c
SimHash 495c9d514533

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://colonist.io/sitemap.xml