cb01.co.im
robots.txt

Robots Exclusion Standard data for cb01.co.im

Resource Scan

Scan Details

Site Domain cb01.co.im
Base Domain cb01.co.im
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-10T00:36:24+00:00
Next Scan 2025-12-09T00:36:24+00:00

Last Successful Scan

Scanned2025-01-21T00:11:58+00:00
URL https://cb01.co.im/robots.txt
Redirect https://cb01.ad/robots.txt
Redirect Domain cb01.ad
Redirect Base cb01.ad
Domain IPs 104.21.0.228, 172.67.128.92, 2606:4700:3033::ac43:805c, 2606:4700:3034::6815:e4
Redirect IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.80.1
Found Yes
Hash c56719af12d55d60436e290f75c8469458a40711478de278bed96db8ee20bfc7
SimHash 590da4714433

Groups

*

Rule Path
Disallow /engine/go.php
Disallow /engine/download.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch

Other Records

Field Value
sitemap https://cb01.ad/sitemap.xml

Warnings

  • `host` is not a known field.