cb01.co.im
robots.txt
Robots Exclusion Standard data for cb01.co.im
Resource Scan
Scan Details
Site Domain | cb01.co.im |
Base Domain | cb01.co.im |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2025-09-10T00:36:24+00:00 |
Next Scan | 2025-12-09T00:36:24+00:00 |
Last Successful Scan
Scanned | 2025-01-21T00:11:58+00:00 |
URL | https://cb01.co.im/robots.txt |
Redirect | https://cb01.ad/robots.txt |
Redirect Domain | cb01.ad |
Redirect Base | cb01.ad |
Domain IPs | 104.21.0.228, 172.67.128.92, 2606:4700:3033::ac43:805c, 2606:4700:3034::6815:e4 |
Redirect IPs | 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001 |
Response IP | 104.21.80.1 |
Found | Yes |
Hash | c56719af12d55d60436e290f75c8469458a40711478de278bed96db8ee20bfc7 |
SimHash | 590da4714433 |
Groups
*
Rule | Path |
---|---|
Disallow | /engine/go.php |
Disallow | /engine/download.php |
Disallow | /user/ |
Disallow | /newposts/ |
Disallow | /statistics.html |
Disallow | /*subaction%3Duserinfo |
Disallow | /*subaction%3Dnewposts |
Disallow | /*do%3Dlastcomments |
Disallow | /*do%3Dfeedback |
Disallow | /*do%3Dregister |
Disallow | /*do%3Dlostpassword |
Disallow | /*do%3Daddnews |
Disallow | /*do%3Dstats |
Disallow | /*do%3Dpm |
Disallow | /*do%3Dsearch |
Other Records
Field | Value |
---|---|
sitemap | https://cb01.ad/sitemap.xml |
Warnings
- `host` is not a known field.