bcb.su
robots.txt
Robots Exclusion Standard data for bcb.su
Resource Scan
Scan Details
Site Domain | bcb.su |
Base Domain | bcb.su |
Scan Status | Ok |
Last Scan | 5/15/2025, 4:31:46 PM |
Next Scan | 5/22/2025, 4:31:46 PM |
Last Scan
Scanned | 5/15/2025, 4:31:46 PM |
URL | https://bcb.su/robots.txt |
Domain IPs | 104.21.87.27, 172.67.168.174, 2606:4700:3031::ac43:a8ae, 2606:4700:3037::6815:571b |
Response IP | 172.67.168.174 |
Found | Yes |
Hash | b6bde9a03113b714951ef0da6858192dcebc5d1afed3425c0f74f6b7a4a2fe13 |
SimHash | 0941f32107c6 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /wp-admin |
Disallow | /wp-includes |
Disallow | /wp-content/plugins |
Disallow | /wp-content/cache |
Disallow | /wp-content/themes |
Disallow | /trackback |
Disallow | */trackback |
Disallow | */*/trackback |
Disallow | */*/feed/*/ |
Disallow | */feed |
Disallow | /*?* |
Disallow | /tag |
Disallow | /page/* |
Disallow | /interesnye-ssylki.html |
Disallow | *possible__unsafe__site* |
Disallow | *.html/amp |
Disallow | /?s=* |
Disallow | /amp/* |
Allow | /zen_feed/ |
Allow | /?yandex_feed=news |
Other Records
Field | Value |
---|---|
sitemap | https://bcb.su/sitemap.xml |
Warnings
- 1 invalid line.
- `host` is not a known field.