svspb.net
robots.txt
Robots Exclusion Standard data for svspb.net
Resource Scan
Scan Details
| Site Domain | svspb.net |
| Base Domain | svspb.net |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-03-06T10:29:00+00:00 |
| Next Scan | 2026-06-04T10:29:00+00:00 |
Last Successful Scan
| Scanned | 2025-04-25T19:04:07+00:00 |
| URL | https://svspb.net/robots.txt |
| Domain IPs | 185.26.122.18 |
| Response IP | 185.26.122.18 |
| Found | Yes |
| Hash | dadf1478fddea73014e964c16f0783acf36225e710b069751b4b1d8ad4c8aac3 |
| SimHash | a15669f08cb7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /m/ |
| Disallow | */wbank/* |
| Disallow | /html/poisk.php |
| Disallow | /html/yandex.* |
| Disallow | /html/google_map.php?lat=* |
| Disallow | /html/google-map.php?lat=* |
| Disallow | /html/karta-yandex.php?lat=* |
| Disallow | /novosti/wp-admin/ |
| Disallow | /novosti/wp-includes/ |
| Disallow | /novosti/category/ |
| Disallow | /novosti/*?* |
| Disallow | /novosti/*.php |
| Disallow | /novosti/2011/ |
| Disallow | /novosti/2012/ |
| Disallow | /novosti/2013/ |
| Disallow | /novosti/2014/ |
| Disallow | /novosti/2015/ |
| Disallow | /novosti/2016/ |
| Disallow | /novosti/2017/ |
| Disallow | /novosti/2018/ |
| Disallow | /novosti/2019/ |
| Disallow | /novosti/2020/ |
| Disallow | /novosti/2021/ |
| Disallow | /novosti/2022/ |
| Disallow | /novosti/2023/ |
| Disallow | /novosti/2024/ |
| Disallow | /novosti/2025/ |
| Disallow | /novosti/feed/ |
| Disallow | /novosti/comments/ |
| Disallow | /novosti/tag/ |
| Disallow | /novosti/wp-json/ |
| Disallow | *yrwinfo%3D |
| Disallow | *fbclid%3D |
| Disallow | *ref%3D |
| Disallow | *ysclid%3D |
| Disallow | *iframe%3D |
| Disallow | */page/* |
| Disallow | *pagespeed* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
Warnings
- `host` is not a known field.