svobodanews.ru
robots.txt
Robots Exclusion Standard data for svobodanews.ru
Resource Scan
Scan Details
| Site Domain | svobodanews.ru |
| Base Domain | svobodanews.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-03-25T16:32:15+00:00 |
| Next Scan | 2024-06-23T16:32:15+00:00 |
Last Successful Scan
| Scanned | 2023-02-22T11:26:36+00:00 |
| URL | https://svobodanews.ru/robots.txt |
| Redirect | https://www.svoboda.org/robots.txt |
| Redirect Domain | www.svoboda.org |
| Redirect Base | svoboda.org |
| Domain IPs | 23.32.29.104, 23.32.29.88, 2600:1413:b000:1b::17d7:70b, 2600:1413:b000:1b::17d7:716 |
| Redirect IPs | 23.32.29.106, 23.32.29.90, 2600:1413:b000:1b::17d7:708, 2600:1413:b000:1b::17d7:709 |
| Response IP | 23.53.33.176 |
| Found | Yes |
| Hash | 01f8537e1b8c5e7842d9d449210d651820227436ea8d7c9a518c6759bdcfc420 |
| SimHash | 6a4cd84afa13 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /z/*/*/*/* |
| Disallow | /tv/*/*/*/*/* |
| Disallow | /radio/*/*/*/*/* |
| Disallow | /schedule/*/*/*/*/* |
| Disallow | /*d%3D*m%3D*y%3D* |
| Disallow | /*wr%3D1 |
| Disallow | /*?p=* |
| Disallow | /comments/* |
| Disallow | /player/* |
| Disallow | /s?k=* |
| Disallow | /login.html |
| Disallow | /signup.html |
| Disallow | /passwordrecovery.html |
| Disallow | /navigation.html |
| Disallow | /Navigation/* |
| Disallow | /office365/login.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.svoboda.org/sitemap.xml |
Warnings
- `clean-param` is not a known field.