svobodanews.ru
robots.txt
Robots Exclusion Standard data for svobodanews.ru
Resource Scan
Scan Details
Site Domain | svobodanews.ru |
Base Domain | svobodanews.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-09-21T19:24:22+00:00 |
Next Scan | 2024-12-20T19:24:22+00:00 |
Last Successful Scan
Scanned | 2023-02-22T11:26:36+00:00 |
URL | https://svobodanews.ru/robots.txt |
Redirect | https://www.svoboda.org/robots.txt |
Redirect Domain | www.svoboda.org |
Redirect Base | svoboda.org |
Domain IPs | 23.32.29.104, 23.32.29.88, 2600:1413:b000:1b::17d7:70b, 2600:1413:b000:1b::17d7:716 |
Redirect IPs | 23.32.29.106, 23.32.29.90, 2600:1413:b000:1b::17d7:708, 2600:1413:b000:1b::17d7:709 |
Response IP | 23.53.33.176 |
Found | Yes |
Hash | 01f8537e1b8c5e7842d9d449210d651820227436ea8d7c9a518c6759bdcfc420 |
SimHash | 6a4cd84afa13 |
Groups
*
Rule | Path |
---|---|
Disallow | /z/*/*/*/* |
Disallow | /tv/*/*/*/*/* |
Disallow | /radio/*/*/*/*/* |
Disallow | /schedule/*/*/*/*/* |
Disallow | /*d%3D*m%3D*y%3D* |
Disallow | /*wr%3D1 |
Disallow | /*?p=* |
Disallow | /comments/* |
Disallow | /player/* |
Disallow | /s?k=* |
Disallow | /login.html |
Disallow | /signup.html |
Disallow | /passwordrecovery.html |
Disallow | /navigation.html |
Disallow | /Navigation/* |
Disallow | /office365/login.html |
Other Records
Field | Value |
---|---|
sitemap | https://www.svoboda.org/sitemap.xml |
Warnings
- `clean-param` is not a known field.