sportobzor.ru
robots.txt
Robots Exclusion Standard data for sportobzor.ru
Resource Scan
Scan Details
Site Domain | sportobzor.ru |
Base Domain | sportobzor.ru |
Scan Status | Ok |
Last Scan | 2024-05-28T02:38:34+00:00 |
Next Scan | 2024-06-04T02:38:34+00:00 |
Last Scan
Scanned | 2024-05-28T02:38:34+00:00 |
URL | https://sportobzor.ru/robots.txt |
Redirect | https://www.sportobzor.ru/robots.txt |
Redirect Domain | www.sportobzor.ru |
Redirect Base | sportobzor.ru |
Domain IPs | 2a00:15f8:a000:5:1:11:7:8e8, 2a00:15f8:a000:5:1:12:7:8e8, 2a00:15f8:a000:5:1:13:7:8e8, 2a00:15f8:a000:5:1:14:7:8e8, 90.156.201.106, 90.156.201.113, 90.156.201.37, 90.156.201.87 |
Redirect IPs | 2a00:15f8:a000:5:1:11:7:8e8, 2a00:15f8:a000:5:1:12:7:8e8, 2a00:15f8:a000:5:1:13:7:8e8, 2a00:15f8:a000:5:1:14:7:8e8, 90.156.201.106, 90.156.201.113, 90.156.201.37, 90.156.201.87 |
Response IP | 90.156.201.106 |
Found | Yes |
Hash | 668a786785eda6e6146415ca322c2ff065cfbc15b32a2cf2a813ca35d151bab7 |
SimHash | 6b00cc05c393 |
Groups
*
Rule | Path |
---|---|
Disallow | /templates/site/js |
Disallow | /search.html |
Disallow | /login.html |
Disallow | /register.html |
Disallow | /sportclubs/search.html |
Disallow | /card/view/* |
Disallow | /card/search.html |
Other Records
Field | Value |
---|---|
sitemap | https://www.sportobzor.ru/sitemap.xml |
Warnings
- `host` is not a known field.