ru.weatherspark.com
robots.txt
Robots Exclusion Standard data for ru.weatherspark.com
Resource Scan
Scan Details
| Site Domain | ru.weatherspark.com |
| Base Domain | weatherspark.com |
| Scan Status | Ok |
| Last Scan | 2024-10-22T21:51:24+00:00 |
| Next Scan | 2024-11-21T21:51:24+00:00 |
Last Scan
| Scanned | 2024-10-22T21:51:24+00:00 |
| URL | https://ru.weatherspark.com/robots.txt |
| Domain IPs | 18.155.68.107, 18.155.68.80, 18.155.68.85, 18.155.68.94 |
| Response IP | 18.155.68.85 |
| Found | Yes |
| Hash | 17e6c4428e60332eb6f8b23adbac7bef4ccc8a6b8dbd8ddaa0c7106b93bbe4f4 |
| SimHash | 6905be60ebd7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /d/ |
| Disallow | /td/ |
| Disallow | /h/d/ |
| Disallow | /h/td/ |
| Disallow | /countries/d/ |
| Disallow | /compare/s/ |
| Disallow | /compare/m/ |
| Disallow | /compare/d/ |
| Disallow | /map |
| Disallow | /search |
| Disallow | /license |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://ru.weatherspark.com/sitemap.xml |