tw.weatherspark.com
robots.txt
Robots Exclusion Standard data for tw.weatherspark.com
Resource Scan
Scan Details
| Site Domain | tw.weatherspark.com |
| Base Domain | weatherspark.com |
| Scan Status | Ok |
| Last Scan | 2024-10-23T00:38:03+00:00 |
| Next Scan | 2024-11-22T00:38:03+00:00 |
Last Scan
| Scanned | 2024-10-23T00:38:03+00:00 |
| URL | https://tw.weatherspark.com/robots.txt |
| Domain IPs | 18.155.68.107, 18.155.68.80, 18.155.68.85, 18.155.68.94 |
| Response IP | 18.155.68.85 |
| Found | Yes |
| Hash | ee526461455a3dc8d68de43092cbb69ba28d7e097719c5af67af372e61f02fcb |
| SimHash | 6984fc60ebd7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /d/ |
| Disallow | /td/ |
| Disallow | /h/d/ |
| Disallow | /h/td/ |
| Disallow | /countries/d/ |
| Disallow | /compare/s/ |
| Disallow | /compare/m/ |
| Disallow | /compare/d/ |
| Disallow | /map |
| Disallow | /search |
| Disallow | /license |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://tw.weatherspark.com/sitemap.xml |