weatherspark.com
robots.txt
Robots Exclusion Standard data for weatherspark.com
Resource Scan
Scan Details
| Site Domain | weatherspark.com |
| Base Domain | weatherspark.com |
| Scan Status | Ok |
| Last Scan | 2024-09-21T08:06:46+00:00 |
| Next Scan | 2024-09-28T08:06:46+00:00 |
Last Scan
| Scanned | 2024-09-21T08:06:46+00:00 |
| URL | https://weatherspark.com/robots.txt |
| Domain IPs | 18.155.68.107, 18.155.68.80, 18.155.68.85, 18.155.68.94 |
| Response IP | 18.155.68.85 |
| Found | Yes |
| Hash | 2c362c389396bca65181e9487938c7d94dd5e3bc3b258663fea8d31eaa5e93a4 |
| SimHash | 6ba5be60ebd7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /d/ |
| Disallow | /td/ |
| Disallow | /h/d/ |
| Disallow | /h/td/ |
| Disallow | /countries/d/ |
| Disallow | /compare/s/ |
| Disallow | /compare/m/ |
| Disallow | /compare/d/ |
| Disallow | /map |
| Disallow | /search |
| Disallow | /license |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://weatherspark.com/sitemap.xml |