wettermail.de
robots.txt
Robots Exclusion Standard data for wettermail.de
Resource Scan
Scan Details
| Site Domain | wettermail.de |
| Base Domain | wettermail.de |
| Scan Status | Ok |
| Last Scan | 2025-05-14T17:24:58+00:00 |
| Next Scan | 2025-06-13T17:24:58+00:00 |
Last Scan
| Scanned | 2025-05-14T17:24:58+00:00 |
| URL | https://wettermail.de/robots.txt |
| Redirect | https://www.wettermail.de/robots.txt |
| Redirect Domain | www.wettermail.de |
| Redirect Base | wettermail.de |
| Domain IPs | 13.37.173.35, 2a05:d012:dd4:3f00:dda:3bf:9393:9324 |
| Redirect IPs | 13.224.245.12, 13.224.245.29, 13.224.245.42, 13.224.245.74, 2600:9000:21b3:200:2:4a2e:d380:93a1, 2600:9000:21b3:3400:2:4a2e:d380:93a1, 2600:9000:21b3:5e00:2:4a2e:d380:93a1, 2600:9000:21b3:a800:2:4a2e:d380:93a1, 2600:9000:21b3:ac00:2:4a2e:d380:93a1, 2600:9000:21b3:b800:2:4a2e:d380:93a1, 2600:9000:21b3:ba00:2:4a2e:d380:93a1, 2600:9000:21b3:e400:2:4a2e:d380:93a1 |
| Response IP | 108.156.22.103 |
| Found | Yes |
| Hash | 4f70b34a0a7ed974e8aacb5ce9b7c546a1d700b9a16e31e330f23b8ddfcd25cc |
| SimHash | c5715c5067d5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /grads/cgi-bin/ |
| Disallow | /opendata-dwd/cgi-bin/ |
| Disallow | /opendata-dwd/data/mos/l/index.html |
| Disallow | /opendata-dwd/data/mos/s/index.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |