mobil.aftonbladet.se
robots.txt
Robots Exclusion Standard data for mobil.aftonbladet.se
Resource Scan
Scan Details
| Site Domain | mobil.aftonbladet.se |
| Base Domain | aftonbladet.se |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-07-13T09:04:09+00:00 |
| Next Scan | 2024-10-11T09:04:09+00:00 |
Last Successful Scan
| Scanned | 2023-09-18T05:35:51+00:00 |
| URL | https://mobil.aftonbladet.se/robots.txt |
| Redirect | https://www.aftonbladet.se/robots.txt |
| Redirect Domain | www.aftonbladet.se |
| Redirect Base | aftonbladet.se |
| Domain IPs | 35.71.185.87, 52.223.48.227 |
| Redirect IPs | 13.224.249.19, 13.224.249.47, 13.224.249.72, 13.224.249.98, 2600:9000:21b4:1400:4:c4ba:ba40:93a1, 2600:9000:21b4:2800:4:c4ba:ba40:93a1, 2600:9000:21b4:3200:4:c4ba:ba40:93a1, 2600:9000:21b4:5e00:4:c4ba:ba40:93a1, 2600:9000:21b4:7000:4:c4ba:ba40:93a1, 2600:9000:21b4:be00:4:c4ba:ba40:93a1, 2600:9000:21b4:d800:4:c4ba:ba40:93a1, 2600:9000:21b4:ee00:4:c4ba:ba40:93a1 |
| Response IP | 13.224.249.47 |
| Found | Yes |
| Hash | 2740dcffc6c013e45e85114ccc680a39b73a71ba22506660eb0c6a021bd8b866 |
| SimHash | 48187ca18516 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /assets/jsp/ |
| Disallow | /contentstudio/ |
| Disallow | /resources/html5 |
| Disallow | /resources/links |
| Disallow | /resources/listing |
| Disallow | /resources/player |
| Disallow | /resources/webbtv |
| Disallow | /test/ |
| Disallow | /static/embed/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.aftonbladet.se/sitemap.xml |
Comments