wwwc.aftonbladet.se
robots.txt
Robots Exclusion Standard data for wwwc.aftonbladet.se
Resource Scan
Scan Details
| Site Domain | wwwc.aftonbladet.se |
| Base Domain | aftonbladet.se |
| Scan Status | Ok |
| Last Scan | 2024-05-09T06:49:36+00:00 |
| Next Scan | 2024-05-16T06:49:36+00:00 |
Last Scan
| Scanned | 2024-05-09T06:49:36+00:00 |
| URL | https://wwwc.aftonbladet.se/robots.txt |
| Redirect | https://wwwc.aftonbladet-cdn.se/robots.txt |
| Redirect Domain | wwwc.aftonbladet-cdn.se |
| Redirect Base | aftonbladet-cdn.se |
| Domain IPs | 18.155.68.104, 18.155.68.27, 18.155.68.54, 18.155.68.58, 2600:9000:23d2:2800:14:2b4a:bb40:93a1, 2600:9000:23d2:4e00:14:2b4a:bb40:93a1, 2600:9000:23d2:600:14:2b4a:bb40:93a1, 2600:9000:23d2:7200:14:2b4a:bb40:93a1, 2600:9000:23d2:7c00:14:2b4a:bb40:93a1, 2600:9000:23d2:ba00:14:2b4a:bb40:93a1, 2600:9000:23d2:ee00:14:2b4a:bb40:93a1, 2600:9000:23d2:fa00:14:2b4a:bb40:93a1 |
| Redirect IPs | 18.155.68.103, 18.155.68.22, 18.155.68.33, 18.155.68.56 |
| Response IP | 18.155.68.33 |
| Found | Yes |
| Hash | 7a8dd6277914db278ee7279649ff2505959b490667d1498cf2761222bfeec8d5 |
| SimHash | 68094e058516 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /assets/jsp/ |
| Disallow | /brandstudio/ |
| Disallow | /contentstudio/ |
| Disallow | /nyheter/fastigheter/ |
| Disallow | /nyheter/trafik |
| Disallow | /resources/html5 |
| Disallow | /resources/links |
| Disallow | /resources/listing |
| Disallow | /resources/player |
| Disallow | /resources/webbtv |
| Disallow | /test/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.aftonbladet.se/sitemap.xml |