wwwc.aftonbladet-cdn.se
robots.txt
Robots Exclusion Standard data for wwwc.aftonbladet-cdn.se
Resource Scan
Scan Details
Site Domain | wwwc.aftonbladet-cdn.se |
Base Domain | aftonbladet-cdn.se |
Scan Status | Ok |
Last Scan | 2024-09-26T19:34:59+00:00 |
Next Scan | 2024-10-03T19:34:59+00:00 |
Last Scan
Scanned | 2024-09-26T19:34:59+00:00 |
URL | https://wwwc.aftonbladet-cdn.se/robots.txt |
Domain IPs | 13.35.238.117, 13.35.238.49, 13.35.238.66, 13.35.238.97 |
Response IP | 54.230.71.126 |
Found | Yes |
Hash | 7a8dd6277914db278ee7279649ff2505959b490667d1498cf2761222bfeec8d5 |
SimHash | 68094e058516 |
Groups
*
Rule | Path |
---|---|
Disallow | /assets/jsp/ |
Disallow | /brandstudio/ |
Disallow | /contentstudio/ |
Disallow | /nyheter/fastigheter/ |
Disallow | /nyheter/trafik |
Disallow | /resources/html5 |
Disallow | /resources/links |
Disallow | /resources/listing |
Disallow | /resources/player |
Disallow | /resources/webbtv |
Disallow | /test/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.aftonbladet.se/sitemap.xml |