jyllands-posten.dk
robots.txt
Robots Exclusion Standard data for jyllands-posten.dk
Resource Scan
Scan Details
Site Domain | jyllands-posten.dk |
Base Domain | jyllands-posten.dk |
Scan Status | Ok |
Last Scan | 2024-05-31T23:56:58+00:00 |
Next Scan | 2024-06-07T23:56:58+00:00 |
Last Scan
Scanned | 2024-05-31T23:56:58+00:00 |
URL | https://jyllands-posten.dk/robots.txt |
Domain IPs | 18.154.144.17, 18.154.144.27, 18.154.144.32, 18.154.144.65 |
Response IP | 18.165.171.27 |
Found | Yes |
Hash | 99d5c663e46736fd6c4a7fa370c6327748b39720b569d589500acc58ab627a35 |
SimHash | 323fda6407a6 |
Groups
*
Rule | Path |
---|---|
Disallow | /soeg/* |
Disallow | /incoming/ |
Disallow | /migration_catalog/ |
Disallow | /template/ |
Disallow | /banner/ |
Disallow | /xstream/ |
Disallow | /jptest/ |
Disallow | /aarhus/kompas/ |
Disallow | /service/topnyheder/biler/ |
Disallow | /service/topnyheder/bolig/ |
Disallow | /service/topnyheder/filmogtv/ |
Disallow | /service/topnyheder/madogvin/ |
Disallow | /service/topnyheder/rejser/ |
Disallow | /service/topnyheder/tema/ |
Disallow | /rabatkode/user/* |
Disallow | /rabatkode/ajax/* |
Disallow | /rabatkode/clickout/* |
Disallow | /rabatkode/gotoshop/* |
Disallow | /rabatkode/*/show/* |
Disallow | /bestil/* |
Other Records
Field | Value |
---|---|
sitemap | https://jyllands-posten.dk/sitemapindex.xml |
Comments