news-des-tages.com
robots.txt
Robots Exclusion Standard data for news-des-tages.com
Resource Scan
Scan Details
Site Domain | news-des-tages.com |
Base Domain | news-des-tages.com |
Scan Status | Ok |
Last Scan | 2024-06-07T04:41:38+00:00 |
Next Scan | 2024-06-14T04:41:38+00:00 |
Last Scan
Scanned | 2024-06-07T04:41:38+00:00 |
URL | https://www.news-des-tages.com/robots.txt |
Domain IPs | 18.164.174.122, 18.164.174.6, 18.164.174.64, 18.164.174.96, 2600:9000:25f1:0:1f:f026:ab00:93a1, 2600:9000:25f1:2400:1f:f026:ab00:93a1, 2600:9000:25f1:2c00:1f:f026:ab00:93a1, 2600:9000:25f1:5000:1f:f026:ab00:93a1, 2600:9000:25f1:5400:1f:f026:ab00:93a1, 2600:9000:25f1:5e00:1f:f026:ab00:93a1, 2600:9000:25f1:a400:1f:f026:ab00:93a1, 2600:9000:25f1:ee00:1f:f026:ab00:93a1 |
Response IP | 18.165.171.2 |
Found | Yes |
Hash | 0b713281393c852f8703e1dde5c44d590245c40e6df813f42301153724ab031e |
SimHash | 2ba2c2c70752 |
Groups
*
Rule | Path |
---|---|
Allow | /breaking-news-us/ |
Allow | /breaking-news-canada/ |
Disallow | /category/politik/ |
Allow | /category/news/ |
Disallow | /category/wirtschaft/ |
Disallow | /category/sport/ |
Disallow | /category/gesellschaft/ |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /wp-content/plugins/ |
Disallow | /wp-content/cache/ |
Disallow | /wp-content/themes/ |
Disallow | /wp-admin/admin-ajax.php |
Disallow | /imprint-info |
Disallow | /impressum/ |
Disallow | /impressum |
Disallow | /you-have-been-unsubscribed/ |
Disallow | /newsletter-abmeldung/ |
Disallow | /newsletter-anmeldung/ |
Disallow | /datenschutzerklaerung/ |
Disallow | /datenschutzerklaerung |
Warnings
- `host` is not a known field.
- `noindex` is not a known field.
Comments