news-des-tages.com
robots.txt

Robots Exclusion Standard data for news-des-tages.com

Resource Scan

Scan Details

Site Domain news-des-tages.com
Base Domain news-des-tages.com
Scan Status Ok
Last Scan2024-06-07T04:41:38+00:00
Next Scan 2024-06-14T04:41:38+00:00

Last Scan

Scanned2024-06-07T04:41:38+00:00
URL https://www.news-des-tages.com/robots.txt
Domain IPs 18.164.174.122, 18.164.174.6, 18.164.174.64, 18.164.174.96, 2600:9000:25f1:0:1f:f026:ab00:93a1, 2600:9000:25f1:2400:1f:f026:ab00:93a1, 2600:9000:25f1:2c00:1f:f026:ab00:93a1, 2600:9000:25f1:5000:1f:f026:ab00:93a1, 2600:9000:25f1:5400:1f:f026:ab00:93a1, 2600:9000:25f1:5e00:1f:f026:ab00:93a1, 2600:9000:25f1:a400:1f:f026:ab00:93a1, 2600:9000:25f1:ee00:1f:f026:ab00:93a1
Response IP 18.165.171.2
Found Yes
Hash 0b713281393c852f8703e1dde5c44d590245c40e6df813f42301153724ab031e
SimHash 2ba2c2c70752

Groups

*

Rule Path
Allow /breaking-news-us/
Allow /breaking-news-canada/
Disallow /category/politik/
Allow /category/news/
Disallow /category/wirtschaft/
Disallow /category/sport/
Disallow /category/gesellschaft/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /wp-admin/admin-ajax.php
Disallow /imprint-info
Disallow /impressum/
Disallow /impressum
Disallow /you-have-been-unsubscribed/
Disallow /newsletter-abmeldung/
Disallow /newsletter-anmeldung/
Disallow /datenschutzerklaerung/
Disallow /datenschutzerklaerung

Comments

  • This robots.txt file was created by Robots.txt Rewrite plugin: https://wordpress.org/plugins/robotstxt-rewrite/

Warnings

  • `host` is not a known field.
  • `noindex` is not a known field.