waz.de
robots.txt
Robots Exclusion Standard data for waz.de
Resource Scan
Scan Details
Site Domain | waz.de |
Base Domain | waz.de |
Scan Status | Ok |
Last Scan | 2024-05-18T00:55:44+00:00 |
Next Scan | 2024-05-25T00:55:44+00:00 |
Last Scan
Scanned | 2024-05-18T00:55:44+00:00 |
URL | https://waz.de/robots.txt |
Redirect | https://www.waz.de:443/robots.txt |
Redirect Domain | www.waz.de |
Redirect Base | waz.de |
Domain IPs | 18.185.81.127, 18.196.221.37, 3.72.121.83 |
Redirect IPs | 108.157.254.11, 108.157.254.30, 108.157.254.6, 108.157.254.63, 2600:9000:2753:2200:1d:a051:b9c0:93a1, 2600:9000:2753:3600:1d:a051:b9c0:93a1, 2600:9000:2753:8400:1d:a051:b9c0:93a1, 2600:9000:2753:a00:1d:a051:b9c0:93a1, 2600:9000:2753:b800:1d:a051:b9c0:93a1, 2600:9000:2753:ba00:1d:a051:b9c0:93a1, 2600:9000:2753:c400:1d:a051:b9c0:93a1, 2600:9000:2753:ce00:1d:a051:b9c0:93a1 |
Response IP | 108.157.254.63 |
Found | Yes |
Hash | 679f2c50cc96d1889c9de4cf28e666a3ad85d81947921e5d01681fffaa10fdef |
SimHash | 580fd050d631 |
Groups
*
Rule | Path |
---|---|
Allow | /static/*/client.js |
Allow | /static/*/main.css |
Allow | /static/*/favicon.png |
Disallow | /stats/* |
Disallow | /*?config* |
Disallow | /*.xmli* |
Disallow | /*?service=Ajax |
Disallow | /*?service=ajax |
Disallow | /config/* |
Disallow | /test/* |
Disallow | /Test/* |
Disallow | /template/* |
Disallow | /*?*token=* |
Disallow | /*?*eventId=* |
Disallow | /static/* |
Disallow | /migration_import_no_section/* |
Disallow | /secure/ |
Disallow | /socialmedia/* |
Disallow | *reader_id%3DREADER_ID* |
Disallow | /suche/* |
Disallow | /*?widgetid= |
Disallow | /newsletter-result/ |
Disallow | *tpcc%3D* |
Disallow | /resources/ |
Disallow | /bin/ |
Disallow | /downloads/ |
Disallow | /service/newsletter-adconsent |
Disallow | /pagespeed_static/ |
Disallow | /resources/img/*icon*pagespeed |
Other Records
Field | Value |
---|---|
sitemap | https://www.waz.de/sitemaps/news.xml |