thueringer-allgemeine.de
robots.txt
Robots Exclusion Standard data for thueringer-allgemeine.de
Resource Scan
Scan Details
| Site Domain | thueringer-allgemeine.de |
| Base Domain | thueringer-allgemeine.de |
| Scan Status | Ok |
| Last Scan | 2024-06-22T04:08:19+00:00 |
| Next Scan | 2024-06-29T04:08:19+00:00 |
Last Scan
| Scanned | 2024-06-22T04:08:19+00:00 |
| URL | https://thueringer-allgemeine.de/robots.txt |
| Redirect | https://www.thueringer-allgemeine.de:443/robots.txt |
| Redirect Domain | www.thueringer-allgemeine.de |
| Redirect Base | thueringer-allgemeine.de |
| Domain IPs | 18.185.81.127, 18.196.221.37, 3.72.121.83 |
| Redirect IPs | 108.157.254.10, 108.157.254.110, 108.157.254.74, 108.157.254.98, 2600:9000:2753:4400:0:747c:e140:93a1, 2600:9000:2753:4c00:0:747c:e140:93a1, 2600:9000:2753:6600:0:747c:e140:93a1, 2600:9000:2753:ac00:0:747c:e140:93a1, 2600:9000:2753:c400:0:747c:e140:93a1, 2600:9000:2753:d000:0:747c:e140:93a1, 2600:9000:2753:e400:0:747c:e140:93a1, 2600:9000:2753:f400:0:747c:e140:93a1 |
| Response IP | 108.157.254.10 |
| Found | Yes |
| Hash | d2ed7c8fc7a41768200563ca12e550046de6ef71be374b0e13298d47da6e7296 |
| SimHash | 9015d877cf13 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /static/*/client.js |
| Allow | /static/*/main.css |
| Allow | /static/*/favicon.png |
| Disallow | /stats/* |
| Disallow | /*?config* |
| Disallow | /*.xmli* |
| Disallow | /*?service=Ajax |
| Disallow | /*?service=ajax |
| Disallow | /config/* |
| Disallow | /test/* |
| Disallow | /Test/* |
| Disallow | /template/* |
| Disallow | /*?*token=* |
| Disallow | /*?*eventId=* |
| Disallow | /static/* |
| Disallow | /migration_import_no_section/* |
| Disallow | /secure/ |
| Disallow | /socialmedia/* |
| Disallow | *reader_id%3DREADER_ID* |
| Disallow | /suche/* |
| Disallow | /*?widgetid= |
| Disallow | /newsletter-result/ |
| Disallow | *tpcc%3D* |
| Disallow | /resources/ |
| Disallow | /bin/ |
| Disallow | /downloads/ |
| Disallow | /service/newsletter-adconsent |
| Disallow | /pagespeed_static/ |
| Disallow | /resources/img/*icon*pagespeed |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.thueringer-allgemeine.de/sitemaps/news.xml |