deutsche-welle.com
robots.txt
Robots Exclusion Standard data for deutsche-welle.com
Resource Scan
Scan Details
| Site Domain | deutsche-welle.com |
| Base Domain | deutsche-welle.com |
| Scan Status | Ok |
| Last Scan | 2024-05-13T07:43:56+00:00 |
| Next Scan | 2024-05-20T07:43:56+00:00 |
Last Scan
| Scanned | 2024-05-13T07:43:56+00:00 |
| URL | https://www.deutsche-welle.com/robots.txt |
| Domain IPs | 20.224.123.88 |
| Response IP | 20.224.123.88 |
| Found | Yes |
| Hash | d6b0601ecb8ebe33568778b24992e120e71e0025c068eed3a41e6dce75bc3f81 |
| SimHash | f188c942c1b1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search/ |
| Disallow | /overlay/ |
| Disallow | /popups/mediaplayer/ |
| Disallow | /popups/popup_gallery/ |
| Disallow | /*/layoutvorlagen/ |
| Disallow | /*/user/account$ |
| Disallow | /*/user/activity$ |
| Disallow | /*/user/profile$ |
| Disallow | /*/user/password/change$ |
| Disallow | /*/user/password/set$ |
| Disallow | /*/user/feedback/status?type=* |
| Disallow | /*/user/register/confirm$ |
| Disallow | /*/user/email/change$ |
| Disallow | /*?maca=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.deutsche-welle.com/sitemap.xml |