drf-tv.de
robots.txt

Robots Exclusion Standard data for drf-tv.de

Resource Scan

Scan Details

Site Domain drf-tv.de
Base Domain drf-tv.de
Scan Status Ok
Last Scan2024-06-28T10:36:45+00:00
Next Scan 2024-07-05T10:36:45+00:00

Last Scan

Scanned2024-06-28T10:36:45+00:00
URL http://drf-tv.de/robots.txt
Redirect https://www.tv-mittelrhein.de//robots.txt
Redirect Domain www.tv-mittelrhein.de
Redirect Base tv-mittelrhein.de
Domain IPs 2001:8d8:100f:f000::26f, 217.160.0.243
Redirect IPs 82.140.15.120
Response IP 82.140.15.120
Found Yes
Hash 44bdee0c0c2e74c40909574ffe8fd1ccec0c8fa2cf316d8bfe7f7372d22e9ec3
SimHash 38501884c752

Groups

*

Rule Path
Disallow /mediathek/native
Disallow /files/
Disallow /fonts/

webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
penthesilea

Rule Path
Disallow /