ntv.de
robots.txt
Robots Exclusion Standard data for ntv.de
Resource Scan
Scan Details
Site Domain | ntv.de |
Base Domain | ntv.de |
Scan Status | Ok |
Last Scan | 2024-05-10T12:15:12+00:00 |
Next Scan | 2024-05-17T12:15:12+00:00 |
Last Scan
Scanned | 2024-05-10T12:15:12+00:00 |
URL | https://ntv.de/robots.txt |
Redirect | https://www.n-tv.de/robots.txt |
Redirect Domain | www.n-tv.de |
Redirect Base | n-tv.de |
Domain IPs | 18.65.3.102, 18.65.3.110, 18.65.3.16, 18.65.3.58, 2600:9000:2366:0:a:8b4a:4700:93a1, 2600:9000:2366:4400:a:8b4a:4700:93a1, 2600:9000:2366:8800:a:8b4a:4700:93a1, 2600:9000:2366:c00:a:8b4a:4700:93a1, 2600:9000:2366:c400:a:8b4a:4700:93a1, 2600:9000:2366:f600:a:8b4a:4700:93a1, 2600:9000:2366:f800:a:8b4a:4700:93a1, 2600:9000:2366:fa00:a:8b4a:4700:93a1 |
Redirect IPs | 18.154.132.103, 18.154.132.114, 18.154.132.13, 18.154.132.92, 2600:9000:24db:1200:10:e1a5:2c0:93a1, 2600:9000:24db:3400:10:e1a5:2c0:93a1, 2600:9000:24db:5a00:10:e1a5:2c0:93a1, 2600:9000:24db:6800:10:e1a5:2c0:93a1, 2600:9000:24db:bc00:10:e1a5:2c0:93a1, 2600:9000:24db:ca00:10:e1a5:2c0:93a1, 2600:9000:24db:d600:10:e1a5:2c0:93a1, 2600:9000:24db:e200:10:e1a5:2c0:93a1 |
Response IP | 3.160.246.14 |
Found | Yes |
Hash | f28fd26c13b029e672ca586efc9198f650ef7e307d8f1bd29f374e31b26ed643 |
SimHash | 882e6bc0e150 |
Groups
*
Rule | Path |
---|---|
Disallow | /*?service=print |
Disallow | /*id9253371?ctxArt=*view=ajax-send |
Disallow | /ratgeber/check/* |
Disallow | /*-hds.f4m |
Disallow | /suche/ |
Disallow | /boersenkurse/suche/ |
Disallow | /stats/ |
Disallow | /jobboerse/ |
Disallow | /archiv/* |
*
Rule | Path |
---|---|
Allow | /news.xml |
Allow | / |
Comments