dradiowissen.de
robots.txt

Robots Exclusion Standard data for dradiowissen.de

Resource Scan

Scan Details

Site Domain dradiowissen.de
Base Domain dradiowissen.de
Scan Status Ok
Last Scan2024-09-20T01:45:43+00:00
Next Scan 2024-10-20T01:45:43+00:00

Last Scan

Scanned2024-09-20T01:45:43+00:00
URL https://dradiowissen.de/robots.txt
Redirect https://www.deutschlandfunknova.de/robots.txt
Redirect Domain www.deutschlandfunknova.de
Redirect Base deutschlandfunknova.de
Domain IPs 35.157.232.111
Redirect IPs 13.35.18.123, 13.35.18.20, 13.35.18.31, 13.35.18.48, 2600:9000:20c7:1200:17:fd98:e500:93a1, 2600:9000:20c7:6800:17:fd98:e500:93a1, 2600:9000:20c7:9e00:17:fd98:e500:93a1, 2600:9000:20c7:a200:17:fd98:e500:93a1, 2600:9000:20c7:a800:17:fd98:e500:93a1, 2600:9000:20c7:c800:17:fd98:e500:93a1, 2600:9000:20c7:dc00:17:fd98:e500:93a1, 2600:9000:20c7:fa00:17:fd98:e500:93a1
Response IP 13.35.18.20
Found Yes
Hash e4ba05c13603597280b0e3ea7e2e4923559191abff92554eeb8ff4ea04143831
SimHash 69099840eb93

Groups

*

Rule Path
Disallow /suche/ergebnisse/*

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.deutschlandfunknova.de/sitemap.xml
sitemap https://www.deutschlandfunknova.de/news.xml