netzpanorama.de
robots.txt

Robots Exclusion Standard data for netzpanorama.de

Resource Scan

Scan Details

Site Domain netzpanorama.de
Base Domain netzpanorama.de
Scan Status Ok
Last Scan2025-09-01T01:35:09+00:00
Next Scan 2025-09-08T01:35:09+00:00

Last Scan

Scanned2025-09-01T01:35:09+00:00
URL https://netzpanorama.de/robots.txt
Domain IPs 213.133.104.171
Response IP 213.133.104.171
Found Yes
Hash 1bf1cf40dcd506a02356c5c5a56ebd75236cf85778cbcf4f24a9855fcc627edc
SimHash db294ddc83f3

Groups

mediapartners-google*

Rule Path
Disallow

*

Rule Path
Disallow /wp-admin/
Disallow /?p=*
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /cgi-bin/
Disallow /logs/

websiterating

Rule Path
Disallow /

penthesilea

Rule Path
Disallow /

proximic

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

aboutusbot

Rule Path
Disallow /

websitewiki

Rule Path
Disallow /

websitewiki

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

cubestat

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.netzpanorama.de/sitemap.xml
sitemap https://www.netzpanorama.de/sitemap-image.xml

Comments

  • robots.txt