testmagazine.de
robots.txt

Robots Exclusion Standard data for testmagazine.de

Resource Scan

Scan Details

Site Domain testmagazine.de
Base Domain testmagazine.de
Scan Status Ok
Last Scan2024-10-02T14:25:11+00:00
Next Scan 2024-10-09T14:25:11+00:00

Last Scan

Scanned2024-10-02T14:25:11+00:00
URL https://testmagazine.de/robots.txt
Redirect https://www.testmagazine.de/robots.txt
Redirect Domain www.testmagazine.de
Redirect Base testmagazine.de
Domain IPs 188.68.47.18, 2a03:4000:30:b648::14:7332
Redirect IPs 188.68.47.18, 2a03:4000:30:b648::14:7332
Response IP 188.68.47.18
Found Yes
Hash 337cd46e4b312ae0fb0f063569333b85aeb0370733bce3c26262dbad355ffbee
SimHash ec99a838c713

Groups

*

Rule Path
Disallow /RealMedia/
Disallow /archiv/
Disallow /active/
Disallow /cgi-bin/
Disallow /artikelversand/
Disallow /druckrezension/
Disallow /druckversion/

webreaper

Rule Path
Disallow /

Comments

  • User-agent: Firefly/1.0
  • Disallow: /