herber.de
robots.txt
Robots Exclusion Standard data for herber.de
Resource Scan
Scan Details
Site Domain | herber.de |
Base Domain | herber.de |
Scan Status | Ok |
Last Scan | 2025-05-03T12:03:27+00:00 |
Next Scan | 2025-05-10T12:03:27+00:00 |
Last Scan
Scanned | 2025-05-03T12:03:27+00:00 |
URL | https://herber.de/robots.txt |
Redirect | https://www.herber.de/robots.txt |
Redirect Domain | www.herber.de |
Redirect Base | herber.de |
Domain IPs | 217.160.0.249 |
Redirect IPs | 2001:8d8:100f:f000::248, 217.160.0.249 |
Response IP | 217.160.0.249 |
Found | Yes |
Hash | d618f363b10d33f6fc25a5b5c1a5fc86021b9986ca536be59ec294dd16c15972 |
SimHash | 20ae4b006391 |
Groups
*
Rule | Path |
---|---|
Disallow | /skat/ |
Allow | /jokes/ |
Allow | /forum/archiv/ |
Disallow | /forum/ |
Allow | /forum/index.html |
Disallow | /forum/archiv/only/ |
Disallow | /forum/archiv/empty/ |
Disallow | /forum/archiv/search/ |
Disallow | /forum/archiv/tar/ |
Disallow | /forum/archiv/texte/ |
Disallow | /forum/archiv/zip* |
Disallow | /forum/archiv/editfiles |
Allow | /excelformeln/pages/ |
Allow | /excelformeln/images/ |
Allow | /excelformeln/src/ |
Disallow | /excelformeln/ |
Disallow | /bbs/ |
Disallow | /excel/ |
Disallow | /1und1-backup/ |
Disallow | /andere/ |
Disallow | /backup/ |
Disallow | /cfg/ |
Disallow | /cgi-bin/ |
Allow | /cgi-public/ |
Allow | /cgi-bin/ExcelUndVBA.pl* |
Disallow | /laura/ |
Disallow | /cgi-calls/ |
Disallow | /crons/ |
Disallow | /data/ |
Disallow | /reports/ |
Disallow | /db/ |
Disallow | /excecutable/ |
Disallow | /extern/ |
Disallow | /allzu/ |
Disallow | /ftp/ |
Disallow | /klassik-als-ebooks/ |
Disallow | /lists/ |
Disallow | /logs/ |
Disallow | /pass/ |
Disallow | /php/ |
Disallow | /silyrik/cgi/ |
Disallow | /templates/ |
Disallow | /test/ |
Disallow | /vorlagen/ |
Disallow | /xlDocs/ |
Disallow | /xlftp/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.herber.de/sitemap_index.xml |