herber.de
robots.txt

Robots Exclusion Standard data for herber.de

Resource Scan

Scan Details

Site Domain herber.de
Base Domain herber.de
Scan Status Ok
Last Scan2025-05-03T12:03:27+00:00
Next Scan 2025-05-10T12:03:27+00:00

Last Scan

Scanned2025-05-03T12:03:27+00:00
URL https://herber.de/robots.txt
Redirect https://www.herber.de/robots.txt
Redirect Domain www.herber.de
Redirect Base herber.de
Domain IPs 217.160.0.249
Redirect IPs 2001:8d8:100f:f000::248, 217.160.0.249
Response IP 217.160.0.249
Found Yes
Hash d618f363b10d33f6fc25a5b5c1a5fc86021b9986ca536be59ec294dd16c15972
SimHash 20ae4b006391

Groups

*

Rule Path
Disallow /skat/
Allow /jokes/
Allow /forum/archiv/
Disallow /forum/
Allow /forum/index.html
Disallow /forum/archiv/only/
Disallow /forum/archiv/empty/
Disallow /forum/archiv/search/
Disallow /forum/archiv/tar/
Disallow /forum/archiv/texte/
Disallow /forum/archiv/zip*
Disallow /forum/archiv/editfiles
Allow /excelformeln/pages/
Allow /excelformeln/images/
Allow /excelformeln/src/
Disallow /excelformeln/
Disallow /bbs/
Disallow /excel/
Disallow /1und1-backup/
Disallow /andere/
Disallow /backup/
Disallow /cfg/
Disallow /cgi-bin/
Allow /cgi-public/
Allow /cgi-bin/ExcelUndVBA.pl*
Disallow /laura/
Disallow /cgi-calls/
Disallow /crons/
Disallow /data/
Disallow /reports/
Disallow /db/
Disallow /excecutable/
Disallow /extern/
Disallow /allzu/
Disallow /ftp/
Disallow /klassik-als-ebooks/
Disallow /lists/
Disallow /logs/
Disallow /pass/
Disallow /php/
Disallow /silyrik/cgi/
Disallow /templates/
Disallow /test/
Disallow /vorlagen/
Disallow /xlDocs/
Disallow /xlftp/

Other Records

Field Value
sitemap https://www.herber.de/sitemap_index.xml