buechertreff.de
robots.txt

Robots Exclusion Standard data for buechertreff.de

Resource Scan

Scan Details

Site Domain buechertreff.de
Base Domain buechertreff.de
Scan Status Ok
Last Scan2024-10-05T10:52:52+00:00
Next Scan 2024-10-12T10:52:52+00:00

Last Scan

Scanned2024-10-05T10:52:52+00:00
URL https://buechertreff.de/robots.txt
Redirect https://www.buechertreff.de/robots.txt
Redirect Domain www.buechertreff.de
Redirect Base buechertreff.de
Domain IPs 134.119.0.36, 2a00:1158:5:24::
Redirect IPs 134.119.0.36, 2a00:1158:5:24::
Response IP 134.119.0.36
Found Yes
Hash bcdeb64d139481787a5b5f0528a2422ffabb48eb2ae277fb5edc478c2db060da
SimHash dc1ccee8c713

Groups

ahrefsbot
baiduspider
blexbot
magpie-crawler
trendictionbot
yandex

Rule Path
Disallow /

*

Rule Path
Disallow /attachment/*pdf/
Disallow /attachment/*xls/
Disallow /bt-out/
Disallow /forum/board-feed/
Disallow /index.php
Disallow /press/
Disallow /search/
Disallow /search-result/