bmuv.de
robots.txt
Robots Exclusion Standard data for bmuv.de
Resource Scan
Scan Details
| Site Domain | bmuv.de |
| Base Domain | bmuv.de |
| Scan Status | Ok |
| Last Scan | 2024-06-26T20:15:26+00:00 |
| Next Scan | 2024-07-26T20:15:26+00:00 |
Last Scan
| Scanned | 2024-06-26T20:15:26+00:00 |
| URL | https://bmuv.de/robots.txt |
| Redirect | https://www.bmuv.de/robots.txt |
| Redirect Domain | www.bmuv.de |
| Redirect Base | bmuv.de |
| Domain IPs | 2a06:2380:2:1::d8, 45.12.50.175 |
| Redirect IPs | 2a06:2380:2:1::d8, 45.12.50.175 |
| Response IP | 45.12.50.175 |
| Found | Yes |
| Hash | 9b77f0b2bf3c7df876687bbc7932cb4587dd4044882b8f1dd3fdaa012c7a0bce |
| SimHash | 28395063937b |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Allow | / | Allow bot to enter |
| Disallow | /t3lib/ | Nothing to see here |
| Disallow | /typo3/ | Nothing to see here |
| Disallow | /typo3conf/ | Nothing to see here |
| Disallow | /themen/wasser-abfall-boden/abfallwirtschaft/buergerdialog-wertstofftonne/ | Nothing to see |
| Disallow | /statistiken/ | Nothing to see here |
| Disallow | /service/publikationen/export-webshop-bpa/ | Nothing to see here |
| Disallow | /service/publikationen/broschueren-bestellen/export-webshop-bpa/ | Nothing to see here |
| Disallow | /*.php$ | - |
| Disallow | /*%26type%3D98 | - |
| Disallow | /*?type=98 | - |
| Disallow | /service/publikationen/warenkorb/ | Nothing to see here |
| Disallow | /buergerservice/broschueren/warenkorb/ | Nothing to see here |
| Disallow | /buergerservice/broschueren/bestellung/ | Nothing to see here |
| Disallow | /buergerservice/broschueren/broschueren-bestellen/export-webshop-bpa/ | Nothing to see here |
| Disallow | /*%26eID%3Dtx_solr | - |
| Disallow | /*?eID=tx_solr | - |
| Disallow | /*?id=1892 | - |
| Disallow | /*%26id%3D1892 | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |