bvb.de
robots.txt
Robots Exclusion Standard data for bvb.de
Resource Scan
Scan Details
| Site Domain | bvb.de |
| Base Domain | bvb.de |
| Scan Status | Ok |
| Last Scan | 2024-11-11T14:18:51+00:00 |
| Next Scan | 2024-11-25T14:18:51+00:00 |
Last Scan
| Scanned | 2024-11-11T14:18:51+00:00 |
| URL | https://bvb.de/robots.txt |
| Redirect | https://www.bvb.de/robots.txt |
| Redirect Domain | www.bvb.de |
| Redirect Base | bvb.de |
| Domain IPs | 104.18.4.217, 104.18.5.217, 2606:4700::6812:4d9, 2606:4700::6812:5d9 |
| Redirect IPs | 104.18.4.217, 104.18.5.217, 2606:4700::6812:4d9, 2606:4700::6812:5d9 |
| Response IP | 104.18.4.217 |
| Found | Yes |
| Hash | 7160e8fc5987624eac7c59e9c6778cb64651793e4f1955ff61d6c60ffa4b27a5 |
| SimHash | 3041e30c6b90 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bvbforms |
| Disallow | /bvbsearch/search |
| Disallow | /de/de/allgemein/suche.html |
| Disallow | /de/en/General/search.html |
| Disallow | /de/de/sitemap.xml |
| Disallow | /de/en/sitemap.xml |