www.bvl.bund.de
robots.txt
Robots Exclusion Standard data for www.bvl.bund.de
Resource Scan
Scan Details
| Site Domain | www.bvl.bund.de |
| Base Domain | bund.de |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Request timed out. |
| Last Scan | 2025-09-27T04:48:34+00:00 |
| Next Scan | 2025-11-26T04:48:34+00:00 |
Last Successful Scan
| Scanned | 2025-07-06T04:13:42+00:00 |
| URL | https://www.bvl.bund.de/robots.txt |
| Domain IPs | 80.245.145.77 |
| Response IP | 80.245.145.77 |
| Found | Yes |
| Hash | e48c351da6917a8a5690651e8efe08c917473ca7650461412118fe22b720356b |
| SimHash | 651050e4cd91 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /SiteGlobals/ |
| Allow | /SiteGlobals/Modules/ |
| Allow | /SiteGlobals/StyleBundles/ |
| Allow | /SiteGlobals/Frontend/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bvl.bund.de/Sitemap_Index.xml |