bundesfinanzministerium.de
robots.txt
Robots Exclusion Standard data for bundesfinanzministerium.de
Resource Scan
Scan Details
| Site Domain | bundesfinanzministerium.de |
| Base Domain | bundesfinanzministerium.de |
| Scan Status | Ok |
| Last Scan | 2024-06-03T07:43:41+00:00 |
| Next Scan | 2024-07-03T07:43:41+00:00 |
Last Scan
| Scanned | 2024-06-03T07:43:41+00:00 |
| URL | https://bundesfinanzministerium.de/robots.txt |
| Domain IPs | 66.6.22.209 |
| Response IP | 66.6.22.209 |
| Found | Yes |
| Hash | 7b3ee42a50b654a9593631fe61f6d284d35e2e15dbceb85934a6c8cd246d90a2 |
| SimHash | e29c6c724c90 |
Groups
clewwa-bot
| Rule | Path |
|---|---|
| Disallow | */SiteGlobals |
| Disallow | */SharedDocs/ExterneLinks |
| Disallow | */Content/FR |
| Disallow | */Web/FR |
| Allow | */SiteGlobals/Forms/_components/Buttons/ |
| Allow | */SiteGlobals/Functions/JavaScript/ |
| Allow | */SiteGlobals/Functions/SocialBookmarks/ |
| Allow | */SiteGlobals/StyleBundles/Bilder/ |
| Allow | */SiteGlobals/StyleBundles/CSS/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
*
| Rule | Path |
|---|---|
| Disallow | */SiteGlobals |
| Disallow | */SharedDocs/ExterneLinks |
| Disallow | */Content/FR |
| Disallow | */Web/FR |
| Allow | */SiteGlobals/Forms/_components/Buttons/ |
| Allow | */SiteGlobals/Functions/JavaScript/ |
| Allow | */SiteGlobals/Functions/SocialBookmarks/ |
| Allow | */SiteGlobals/StyleBundles/Bilder/ |
| Allow | */SiteGlobals/StyleBundles/CSS/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 180 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.bundesfinanzministerium.de/sitemap.xml |