bundesfinanzministerium.de
robots.txt
Robots Exclusion Standard data for bundesfinanzministerium.de
Resource Scan
Scan Details
Site Domain | bundesfinanzministerium.de |
Base Domain | bundesfinanzministerium.de |
Scan Status | Ok |
Last Scan | 2024-09-01T07:44:03+00:00 |
Next Scan | 2024-10-01T07:44:03+00:00 |
Last Scan
Scanned | 2024-09-01T07:44:03+00:00 |
URL | https://bundesfinanzministerium.de/robots.txt |
Domain IPs | 66.6.22.209 |
Response IP | 66.6.22.209 |
Found | Yes |
Hash | 7b3ee42a50b654a9593631fe61f6d284d35e2e15dbceb85934a6c8cd246d90a2 |
SimHash | e29c6c724c90 |
Groups
clewwa-bot
Rule | Path |
---|---|
Disallow | */SiteGlobals |
Disallow | */SharedDocs/ExterneLinks |
Disallow | */Content/FR |
Disallow | */Web/FR |
Allow | */SiteGlobals/Forms/_components/Buttons/ |
Allow | */SiteGlobals/Functions/JavaScript/ |
Allow | */SiteGlobals/Functions/SocialBookmarks/ |
Allow | */SiteGlobals/StyleBundles/Bilder/ |
Allow | */SiteGlobals/StyleBundles/CSS/ |
Other Records
Field | Value |
---|---|
crawl-delay | 15 |
*
Rule | Path |
---|---|
Disallow | */SiteGlobals |
Disallow | */SharedDocs/ExterneLinks |
Disallow | */Content/FR |
Disallow | */Web/FR |
Allow | */SiteGlobals/Forms/_components/Buttons/ |
Allow | */SiteGlobals/Functions/JavaScript/ |
Allow | */SiteGlobals/Functions/SocialBookmarks/ |
Allow | */SiteGlobals/StyleBundles/Bilder/ |
Allow | */SiteGlobals/StyleBundles/CSS/ |
Other Records
Field | Value |
---|---|
crawl-delay | 180 |
Other Records
Field | Value |
---|---|
sitemap | http://www.bundesfinanzministerium.de/sitemap.xml |