dfas.mil
robots.txt
Robots Exclusion Standard data for dfas.mil
Resource Scan
Scan Details
Site Domain | dfas.mil |
Base Domain | dfas.mil |
Scan Status | Ok |
Last Scan | 2024-10-21T14:38:20+00:00 |
Next Scan | 2024-11-20T14:38:20+00:00 |
Last Scan
Scanned | 2024-10-21T14:38:20+00:00 |
URL | https://www.dfas.mil/robots.txt |
Domain IPs | 2600:1413:b000:6::17d5:2bca, 2600:1413:b000:6::17d5:2bd3, 96.17.96.27, 96.17.96.8 |
Response IP | 184.51.6.220 |
Found | Yes |
Hash | 621605df95f37328e2f285db3ca42f36dad75ea6bd5f4a925e1f64f3f4db5644 |
SimHash | 7b0151018f06 |
Groups
*
Rule | Path |
---|---|
Allow | /Components/Administrative-Investigations/ |
Disallow | *captcha* |
Disallow | /*Print.aspx |
Disallow | /*.axd$ |
Disallow | /*.exe$ |
Disallow | /bin/ |
Disallow | /Bin/ |
Disallow | /*.bin$ |
Disallow | /*.dll$ |
Disallow | /*.ssi$ |
Disallow | /Error/ |
Disallow | /Controls/ |
Disallow | /controls/ |
Disallow | /Utility/ |
Disallow | /install/ |
Disallow | /Admin/ |
Disallow | /App_Browser/ |
Disallow | /App_Code/ |
Disallow | /App_Data/ |
Disallow | /App_GlobalResources/ |
Disallow | /Components/ |
Disallow | /Config/ |
Disallow | /Documentation/ |
Disallow | /Install/ |
Disallow | /Providers/ |
Other Records
Field | Value |
---|---|
sitemap | /DesktopModules/SiteData/SiteMap.ashx |