dla.mil
robots.txt
Robots Exclusion Standard data for dla.mil
Resource Scan
Scan Details
Site Domain | dla.mil |
Base Domain | dla.mil |
Scan Status | Ok |
Last Scan | 2024-06-21T20:59:29+00:00 |
Next Scan | 2024-07-21T20:59:29+00:00 |
Last Scan
Scanned | 2024-06-21T20:59:29+00:00 |
URL | https://www.dla.mil/robots.txt |
Domain IPs | 23.44.4.153, 23.44.4.154, 2600:1413:a000::1734:283a, 2600:1413:a000::1734:2840 |
Response IP | 23.59.168.138 |
Found | Yes |
Hash | e9e9c2d47a074949cc829427c207044c20e64a8527ff9e3800411b6fb4bb10cb |
SimHash | 7b0551018f06 |
Groups
*
Rule | Path |
---|---|
Disallow | *captcha* |
Disallow | /*Print.aspx |
Disallow | /*.axd$ |
Disallow | /*.exe$ |
Disallow | /bin/ |
Disallow | /Bin/ |
Disallow | /*.bin$ |
Disallow | /*.dll$ |
Disallow | /*.ssi$ |
Disallow | /Error/ |
Disallow | /Controls/ |
Disallow | /controls/ |
Disallow | /Utility/ |
Disallow | /install/ |
Disallow | /Admin/ |
Disallow | /App_Browser/ |
Disallow | /App_Code/ |
Disallow | /App_Data/ |
Disallow | /App_GlobalResources/ |
Disallow | /Components/ |
Disallow | /Config/ |
Disallow | /Documentation/ |
Disallow | /Install/ |
Disallow | /Providers/ |
Other Records
Field | Value |
---|---|
sitemap | /DesktopModules/SiteData/SiteMap.ashx |