dfas.mil
robots.txt

Robots Exclusion Standard data for dfas.mil

Resource Scan

Scan Details

Site Domain dfas.mil
Base Domain dfas.mil
Scan Status Ok
Last Scan2024-10-21T14:38:20+00:00
Next Scan 2024-11-20T14:38:20+00:00

Last Scan

Scanned2024-10-21T14:38:20+00:00
URL https://www.dfas.mil/robots.txt
Domain IPs 2600:1413:b000:6::17d5:2bca, 2600:1413:b000:6::17d5:2bd3, 96.17.96.27, 96.17.96.8
Response IP 184.51.6.220
Found Yes
Hash 621605df95f37328e2f285db3ca42f36dad75ea6bd5f4a925e1f64f3f4db5644
SimHash 7b0151018f06

Groups

*

Rule Path
Allow /Components/Administrative-Investigations/
Disallow *captcha*
Disallow /*Print.aspx
Disallow /*.axd$
Disallow /*.exe$
Disallow /bin/
Disallow /Bin/
Disallow /*.bin$
Disallow /*.dll$
Disallow /*.ssi$
Disallow /Error/
Disallow /Controls/
Disallow /controls/
Disallow /Utility/
Disallow /install/
Disallow /Admin/
Disallow /App_Browser/
Disallow /App_Code/
Disallow /App_Data/
Disallow /App_GlobalResources/
Disallow /Components/
Disallow /Config/
Disallow /Documentation/
Disallow /Install/
Disallow /Providers/

Other Records

Field Value
sitemap /DesktopModules/SiteData/SiteMap.ashx