cybercom.mil
robots.txt

Robots Exclusion Standard data for cybercom.mil

Resource Scan

Scan Details

Site Domain cybercom.mil
Base Domain cybercom.mil
Scan Status Ok
Last Scan2024-06-04T01:17:01+00:00
Next Scan 2024-07-04T01:17:01+00:00

Last Scan

Scanned2024-06-04T01:17:01+00:00
URL https://www.cybercom.mil/robots.txt
Domain IPs 23.32.29.9, 2600:1413:b000:6::17d5:2bca, 2600:1413:b000:6::17d5:2bd4, 96.17.180.44
Response IP 23.59.168.138
Found Yes
Hash 621605df95f37328e2f285db3ca42f36dad75ea6bd5f4a925e1f64f3f4db5644
SimHash 7b0151018f06

Groups

*

Rule Path
Allow /Components/Administrative-Investigations/
Disallow *captcha*
Disallow /*Print.aspx
Disallow /*.axd$
Disallow /*.exe$
Disallow /bin/
Disallow /Bin/
Disallow /*.bin$
Disallow /*.dll$
Disallow /*.ssi$
Disallow /Error/
Disallow /Controls/
Disallow /controls/
Disallow /Utility/
Disallow /install/
Disallow /Admin/
Disallow /App_Browser/
Disallow /App_Code/
Disallow /App_Data/
Disallow /App_GlobalResources/
Disallow /Components/
Disallow /Config/
Disallow /Documentation/
Disallow /Install/
Disallow /Providers/

Other Records

Field Value
sitemap /DesktopModules/SiteData/SiteMap.ashx