militaryonesource.mil
robots.txt

Robots Exclusion Standard data for militaryonesource.mil

Resource Scan

Scan Details

Site Domain militaryonesource.mil
Base Domain militaryonesource.mil
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-30T07:39:41+00:00
Next Scan 2024-12-29T07:39:41+00:00

Last Successful Scan

Scanned2022-08-08T04:49:54+00:00
URL https://militaryonesource.mil/robots.txt
Redirect https://www.militaryonesource.mil/robots.txt
Redirect Domain www.militaryonesource.mil
Redirect Base militaryonesource.mil
Response IP 52.222.118.33
Found Yes
Hash fdef5560edb2d7082213f77671aa04f04eb842220c299557cdbe0aba22a44cac
SimHash 384aca18cb97

Groups

twitterbot

Rule Path
Allow /

rogerbot

Rule Path
Disallow

*

Rule Path
Disallow /page-not-found
Disallow /c/portal/logout
Disallow /c/portal/login
Disallow /military-onesource-system-maintenance-announcement
Disallow /thank-you
Disallow /taxprep
Disallow /asset_publisher/
Disallow *?p_p
Disallow /web/mos/*
Disallow /content_id%3D
Disallow *?inheritRedirect
Disallow *?redirect=
Disallow /wp-admin/
Disallow /military-life-cycle/friends-extended-family/red-cross/
Disallow /wp-content/uploads/*
Disallow /en/*
Disallow /group/control_panel*
Disallow /cart
Disallow /author
Disallow /?product-type=*
Disallow /api
Disallow /documents
Disallow /combo/
Disallow */-/
Disallow *?content_id=
Disallow /MOS/f
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.militaryonesource.mil/sitemap_index.xml