hawaii.armymwr.com
robots.txt

Robots Exclusion Standard data for hawaii.armymwr.com

Resource Scan

Scan Details

Site Domain hawaii.armymwr.com
Base Domain armymwr.com
Scan Status Ok
Last Scan2024-06-12T14:30:42+00:00
Next Scan 2024-07-12T14:30:42+00:00

Last Scan

Scanned2024-06-12T14:30:42+00:00
URL https://hawaii.armymwr.com/robots.txt
Domain IPs 18.155.68.105, 18.155.68.23, 18.155.68.54, 18.155.68.79, 2600:9000:23d2:1200:1e:2e08:d580:93a1, 2600:9000:23d2:3000:1e:2e08:d580:93a1, 2600:9000:23d2:7200:1e:2e08:d580:93a1, 2600:9000:23d2:7400:1e:2e08:d580:93a1, 2600:9000:23d2:ae00:1e:2e08:d580:93a1, 2600:9000:23d2:be00:1e:2e08:d580:93a1, 2600:9000:23d2:ca00:1e:2e08:d580:93a1, 2600:9000:23d2:f800:1e:2e08:d580:93a1
Response IP 18.155.68.105
Found Yes
Hash e3986cf7683aa119e537e65397fd559bcd79a5a22613d3f14e70eb7691befa4f
SimHash 6a089082c1b5

Groups

*

Rule Path
Disallow /application/attributes
Disallow /application/authentication
Disallow /application/bootstrap
Disallow /application/config
Disallow /application/controllers
Disallow /application/elements
Disallow /application/helpers
Disallow /application/jobs
Disallow /application/languages
Disallow /application/mail
Disallow /application/models
Disallow /application/page_types
Disallow /application/single_pages
Disallow /application/tools
Disallow /application/views
Disallow /packages
Allow /packages/armymwr/themes/armymwr/js
Allow /packages/armymwr/themes/armymwr/css
Disallow /tools
Disallow /updates
Disallow /login
Disallow /calendar?*category=*

slurp

Rule Path
Disallow /application/attributes
Disallow /application/authentication
Disallow /application/bootstrap
Disallow /application/config
Disallow /application/controllers
Disallow /application/elements
Disallow /application/helpers
Disallow /application/jobs
Disallow /application/languages
Disallow /application/mail
Disallow /application/models
Disallow /application/page_types
Disallow /application/single_pages
Disallow /application/tools
Disallow /application/views
Disallow /packages
Allow /packages/armymwr/themes/armymwr/js
Allow /packages/armymwr/themes/armymwr/css
Disallow /tools
Disallow /updates
Disallow /login
Disallow /calendar?*category=*

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /application/attributes
Disallow /application/authentication
Disallow /application/bootstrap
Disallow /application/config
Disallow /application/controllers
Disallow /application/elements
Disallow /application/helpers
Disallow /application/jobs
Disallow /application/languages
Disallow /application/mail
Disallow /application/models
Disallow /application/page_types
Disallow /application/single_pages
Disallow /application/tools
Disallow /application/views
Disallow /packages
Allow /packages/armymwr/themes/armymwr/js
Allow /packages/armymwr/themes/armymwr/css
Disallow /tools
Disallow /updates
Disallow /login
Disallow /calendar?*category=*

Other Records

Field Value
crawl-delay 10

bing

Rule Path
Disallow /application/attributes
Disallow /application/authentication
Disallow /application/bootstrap
Disallow /application/config
Disallow /application/controllers
Disallow /application/elements
Disallow /application/helpers
Disallow /application/jobs
Disallow /application/languages
Disallow /application/mail
Disallow /application/models
Disallow /application/page_types
Disallow /application/single_pages
Disallow /application/tools
Disallow /application/views
Disallow /packages
Allow /packages/armymwr/themes/armymwr/js
Allow /packages/armymwr/themes/armymwr/css
Disallow /tools
Disallow /updates
Disallow /login
Disallow /calendar?*category=*

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow /application/attributes
Disallow /application/authentication
Disallow /application/bootstrap
Disallow /application/config
Disallow /application/controllers
Disallow /application/elements
Disallow /application/helpers
Disallow /application/jobs
Disallow /application/languages
Disallow /application/mail
Disallow /application/models
Disallow /application/page_types
Disallow /application/single_pages
Disallow /application/tools
Disallow /application/views
Disallow /packages
Allow /packages/armymwr/themes/armymwr/js
Allow /packages/armymwr/themes/armymwr/css
Disallow /tools
Disallow /updates
Disallow /login
Disallow /calendar?*category=*

seekportbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandex

Rule Path
Disallow /