armymwr.com
robots.txt
Robots Exclusion Standard data for armymwr.com
Resource Scan
Scan Details
| Site Domain | armymwr.com |
| Base Domain | armymwr.com |
| Scan Status | Ok |
| Last Scan | 2024-06-21T20:15:18+00:00 |
| Next Scan | 2024-07-21T20:15:18+00:00 |
Last Scan
| Scanned | 2024-06-21T20:15:18+00:00 |
| URL | https://armymwr.com/robots.txt |
| Redirect | https://www.armymwr.com/robots.txt |
| Redirect Domain | www.armymwr.com |
| Redirect Base | armymwr.com |
| Domain IPs | 3.233.190.125 |
| Redirect IPs | 18.155.68.105, 18.155.68.23, 18.155.68.54, 18.155.68.79, 2600:9000:23d2:1e00:1e:2e08:d580:93a1, 2600:9000:23d2:2c00:1e:2e08:d580:93a1, 2600:9000:23d2:2e00:1e:2e08:d580:93a1, 2600:9000:23d2:3a00:1e:2e08:d580:93a1, 2600:9000:23d2:8200:1e:2e08:d580:93a1, 2600:9000:23d2:c400:1e:2e08:d580:93a1, 2600:9000:23d2:ca00:1e:2e08:d580:93a1, 2600:9000:23d2:e400:1e:2e08:d580:93a1 |
| Response IP | 18.155.68.79 |
| Found | Yes |
| Hash | e3986cf7683aa119e537e65397fd559bcd79a5a22613d3f14e70eb7691befa4f |
| SimHash | 6a089082c1b5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /application/attributes |
| Disallow | /application/authentication |
| Disallow | /application/bootstrap |
| Disallow | /application/config |
| Disallow | /application/controllers |
| Disallow | /application/elements |
| Disallow | /application/helpers |
| Disallow | /application/jobs |
| Disallow | /application/languages |
| Disallow | /application/mail |
| Disallow | /application/models |
| Disallow | /application/page_types |
| Disallow | /application/single_pages |
| Disallow | /application/tools |
| Disallow | /application/views |
| Disallow | /packages |
| Allow | /packages/armymwr/themes/armymwr/js |
| Allow | /packages/armymwr/themes/armymwr/css |
| Disallow | /tools |
| Disallow | /updates |
| Disallow | /login |
| Disallow | /calendar?*category=* |
slurp
| Rule | Path |
|---|---|
| Disallow | /application/attributes |
| Disallow | /application/authentication |
| Disallow | /application/bootstrap |
| Disallow | /application/config |
| Disallow | /application/controllers |
| Disallow | /application/elements |
| Disallow | /application/helpers |
| Disallow | /application/jobs |
| Disallow | /application/languages |
| Disallow | /application/mail |
| Disallow | /application/models |
| Disallow | /application/page_types |
| Disallow | /application/single_pages |
| Disallow | /application/tools |
| Disallow | /application/views |
| Disallow | /packages |
| Allow | /packages/armymwr/themes/armymwr/js |
| Allow | /packages/armymwr/themes/armymwr/css |
| Disallow | /tools |
| Disallow | /updates |
| Disallow | /login |
| Disallow | /calendar?*category=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
bingbot
| Rule | Path |
|---|---|
| Disallow | /application/attributes |
| Disallow | /application/authentication |
| Disallow | /application/bootstrap |
| Disallow | /application/config |
| Disallow | /application/controllers |
| Disallow | /application/elements |
| Disallow | /application/helpers |
| Disallow | /application/jobs |
| Disallow | /application/languages |
| Disallow | /application/mail |
| Disallow | /application/models |
| Disallow | /application/page_types |
| Disallow | /application/single_pages |
| Disallow | /application/tools |
| Disallow | /application/views |
| Disallow | /packages |
| Allow | /packages/armymwr/themes/armymwr/js |
| Allow | /packages/armymwr/themes/armymwr/css |
| Disallow | /tools |
| Disallow | /updates |
| Disallow | /login |
| Disallow | /calendar?*category=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
bing
| Rule | Path |
|---|---|
| Disallow | /application/attributes |
| Disallow | /application/authentication |
| Disallow | /application/bootstrap |
| Disallow | /application/config |
| Disallow | /application/controllers |
| Disallow | /application/elements |
| Disallow | /application/helpers |
| Disallow | /application/jobs |
| Disallow | /application/languages |
| Disallow | /application/mail |
| Disallow | /application/models |
| Disallow | /application/page_types |
| Disallow | /application/single_pages |
| Disallow | /application/tools |
| Disallow | /application/views |
| Disallow | /packages |
| Allow | /packages/armymwr/themes/armymwr/js |
| Allow | /packages/armymwr/themes/armymwr/css |
| Disallow | /tools |
| Disallow | /updates |
| Disallow | /login |
| Disallow | /calendar?*category=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
msnbot
| Rule | Path |
|---|---|
| Disallow | /application/attributes |
| Disallow | /application/authentication |
| Disallow | /application/bootstrap |
| Disallow | /application/config |
| Disallow | /application/controllers |
| Disallow | /application/elements |
| Disallow | /application/helpers |
| Disallow | /application/jobs |
| Disallow | /application/languages |
| Disallow | /application/mail |
| Disallow | /application/models |
| Disallow | /application/page_types |
| Disallow | /application/single_pages |
| Disallow | /application/tools |
| Disallow | /application/views |
| Disallow | /packages |
| Allow | /packages/armymwr/themes/armymwr/js |
| Allow | /packages/armymwr/themes/armymwr/css |
| Disallow | /tools |
| Disallow | /updates |
| Disallow | /login |
| Disallow | /calendar?*category=* |