activeweargroup.com
robots.txt
Robots Exclusion Standard data for activeweargroup.com
Resource Scan
Scan Details
| Site Domain | activeweargroup.com |
| Base Domain | activeweargroup.com |
| Scan Status | Ok |
| Last Scan | 2024-10-22T05:52:00+00:00 |
| Next Scan | 2024-11-21T05:52:00+00:00 |
Last Scan
| Scanned | 2024-10-22T05:52:00+00:00 |
| URL | https://activeweargroup.com/robots.txt |
| Domain IPs | 109.108.148.113 |
| Response IP | 109.108.148.113 |
| Found | Yes |
| Hash | 67228f26d0f9ca462f459993519a76a69fcd32062b3b232b865264bda985fc21 |
| SimHash | 524f12c0da4c |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /ajax/removefrombasket/ |
| Disallow | /us/ajax/removefrombasket/ |
| Disallow | /ca/ajax/removefrombasket/ |
| Disallow | /au/ajax/removefrombasket/ |
| Disallow | /nz/ajax/removefrombasket/ |
| Disallow | /basket$ |
| Disallow | /us/basket$ |
| Disallow | /ca/basket$ |
| Disallow | /au/basket$ |
| Disallow | /nz/basket$ |
| Disallow | /checkout/ |
| Disallow | /us/checkout/ |
| Disallow | /ca/checkout/ |
| Disallow | /au/checkout/ |
| Disallow | /nz/checkout/ |
| Disallow | /errors/ |
| Disallow | /us/errors/ |
| Disallow | /ca/errors/ |
| Disallow | /au/errors/ |
| Disallow | /nz/errors/ |
| Disallow | /quickbuy/ |
| Disallow | /us/quickbuy/ |
| Disallow | /ca/quickbuy/ |
| Disallow | /au/quickbuy/ |
| Disallow | /nz/quickbuy/ |
| Disallow | /product_personalisation/ |
| Disallow | /us/product_personalisation/ |
| Disallow | /ca/product_personalisation/ |
| Disallow | /au/product_personalisation/ |
| Disallow | /nz/product_personalisation/ |
| Disallow | /register/ |
| Disallow | /us/register/ |
| Disallow | /ca/register/ |
| Disallow | /au/register/ |
| Disallow | /nz/register/ |
| Disallow | /register |
| Disallow | /us/register |
| Disallow | /ca/register |
| Disallow | /au/register |
| Disallow | /nz/register |
| Disallow | /vs/ |
| Disallow | /us/vs/ |
| Disallow | /ca/vs/ |
| Disallow | /au/vs/ |
| Disallow | /nz/vs/ |
| Disallow | /images/products/yofla/ |
| Disallow | /us/images/products/yofla/ |
| Disallow | /ca/images/products/yofla/ |
| Disallow | /au/images/products/yofla/ |
| Disallow | /nz/images/products/yofla/ |
| Disallow | /customer_groups/choose_group/ |
| Disallow | /us/customer_groups/choose_group/ |
| Disallow | /ca/customer_groups/choose_group/ |
| Disallow | /au/customer_groups/choose_group/ |
| Disallow | /nz/customer_groups/choose_group/ |
| Disallow | /formbuilder/ |
| Disallow | /us/formbuilder/ |
| Disallow | /ca/formbuilder/ |
| Disallow | /au/formbuilder/ |
| Disallow | /nz/formbuilder/ |
| Disallow | /callbacks/ |
| Disallow | /us/callbacks/ |
| Disallow | /ca/callbacks/ |
| Disallow | /au/callbacks/ |
| Disallow | /nz/callbacks/ |
| Disallow | /ajax/formatprice/ |
| Disallow | /us/ajax/formatprice/ |
| Disallow | /ca/ajax/formatprice/ |
| Disallow | /au/ajax/formatprice/ |
| Disallow | /nz/ajax/formatprice/ |
| Disallow | /new-products/ |
| Disallow | /sale/ |
| Disallow | /search/ |
| Disallow | /back-in-stock-notification-i14 |
| Disallow | /lists/ajax_check_wishlist/ |
| Disallow | /wishlist* |
| Disallow | /customer* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://activeweargroup.com/sitemap-index.xml |
| sitemap | https://activeweargroup.com/us/sitemap-index.xml |
| sitemap | https://activeweargroup.com/ca/sitemap-index.xml |
| sitemap | https://activeweargroup.com/au/sitemap-index.xml |
| sitemap | https://activeweargroup.com/nz/sitemap-index.xml |
| sitemap | https://activeweargroup.com/news/sitemap.xml |
Warnings
- `request-rate` is not a known field.