avon.ca
robots.txt

Robots Exclusion Standard data for avon.ca

Resource Scan

Scan Details

Site Domain avon.ca
Base Domain avon.ca
Scan Status Ok
Last Scan2024-10-17T03:57:49+00:00
Next Scan 2024-11-16T03:57:49+00:00

Last Scan

Scanned2024-10-17T03:57:49+00:00
URL https://avon.ca/robots.txt
Domain IPs 13.227.254.108, 13.227.254.24, 13.227.254.45, 13.227.254.78
Response IP 13.227.254.24
Found Yes
Hash 02e47ec3e0c2de9f8f245bc506cb61aad3cc4e81f92edf4411c235fd760676d3
SimHash 601356564071

Groups

*

Rule Path
Disallow /becomearep/general-information
Disallow /becomearep/full-information
Disallow /becomearep/complete
Disallow /order-history/
Disallow /wait-list
Disallow /web-office/
Disallow /dashboard
Disallow /promotion-tool
Disallow /catalog-tool
Disallow /fundraising-hub/
Disallow /commissions-sales-levels/
Disallow /findarep/result
Disallow /repstore/
Disallow /my-account/
Disallow /order/
Disallow /search/
Disallow /blog/reps-news/
Disallow /track-my-order
Disallow /cart
Disallow /bag
Disallow /api
Disallow /avon-rewards
Disallow /*rep%3D*
Disallow /*repstore%3D*
Disallow /*?ShopURL=*
Disallow /*?shopURL=*
Disallow /*%26ShopURL%3D*
Disallow /*%26shopURL%3D*
Disallow /*?repid=*
Disallow /*?Repid=*
Disallow /*%26Repid%3D*
Disallow /*%26repid%3D*
Disallow /*%26myavon%3D*

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

slurp

Rule Path
Disallow /

yahoo pipes 1.0

Rule Path
Disallow /

facebookexternalhit

Rule Path
Allow /*rep%3D*

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.avon.ca/sitemap.xml