store.ashley.cl
robots.txt

Robots Exclusion Standard data for store.ashley.cl

Resource Scan

Scan Details

Site Domain store.ashley.cl
Base Domain ashley.cl
Scan Status Ok
Last Scan5/15/2025, 5:41:15 AM
Next Scan 6/14/2025, 5:41:15 AM

Last Scan

Scanned5/15/2025, 5:41:15 AM
URL https://store.ashley.cl/robots.txt
Domain IPs 104.21.69.139, 172.67.208.250, 2606:4700:3034::6815:458b, 2606:4700:3035::ac43:d0fa
Response IP 172.67.208.250
Found Yes
Hash 471db6cd0fbd8aad4a8a1b075fea7ceee19370f8f96bdfb35515ff46a1d556fe
SimHash 0f149e43d592

Groups

*

Rule Path
Disallow /admin
Disallow /*%3D
Disallow /login/
Disallow /search?q=
Disallow /wishlist
Disallow /orderhistory
Disallow /product/printview
Disallow /product/printview/*
Disallow /shoppingcart
Disallow /checkout
Disallow /c/*%2B*
Disallow /c/*%2B*
Disallow /c/*%2B*
Disallow /*/c/*%2B*
Disallow /*/c/*%2B*
Disallow /*/c/*%2B*
Disallow /page/privacy-policy
Disallow /search

adsbot-google

Rule Path
Disallow /admin
Disallow /*%3D
Disallow /login/
Disallow /search?q=
Disallow /wishlist
Disallow /orderhistory
Disallow /product/printview
Disallow /product/printview/*
Disallow /checkout
Disallow /shoppingcart
Disallow /c/*%2B*
Disallow /c/*%2B*
Disallow /c/*%2B*
Disallow /*/c/*%2B*
Disallow /*/c/*%2B*
Disallow /*/c/*%2B*
Disallow /page/privacy-policy
Disallow /search

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /admin
Disallow /*%3D
Disallow /login/
Disallow /search?q=
Disallow /wishlist
Disallow /orderhistory
Disallow /product/printview
Disallow /product/printview/*
Disallow /shoppingcart
Disallow /checkout
Disallow /c/*%2B*
Disallow /c/*%2B*
Disallow /c/*%2B*
Disallow /*/c/*%2B*
Disallow /*/c/*%2B*
Disallow /*/c/*%2B*
Disallow /page/privacy-policy
Disallow /search

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /*%3D
Disallow /login/
Disallow /search?q=
Disallow /wishlist
Disallow /orderhistory
Disallow /product/printview
Disallow /product/printview/*
Disallow /shoppingcart
Disallow /checkout
Disallow /c/*%2B*
Disallow /c/*%2B*
Disallow /c/*%2B*
Disallow /*/c/*%2B*
Disallow /*/c/*%2B*
Disallow /*/c/*%2B*
Disallow /page/privacy-policy
Disallow /search

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap /sitemap.xml
sitemap /sitemap.xml
sitemap /sitemap.xml
sitemap /sitemap.xml

Comments

  • This is Rencommerce platform
  • Google adsbot ignores robots.txt unless specifically named!