cottonon.com
robots.txt

Robots Exclusion Standard data for cottonon.com

Resource Scan

Scan Details

Site Domain cottonon.com
Base Domain cottonon.com
Scan Status Ok
Last Scan2024-11-14T15:18:17+00:00
Next Scan 2024-12-14T15:18:17+00:00

Last Scan

Scanned2024-11-14T15:18:17+00:00
URL https://cottonon.com/robots.txt
Domain IPs 104.18.146.86, 104.18.147.86, ::
Response IP 104.18.147.86
Found Yes
Hash 56320f6048b495e0757eef2332c87c7928eb09154a21d8ce9ac8534e3cd845f9
SimHash ca941622801d

Groups

*

Rule Path
Disallow /*/account/
Disallow /*/forgot-password/
Disallow /*/reset-password/
Disallow /*/checkout/
Disallow /*/bag/
Disallow /*/cart/
Disallow /*/page-not-found/
Disallow /*/sign-out/
Disallow /*/sign-in/
Disallow /*/not-you/
Disallow /*/subscribe/
Disallow /*/wishlist/
Disallow /*/show-variation/
Disallow /*/activate-perks/
Disallow /*/set-password/
Disallow /*/perkscard/
Disallow /*/applycoupon/
Disallow /*/demandware.store/
Disallow /*srule%3D*
Disallow /*pmin%3D*
Disallow /*pmax%3D*
Disallow /*prefn1%3D*
Disallow /*prefn2%3D*
Disallow /*prefn3%3D*
Disallow /*prefn4%3D*
Disallow /*prefn5%3D*
Disallow /*prefv1%3D*
Disallow /*prefv2%3D*
Disallow /*prefv3%3D*
Disallow /*prefv4%3D*
Disallow /*prefv5%3D*
Disallow /*prefn5%3D*
Disallow /*stickyFilters%3D*
Disallow /*bvstate%3D*

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

powermapper

Rule Path
Disallow /AU/
Disallow /NZ/
Disallow /UK/
Disallow /SG/
Disallow /MY/
Disallow /HK/
Disallow /ZA/
Disallow /BR/
Disallow .pdf*
Disallow .PDF*

Other Records

Field Value
sitemap https://cottonon.com/AU/sitemap_index.xml
sitemap https://cottonon.com/NZ/sitemap_index.xml
sitemap https://cottonon.com/US/sitemap_index.xml
sitemap https://cottonon.com/UK/sitemap_index.xml
sitemap https://cottonon.com/SG/sitemap_index.xml
sitemap https://cottonon.com/MY/sitemap_index.xml
sitemap https://cottonon.com/HK/sitemap_index.xml
sitemap https://cottonon.com/ZA/sitemap_index.xml
sitemap https://cottonon.com/BR/sitemap_index.xml

Warnings

  • 2 invalid lines.