Log In Sign Up

high-everydaycouture.com
robots.txt

Robots Exclusion Standard data for high-everydaycouture.com

Resource Scan

Scan Details

Site Domain high-everydaycouture.com
Base Domain high-everydaycouture.com
Scan Status Ok
Last Scan2024-10-17T04:52:58+00:00
Next Scan 2024-11-16T04:52:58+00:00

Last Scan

Scanned2024-10-17T04:52:58+00:00
URL https://high-everydaycouture.com/robots.txt
Redirect https://www.high-everydaycouture.com/robots.txt
Redirect Domain www.high-everydaycouture.com
Redirect Base high-everydaycouture.com
Domain IPs 34.241.19.243
Redirect IPs 3.165.102.107, 3.165.102.113, 3.165.102.127, 3.165.102.24
Response IP 3.165.102.107
Found Yes
Hash 20b0cf68756c4445ce9e27e7ff2ffe31ad7e0ea4eb9a31594294c69c31d7dbb8
SimHash cd6238578fe3

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

*

Rule Path
Disallow /CVS
Disallow /*.svn$
Disallow /*.idea$
Disallow /*.sql$
Disallow /*.tgz$
Disallow *brand%3D*
Disallow *color%3D*
Disallow *color_filter%3D*
Disallow *material_filter%3D*
Disallow *fitting_filter%3D*
Disallow *asc%3Dprice*
Disallow *desc%3Dprice*
Disallow *asc%3Dname*
Disallow *desc%3Dname*
Disallow *food_type%3D*
Disallow *tags%3D*
Disallow *size%3D*
Disallow *search%3D*
Disallow *popup%3D*
Disallow *successRedirect%3D*
Disallow */user/*
Disallow */checkout/*
Disallow */wishlist/*
Back to top

Other Records

Field Value
sitemap https://www.high-everydaycouture.com/sitemap/index.xml
Back to top

Comments

  • Specific Disallow for filters
  • But accept pages
  • Exclude other parametric for pop-ups
  • Do not crawl checkout and user account pages
Back to top