youthtothepeople.com
robots.txt

Robots Exclusion Standard data for youthtothepeople.com

Resource Scan

Scan Details

Site Domain youthtothepeople.com
Base Domain youthtothepeople.com
Scan Status Ok
Last Scan2024-09-16T21:56:18+00:00
Next Scan 2024-09-30T21:56:18+00:00

Last Scan

Scanned2024-09-16T21:56:18+00:00
URL https://youthtothepeople.com/robots.txt
Redirect https://www.youthtothepeople.com/robots.txt
Redirect Domain www.youthtothepeople.com
Redirect Base youthtothepeople.com
Domain IPs 104.18.43.201, 172.64.144.55, 2606:4700:4400::6812:2bc9, 2606:4700:4400::ac40:9037
Redirect IPs 104.18.43.201, 172.64.144.55, 2606:4700:4400::6812:2bc9, 2606:4700:4400::ac40:9037
Response IP 172.64.144.55
Found Yes
Hash 046976a5842e6da25d1d95c6d8b1fe2a5d64b3f99001fd4c1f57b1134c617219
SimHash ea2c947c2077

Groups

*

Rule Path
Disallow /Address-List*
Disallow /account*
Disallow /cart*
Disallow /checkout-start*
Disallow /gift-wrapping*
Disallow /Order-History*
Disallow /register*
Disallow /sale*
Disallow /samples*
Disallow /search*
Disallow /shopping-bag*
Disallow /Wishlist-Show*
Disallow /*prefn1%3D
Disallow /*prefn2%3D
Disallow /*prefn3%3D
Disallow /*prefn4%3D
Disallow /*prefv1%3D
Disallow /*prefv2%3D
Disallow /*prefv3%3D
Disallow /*prefv4%3D
Disallow /*subid%3D*
Disallow /*pmax%3D*
Disallow /*pmin%3D*
Disallow /*start%3D*
Disallow /*cgid%3D*
Disallow /*sz%3D*
Disallow /*format%3D*
Disallow /*gclid%3D*
Disallow /*linksrc%3D*
Disallow /*variantID%3D*
Disallow /*crefn1%3D
Disallow /*bvstate
Disallow /*dwcont
Disallow /*dwvar
Disallow /*utm

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.youthtothepeople.com/on/demandware.static/Sites-yttp-us-Site/Sites-yttp-us-Library/default/sitemap_index.xml