pantene.com
robots.txt

Robots Exclusion Standard data for pantene.com

Resource Scan

Scan Details

Site Domain pantene.com
Base Domain pantene.com
Scan Status Ok
Last Scan2024-11-04T22:28:40+00:00
Next Scan 2024-11-18T22:28:40+00:00

Last Scan

Scanned2024-11-04T22:28:40+00:00
URL https://pantene.com/robots.txt
Domain IPs 13.107.246.59
Response IP 13.107.246.59
Found Yes
Hash 8b1882de7a2cf57866c5f4077510b0cb2ed8d9f5d0d3ee931c0fbbea7743289b
SimHash 685443f2a552

Groups

*

Rule Path
Allow /
Disallow /en-us/product/miracle-bond-repair-shampoo-conditioner
Disallow /en-us/404
Disallow /en-us/ittakesscience
Disallow /es-us/producto/miracle-rescue-curl-define-shine-leave-on-conditioner
Disallow /es-us/producto/miracle-rescue-regenerative-hair-oil
Disallow /es-us/producto/regenerative-oil-blend-set
Disallow /es-us/producto/keratin-miracle-repair-treatment
Disallow /es-us/producto/miracle-rescue-10-in-1-multitasking-spray-leave-in-conditioner
Disallow /es-us/producto/extreme-damage-care-shampoo
Disallow /es-us/producto/extreme-damage-care-conditioner
Disallow /es-us/producto/miracle-repair-dual-pack
Disallow /es-us/producto/miracle-repair-conditioner
Disallow /es-us/producto/miracle-repair-shampoo
Disallow /es-us/producto/infinite-lengths-dual-pack
Disallow /es-us/producto/infinite-lengths-conditioner
Disallow /es-us/producto/infinite-lengths-shampoo
Disallow /es-us/producto/mix-in-shine
Disallow /es-us/producto/mix-in-anti-frizz
Disallow /es-us/producto/mix-in-lengthen
Disallow /es-us/producto/mix-in-strengthen
Disallow /es-us/producto/mix-in-hydrate
Disallow /es-us/producto/mix-in-curl

Other Records

Field Value
sitemap https://pantene.com/sitemap.xml

Warnings

  • `host` is not a known field.