shop.mango.com
robots.txt

Robots Exclusion Standard data for shop.mango.com

Resource Scan

Scan Details

Site Domain shop.mango.com
Base Domain mango.com
Scan Status Ok
Last Scan2024-10-23T16:22:32+00:00
Next Scan 2024-11-06T16:22:32+00:00

Last Scan

Scanned2024-10-23T16:22:32+00:00
URL https://shop.mango.com/robots.txt
Domain IPs 23.36.48.9
Response IP 23.54.56.11
Found Yes
Hash d403046042849c7de7019ac7225f32dbdf4551e41265feff6effc45c2b83507b
SimHash 6fa39056606f

Groups

*

Rule Path
Disallow /*size%3D*
Disallow /*min%3D*
Disallow /*max%3D*
Disallow /*?temporada=*
Disallow /*%3D*%2C*
Disallow /*sort%3Dasc
Disallow /*sort%3Ddesc
Disallow /*/search*
Disallow /*?descuento*
Disallow /shopurlhome*
Disallow /*/helppopup/*
Disallow /*GroupsColors%3D*
Disallow /*Sizes%3D*
Disallow /*Prices%3D*
Disallow /*priceOrder%3D*
Disallow /checkout/
Disallow /es1*
Disallow /es-cn*
Disallow /es2*
Disallow /es-ce*
Disallow /es3*
Disallow /es-ml*
Disallow /cy1*
Disallow /gb1*
Disallow /gb-cha*
Disallow /*_c19243196*
Disallow /*_c43904373*
Disallow /*_c18026703*
Disallow /*_c39849743*
Disallow /*_c6131879*
Disallow /*_c40381950*
Disallow /*_c18240984*
Disallow /*_c19944590*
Disallow /*_c20013158*
Disallow /*_c14148274*
Disallow /*_c11277498*
Disallow /*_c74691299*
Disallow /*_c20082797*
Disallow /*_c97922509*
Disallow /ws-favorites*

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

Rule Path
Disallow /services/header-bag/getBagItems

xenu

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

Other Records

Field Value
sitemap https://shop.mango.com/sitemap.xml

Comments

  • FILTERS
  • DUPLICATE LANGUAGE
  • DUPLICATE CATEGORIES
  • BOTS CONTROLS
  • SITEMAPS