Log In Sign Up

mango.com
robots.txt

Robots Exclusion Standard data for mango.com

Resource Scan

Scan Details

Site Domain mango.com
Base Domain mango.com
Scan Status Ok
Last Scan2024-10-09T10:22:13+00:00
Next Scan 2024-11-08T10:22:13+00:00

Last Scan

Scanned2024-10-09T10:22:13+00:00
URL https://mango.com/robots.txt
Redirect https://www.mango.com/robots.txt
Redirect Domain www.mango.com
Redirect Base mango.com
Domain IPs 108.156.133.116, 108.156.133.72, 108.156.133.75, 108.156.133.8
Redirect IPs 23.36.48.9
Response IP 23.39.52.12
Found Yes
Hash 07287b2e7e8a4a8ce754bf1ecfe5017a5f0a6bb4c07d550b6b7a9834daccdacc
SimHash e7379d676677

Groups

*

Rule Path
Disallow /*size%3D*
Disallow /*min%3D*
Disallow /*max%3D*
Disallow /*?temporada=*
Disallow /*%3D*%2C*
Disallow /*sort%3Dasc
Disallow /*sort%3Ddesc
Disallow /*/search*
Disallow /*?descuento*
Disallow /shopurlhome*
Disallow /*/helppopup/*
Disallow /*GroupsColors%3D*
Disallow /*Sizes%3D*
Disallow /*Prices%3D*
Disallow /*priceOrder%3D*
Disallow /checkout/
Disallow /cy1*
Disallow /*_c19243196*
Disallow /*_c43904373*
Disallow /*_c18026703*
Disallow /*_c39849743*
Disallow /*_c6131879*
Disallow /*_c40381950*
Disallow /*_c18240984*
Disallow /*_c19944590*
Disallow /*_c20013158*
Disallow /*_c14148274*
Disallow /*_c11277498*
Disallow /*_c74691299*
Disallow /*_c20082797*
Disallow /*_c97922509*
Disallow /ws-favorites*

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

Rule Path
Disallow /services/header-bag/getBagItems

xenu

Rule Path
Disallow /

download ninja

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://shop.mango.com/sitemap.xml
Back to top

Comments

  • MNG robots file
  • A robot may not injure a human being or, through inaction, allow a human being to come to harm.
  • A robot must obey orders given it by human beings except where such orders would conflict with the First Law.
  • A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.
  • FILTERS
  • DUPLICATE LANGUAGE
  • DUPLICATE CATEGORIES
  • BOTS CONTROLS
  • SITEMAPS
Back to top