azadea.com
robots.txt

Robots Exclusion Standard data for azadea.com

Resource Scan

Scan Details

Site Domain azadea.com
Base Domain azadea.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-16T08:25:15+00:00
Next Scan 2026-05-17T08:25:15+00:00

Last Successful Scan

Scanned2024-04-21T03:56:55+00:00
URL https://www.azadea.com/robots.txt
Domain IPs 104.16.56.66, 104.16.57.66
Response IP 104.16.57.66
Found Yes
Hash a637510c1af2a7a0f19f43b42b7d18487217540d99be0ce970f93184351b4ad9
SimHash 79097398ef16

Groups

*

Rule Path
Disallow */demandware.store/
Disallow */__SYSTEM__StorefrontToolkit-Start
Disallow */account
Disallow */edits
Disallow */sale/*
Disallow */new-in/*
Disallow */shopping-bag
Disallow */hidden
Disallow */wishlist
Disallow */visual-search
Disallow */lb/ar/*
Disallow */national-day-offer/*
Disallow /*?*v=
Disallow /*?*q=
Disallow /*?*lang=
Disallow /*?*postid=
Disallow /*?*size=
Disallow /*?*cgid=
Disallow /*?refinementColor=
Disallow /*?*sizeRefinement=
Disallow /*?*price=
Disallow /*?*srule=
Disallow /*?*start=
Disallow /*?*superStore=
Disallow /*?*subBrand=
Disallow /*?*isSale=
Disallow /*?*fit=
Disallow /*?*styles=
Disallow /*?*design=
Disallow /*?*productLengthType=
Disallow /*?*sleeve_length=
Disallow /*?*material=
Disallow /*?*necklineType=
Disallow /*?*waistType=
Disallow /*?*closureType=
Disallow /*?*promo_id=
Disallow /*?*promo_name=
Disallow /*?*cuff=
Disallow /*?*gender=
Disallow /*?*heelHeightType=
Disallow /*?*heelStyleType=
Disallow /*?*natureType=
Disallow /*?*original=
Disallow /*?*pid=
Disallow /*?*prefn1=
Disallow /*?*productId=
Disallow /*?*sizevalue=
Disallow /*?*sz=

Other Records

Field Value
sitemap https://www.azadea.com/en/sitemap_index.xml
sitemap https://www.azadea.com/kw/en/sitemap_index.xml
sitemap https://www.azadea.com/qa/en/sitemap_index.xml
sitemap https://www.azadea.com/lb/en/sitemap_index.xml

Comments

  • Pages
  • Blocking LB AR pages
  • Festive Pages allowing only L1 to be crawled
  • URL parameters