Log In Sign Up

nz.2xu.com
robots.txt

Robots Exclusion Standard data for nz.2xu.com

Resource Scan

Scan Details

Site Domain nz.2xu.com
Base Domain 2xu.com
Scan Status Ok
Last Scan2025-12-16T18:49:06+00:00
Next Scan 2025-12-30T18:49:06+00:00

Last Scan

Scanned2025-12-16T18:49:06+00:00
URL https://nz.2xu.com/robots.txt
Domain IPs 23.227.38.74, 2620:127:f00f:e::
Response IP 23.227.38.74
Found Yes
Hash 9927f4c2b589cc6c9215f3adb21adf281de84310402b7534f376ddeda34eeee8
SimHash 6734df16ded5

Groups

*

Rule Path Comment
Disallow /a/downloads/-/* -
Disallow /admin -
Disallow /cart -
Disallow /orders -
Disallow /checkouts/ -
Disallow /checkout -
Disallow /51840876699/checkouts -
Disallow /51840876699/orders -
Disallow /carts -
Disallow /account -
Disallow /collections/*sort_by* -
Disallow /*/collections/*sort_by* -
Disallow /collections/*%2B* -
Disallow /collections/*%2B* -
Disallow /collections/*%2B* -
Disallow /*/collections/*%2B* -
Disallow /*/collections/*%2B* -
Disallow /*/collections/*%2B* -
Disallow /collections/vendors*?*q=* -
Disallow /collections/types*?*q=* -
Disallow /collections/*?*grid_list* -
Disallow /collections/*?*view* -
Disallow /collections/*?*filter* -
Disallow /*/collections/*?*filter* -
Disallow /collections/*?*pf_* -
Disallow /collections/*?*constraint* -
Disallow /collections/*?*q=* NEW - Blocks in-collection search queries
Disallow /*/collections/*?*q=* NEW - Blocks in-collection search queries with path prefixes (e.g., /us/)
Disallow /blogs/*%2B* -
Disallow /blogs/*%2B* -
Disallow /blogs/*%2B* -
Disallow /*/blogs/*%2B* -
Disallow /*/blogs/*%2B* -
Disallow /*/blogs/*%2B* -
Disallow /blogs/*/tagged/* -
Disallow /*?*oseid=* -
Disallow /*preview_theme_id* -
Disallow /*preview_script_id* -
Disallow /policies/ -
Disallow /*/policies/ -
Disallow /*/*?*ls=*&ls=* -
Disallow /*/*?*ls%3D*%3Fls%3D* -
Disallow /*/*?*ls%3D*%3Fls%3D* -
Disallow /search -
Disallow /apple-app-site-association -
Disallow /.well-known/shopify/monorail -
Disallow /cdn/wpm/*.js This JS path is blocked for all bots adhering to User-agent: * (including Googlebot and AdsBot-Google)
Disallow /recommendations/products -
Disallow /*/recommendations/products -

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path Comment
Disallow Allows full crawling

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path Comment
Disallow Allows full crawling

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

Rule Path
Disallow /*?q=*

Other Records

Field Value
crawl-delay 1

googlebot-image

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://nz.2xu.com/sitemap.xml
Back to top

Comments

  • Collection related disallows for sorting, facets, and query parameters
  • Blog related disallows
  • Generic parameter and preview disallows
  • Policy and specific path disallows
  • Nutch Bot specific
  • Ahrefs Bots - Opened up for crawling, but with a crawl delay
  • MJ12bot (Majestic)
  • Disallow rules are inherited from User-agent: *
  • Pinterest Bot
  • Other disallow rules are inherited from User-agent: *
  • Googlebot will use the rules specified under User-agent: *
  • This ensures it respects disallows for /cart, /account, /search, /collections/*?*filter*, etc.
  • and is also blocked from /cdn/wpm/*.js
  • Googlebot-image
  • Allows Googlebot-image to crawl all images, overriding User-agent: * for image-specific crawling.
Back to top