boohooman.com
robots.txt

Robots Exclusion Standard data for boohooman.com

Resource Scan

Scan Details

Site Domain boohooman.com
Base Domain boohooman.com
Scan Status Ok
Last Scan2024-11-02T08:10:15+00:00
Next Scan 2024-11-16T08:10:15+00:00

Last Scan

Scanned2024-11-02T08:10:15+00:00
URL https://boohooman.com/robots.txt
Redirect https://www.boohooman.com/robots.txt
Redirect Domain www.boohooman.com
Redirect Base boohooman.com
Domain IPs 34.213.106.51, 54.68.182.72
Redirect IPs 2600:1413:b000:1b::17d7:70c, 2600:1413:b000:1b::17d7:70e, 96.17.180.42, 96.17.180.48
Response IP 96.17.180.42
Found Yes
Hash 444ada0ef716965171b7dc78bf63c538e5c2e2d546de85be8e1822417531b458
SimHash 60213e4a0267

Groups

*

Rule Path
Disallow /myaccount*
Disallow /account-edit*
Disallow /preferences-edit*
Disallow /checkout-login*
Disallow /order-history*
Disallow /order-confirmation*
Disallow /on/demandware.store/*
Allow /on/demandware.store/*/Product-Show?pid=*
Disallow */Wishlist-Add*
Disallow */wishlist-add*
Disallow */Product-Variation*
Disallow /*sz%3D16%26start%3D*
Disallow /*srule%3D*
Disallow /*pmin%3D*
Disallow /*pmax%3D*
Disallow /*prefn*
Disallow /*prefv*
Disallow /*%7C*
Disallow /*search*
Allow /on/demandware.static/*/*.js
Allow /on/demandware.static/*/*.css
Allow /on/demandware.static/*/*.json
Allow /on/demandware.static/*/*.jpg
Allow /on/demandware.static/*/*.jpeg
Allow /on/demandware.static/*/*.webp
Allow /on/demandware.static/*/*.woff2
Allow /on/demandware.static/*/*.png
Allow /on/demandware.static/*/*.gif
Allow /on/demandware.static/*/*.svg

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0.2

Other Records

Field Value
sitemap https://www.boohooman.com/sitemap_index.xml
sitemap https://www.boohooman.com/us/sitemap_index.xml
sitemap https://www.boohooman.com/au/sitemap_index.xml
sitemap https://www.boohooman.com/eu/sitemap_index.xml

Comments

  • Pages
  • Product Filter
  • Ordering & Product per page
  • Number of product per page
  • Order By
  • Price
  • Faceted Navigation
  • UK & ALL Search
  • Allow: /search?q=pride
  • Allow: /search?q=MCR
  • Allow: /search?cgid=mens-quincy
  • Allow: /search?q=big+&+tall
  • Allow: /search?q=disney
  • EU Search
  • Allow: /search?q=STRIPE+
  • Search
  • Ensure no Static Ressources is blocked
  • Crawl Delay - 5 URL max per second