oasis-stores.com
robots.txt

Robots Exclusion Standard data for oasis-stores.com

Resource Scan

Scan Details

Site Domain oasis-stores.com
Base Domain oasis-stores.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-16T18:56:43+00:00
Next Scan 2024-08-14T18:56:43+00:00

Last Successful Scan

Scanned2023-06-27T18:25:13+00:00
URL https://oasis-stores.com/robots.txt
Redirect https://www.oasisfashion.com/robots.txt
Redirect Domain www.oasisfashion.com
Redirect Base oasisfashion.com
Domain IPs 34.213.106.51, 54.68.182.72
Redirect IPs 13.33.88.100, 13.33.88.25, 13.33.88.36, 13.33.88.80, 2600:9000:223b:2600:10:8379:a480:93a1, 2600:9000:223b:4800:10:8379:a480:93a1, 2600:9000:223b:8800:10:8379:a480:93a1, 2600:9000:223b:8c00:10:8379:a480:93a1, 2600:9000:223b:cc00:10:8379:a480:93a1, 2600:9000:223b:d200:10:8379:a480:93a1, 2600:9000:223b:e400:10:8379:a480:93a1, 2600:9000:223b:f600:10:8379:a480:93a1
Response IP 54.192.111.56
Found Yes
Hash 0a4a7ef626df5144559e24a1208f0d36ed099cec7555c788f0c19e95bffe05b3
SimHash 22293f4a833f

Groups

*

Rule Path
Disallow /account-edit*
Disallow /preferences-edit*
Disallow /checkout-login*
Disallow /order-history*
Disallow /order-confirmation*
Disallow /on/demandware.store/*
Allow /on/demandware.store/*/Product-Show?pid=*
Disallow */Wishlist-Add*
Disallow */wishlist-add*
Disallow */Product-Variation*
Disallow /*sz%3D16%26start%3D*
Disallow /*sz%3D40%26start%3D*
Disallow /*sz%3D60%26start%3D*
Disallow /*srule%3D*
Disallow /*pmin%3D*
Disallow /*pmax%3D*
Disallow /*prefn*
Disallow /*prefv*
Disallow /*%7C*
Disallow /*search*
Allow /on/demandware.static/*/*.js
Allow /on/demandware.static/*/*.css
Allow /on/demandware.static/*/*.json
Allow /on/demandware.static/*/*.jpg
Allow /on/demandware.static/*/*.jpeg
Allow /on/demandware.static/*/*.webp
Allow /on/demandware.static/*/*.woff2
Allow /on/demandware.static/*/*.png
Allow /on/demandware.static/*/*.gif
Allow /on/demandware.static/*/*.svg

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0.2

Other Records

Field Value
sitemap https://www.oasisfashion.com/sitemap_index.xml

Comments

  • Pages
  • Product Filter
  • Ordering & Product per page
  • Number of product per page - Default 80
  • Order By
  • Price
  • Faceted Navigation
  • Search
  • Ensure no Static Ressources is blocked
  • Crawl Delay - 5 URL max per second