wallis.co.uk
robots.txt

Robots Exclusion Standard data for wallis.co.uk

Resource Scan

Scan Details

Site Domain wallis.co.uk
Base Domain wallis.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-05T08:17:26+00:00
Next Scan 2024-07-04T08:17:26+00:00

Last Successful Scan

Scanned2023-05-31T14:42:26+00:00
URL https://wallis.co.uk/robots.txt
Redirect https://www.wallis.co.uk/robots.txt
Redirect Domain www.wallis.co.uk
Redirect Base wallis.co.uk
Domain IPs 13.248.160.137, 76.223.34.124
Redirect IPs 13.33.88.100, 13.33.88.25, 13.33.88.36, 13.33.88.80, 2600:9000:223b:1400:10:8379:a480:93a1, 2600:9000:223b:1a00:10:8379:a480:93a1, 2600:9000:223b:3e00:10:8379:a480:93a1, 2600:9000:223b:7a00:10:8379:a480:93a1, 2600:9000:223b:ae00:10:8379:a480:93a1, 2600:9000:223b:c200:10:8379:a480:93a1, 2600:9000:223b:f400:10:8379:a480:93a1, 2600:9000:223b:f800:10:8379:a480:93a1
Response IP 52.222.236.122
Found Yes
Hash 36ee153dd857522fb461e7627b4b643e885bc5d5d93432099b99fd22baaaaee3
SimHash e0271e4b07a7

Groups

*

Rule Path
Disallow /account-edit*
Disallow /preferences-edit*
Disallow /checkout-login*
Disallow /order-history*
Disallow /order-confirmation*
Disallow /on/demandware.store/*
Allow /on/demandware.store/*/Product-Show?pid=*
Disallow */Wishlist-Add*
Disallow */wishlist-add*
Disallow */Product-Variation*
Disallow */Tile-UpdateVariantTile*
Disallow /*srule%3D*
Disallow /*pmin%3D*
Disallow /*pmax%3D*
Disallow /*prefn*
Disallow /*prefv*
Disallow /*%7C*
Disallow /*search*
Allow /on/demandware.static/*/*.js
Allow /on/demandware.static/*/*.css
Allow /on/demandware.static/*/*.json
Allow /on/demandware.static/*/*.jpg
Allow /on/demandware.static/*/*.jpeg
Allow /on/demandware.static/*/*.webp
Allow /on/demandware.static/*/*.woff2
Allow /on/demandware.static/*/*.png
Allow /on/demandware.static/*/*.gif
Allow /on/demandware.static/*/*.svg

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0.2

Other Records

Field Value
sitemap https://www.wallis.co.uk/sitemap_index.xml
sitemap https://www.wallisfashion.com/eu/sitemap_index.xml

Comments

  • Pages
  • Product Filter
  • Order By
  • Price
  • Faceted Navigation
  • Search
  • Ensure no Static Ressources is blocked
  • Crawl Delay - 5 URL max per second