disneystore.co.uk
robots.txt

Robots Exclusion Standard data for disneystore.co.uk

Resource Scan

Scan Details

Site Domain disneystore.co.uk
Base Domain disneystore.co.uk
Scan Status Ok
Last Scan2024-09-01T22:35:46+00:00
Next Scan 2024-10-01T22:35:46+00:00

Last Scan

Scanned2024-09-01T22:35:46+00:00
URL https://disneystore.co.uk/robots.txt
Redirect https://www.disneystore.co.uk/robots.txt
Redirect Domain www.disneystore.co.uk
Redirect Base disneystore.co.uk
Domain IPs 184.50.85.131, 2600:1413:b000:1c::17d1:2ed1, 2600:1413:b000:1c::17d1:2eda, 96.17.180.16
Redirect IPs 23.215.7.17, 23.215.7.31, 2600:1413:b000:1c::17d1:2ed1, 2600:1413:b000:1c::17d1:2eda
Response IP 184.50.85.131
Found Yes
Hash 4fb3d1b0a1eafcc1db81a5ba6f7eb6a0ca5dc22f6659b4a5342d5461b8575f97
SimHash e3a2294a2f74

Groups

*

Rule Path
Disallow *OneID-Responder*
Disallow /search*
Disallow /*Product-ShowQuickView*
Disallow /*Product-Variation*
Disallow /Product-SizeChart*
Disallow /Promotion-Details*
Disallow /secure*
Disallow /*pmin*
Disallow /*pmax*
Disallow /null$
Disallow /my-bag*
Disallow /account*
Disallow /register*
Disallow /wishlist*
Disallow /payment*
Disallow /billing*
Disallow /shipping*
Disallow /order*
Disallow /product-print*
Disallow /contentsearch*
Disallow *?*q=*
Disallow *prefn*
Disallow *prefv*
Disallow /on/demandware.static/*/internal/jscript/dwanalytics
Disallow /on/demandware.static/*/internal/jscript/dwac
Disallow /on/demandware.store/*/__Analytics-Start
Disallow /on/demandware.static/*/js/search.js
Disallow /on/demandware.store/*/Wishlist-GetListJson
Allow *?page=*&prefn1=memberGroups
Allow *?page=*&prefn1=allowed_country
Disallow /search?page=*&prefn1=memberGroups
Disallow /search?page=*&prefn1=allowed_country
Disallow /on/demandware.store/*/Search-ShowAjax
Allow /search?q=star%2Bwars%2Bgame$
Allow /search?q=star%2Bwars%2Bcostumes$
Allow /search?q=disney%2Bgame$
Allow /search?q=marvel%2Bgame$
Allow /search?q=toy%2Bstory%2Bfancy%2Bdress$
Allow /search?q=toy%2Bstory%2Bcostumes$
Allow /search?q=encanto%2Bplayset$
Allow /search?q=buzz%2Blightyear%2Bfancy%2Bdress$
Allow /search?q=aladdin%2Bfancy%2Bdress$
Allow /search?q=avatar%2Bfigures$
Allow /search?q=dolls%2Bhouse$
Allow /search?q=duck%2Bteddy$
Allow /search?q=duck%2Bplush$
Allow /search?q=princess%2Bdolls$
Allow /search?q=lion%2Bteddy$
Allow /search?q=toy%2Bplayset$
Allow /search?q=outdoor%2Bplaysets$
Allow /search?q=duck%2Bsoft%2Btoy$
Allow /search?q=lion%2Bsoft%2Btoy$
Allow /search?q=mouse%2Bteddy$

adsbot-google-mobile

Rule Path
Disallow /secure*
Disallow /my-bag*
Disallow /search*
Disallow /account*
Disallow /register*
Disallow /wishlist*
Disallow /payment*
Disallow /billing*
Disallow /shipping*
Disallow /order*
Disallow /product-print*

adsbot-google

Rule Path
Disallow /secure*
Disallow /my-bag*
Disallow /search*
Disallow /account*
Disallow /register*
Disallow /wishlist*
Disallow /payment*
Disallow /billing*
Disallow /shipping*
Disallow /order*
Disallow /product-print*

Other Records

Field Value
sitemap https://www.disneystore.co.uk/sitemap_index.xml

Comments

  • Standard rules and HTML pages
  • Non-critical resources
  • PLP pagination
  • Indexable internal search pages