shopdisney.es
robots.txt

Robots Exclusion Standard data for shopdisney.es

Resource Scan

Scan Details

Site Domain shopdisney.es
Base Domain shopdisney.es
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-06-09T10:08:53+00:00
Next Scan 2024-09-07T10:08:53+00:00

Last Successful Scan

Scanned2024-01-19T08:49:16+00:00
URL https://shopdisney.es/robots.txt
Redirect https://www.shopdisney.es/robots.txt
Redirect Domain www.shopdisney.es
Redirect Base shopdisney.es
Domain IPs 23.49.60.143, 23.49.60.184, 2600:1417:5e::1731:3c8f, 2600:1417:5e::1731:3cb8
Redirect IPs 23.209.46.18, 23.209.46.21, 2600:1417:5e::1731:3c8f, 2600:1417:5e::1731:3cb8
Response IP 42.99.140.200
Found Yes
Hash 42e09be7a73110ff630305b27bb1ce1902769d60a11a4a135be612d8b4502d79
SimHash e320296a0775

Groups

*

Rule Path
Disallow *OneID-Responder*
Disallow /search*
Disallow /*Product-ShowQuickView*
Disallow /*Product-Variation*
Disallow /Product-SizeChart*
Disallow /Promotion-Details*
Disallow /secure*
Disallow /*pmin*
Disallow /*pmax*
Disallow /null$
Disallow /my-bag*
Disallow /account*
Disallow /register*
Disallow /wishlist*
Disallow /payment*
Disallow /billing*
Disallow /shipping*
Disallow /order*
Disallow /product-print*
Disallow /contentsearch*
Disallow *?*q=*
Disallow *prefn*
Disallow *prefv*
Disallow /on/demandware.static/*/internal/jscript/dwanalytics
Disallow /on/demandware.static/*/internal/jscript/dwac
Disallow /on/demandware.store/*/__Analytics-Start
Disallow /on/demandware.static/*/js/search.js
Disallow /on/demandware.store/*/Wishlist-GetListJson
Allow *?page=*&prefn1=memberGroups
Allow *?page=*&prefn1=allowed_country
Disallow /search?page=*&prefn1=memberGroups
Disallow /search?page=*&prefn1=allowed_country
Disallow /on/demandware.store/*/Search-ShowAjax
Allow /search?q=star%2Bwars%2Bgame$
Allow /search?q=star%2Bwars%2Bcostumes$
Allow /search?q=disney%2Bgame$
Allow /search?q=marvel%2Bgame$
Allow /search?q=toy%2Bstory%2Bfancy%2Bdress$
Allow /search?q=toy%2Bstory%2Bcostumes$
Allow /search?q=encanto%2Bplayset$
Allow /search?q=buzz%2Blightyear%2Bfancy%2Bdress$
Allow /search?q=aladdin%2Bfancy%2Bdress$
Allow /search?q=avatar%2Bfigures$
Allow /search?q=dolls%2Bhouse$
Allow /search?q=duck%2Bteddy$
Allow /search?q=duck%2Bplush$
Allow /search?q=princess%2Bdolls$
Allow /search?q=lion%2Bteddy$
Allow /search?q=toy%2Bplayset$
Allow /search?q=outdoor%2Bplaysets$
Allow /search?q=duck%2Bsoft%2Btoy$
Allow /search?q=lion%2Bsoft%2Btoy$
Allow /search?q=mouse%2Bteddy$

adsbot-google-mobile

Rule Path
Disallow /secure*
Disallow /my-bag*
Disallow /search*
Disallow /account*
Disallow /register*
Disallow /wishlist*
Disallow /payment*
Disallow /billing*
Disallow /shipping*
Disallow /order*
Disallow /product-print*

adsbot-google

Rule Path
Disallow /secure*
Disallow /my-bag*
Disallow /search*
Disallow /account*
Disallow /register*
Disallow /wishlist*
Disallow /payment*
Disallow /billing*
Disallow /shipping*
Disallow /order*
Disallow /product-print*

Other Records

Field Value
sitemap https://www.shopdisney.es/sitemap_index.xml

Comments

  • Standard rules and HTML pages
  • Non-critical resources
  • PLP pagination
  • Indexable internal search pages