xtrawine.com
robots.txt

Robots Exclusion Standard data for xtrawine.com

Resource Scan

Scan Details

Site Domain xtrawine.com
Base Domain xtrawine.com
Scan Status Ok
Last Scan2024-05-20T22:00:56+00:00
Next Scan 2024-05-27T22:00:56+00:00

Last Scan

Scanned2024-05-20T22:00:56+00:00
URL https://xtrawine.com/robots.txt
Redirect https://www.xtrawine.com/robots.txt
Redirect Domain www.xtrawine.com
Redirect Base xtrawine.com
Domain IPs 172.66.40.136, 172.66.43.120, 2606:4700:3108::ac42:2888, 2606:4700:3108::ac42:2b78
Redirect IPs 172.66.40.136, 172.66.43.120, 2606:4700:3108::ac42:2888, 2606:4700:3108::ac42:2b78
Response IP 172.66.43.120
Found Yes
Hash 5faae911c62a38968874de4b7b3bc746faf87435ba6cadbe1f63047cff93c6ee
SimHash 2e460453a4fb

Groups

*

Rule Path
Disallow /*Admin/*
Disallow /*admin/*
Disallow /*Handlers/*
Disallow /*handlers/*
Disallow /*Logs/*
Disallow /*logs/*
Disallow /*Paypal/*
Disallow /*paypal/*
Disallow /*Providers/*
Disallow /*providers/*
Disallow /*Services/*
Disallow /*services/*
Disallow /*Pages/*
Disallow /*pages/*
Disallow /Prodotti/*
Disallow /prodotti/*
Disallow /*.aspx
Disallow /*.aspx?*
Disallow /*.htm
Disallow /*.html
Disallow /*?search=*
Disallow /*?*&search=*
Disallow /*?c=*
Disallow /*?*&c=*
Disallow /*?min=*
Disallow /*?*&min=*
Disallow /*?max=*
Disallow /*?*&max=*
Disallow /*%3D?dst=*
Disallow /*/products*
Disallow /*/prodotti*
Disallow /*/produkte*
Disallow /*/produits*
Disallow /*/productos*
Disallow /*/comparison/*
Disallow /*/comparazione/*
Disallow /*/comparaison/*
Disallow /*/vergleich-weine/*
Disallow /*/comparacion/*
Disallow /*/cart
Disallow /*/carrello
Disallow /*/kaufkorb
Disallow /*/panier
Disallow /*/carrito
Disallow /*/checkout
Disallow /*/verifica-ordine
Disallow /*/kasse
Disallow /*/paiement
Disallow /*/caja
Disallow /*/user-account
Disallow /*/profilo-utente
Disallow /*/benutzerprofil
Disallow /*/profil-utilisateur
Disallow /*/perfil-usuario
Disallow /*/my-orders
Disallow /*/miei-ordini
Disallow /*/meine-bestellungen
Disallow /*/mes-commandes
Disallow /*/mis-pedidos
Disallow /*/wish-list
Disallow /*/lista-desideri
Disallow /*/wunschzettel
Disallow /*/liste-de-favoris
Disallow /*/lista-de-deseos
Disallow /*/authentication
Disallow /*/autenticazione
Disallow /*/authentifizierung
Disallow /*/authentification
Disallow /*/autenticacion
Disallow /*/forgotten-password
Disallow /*/password-dimenticata
Disallow /*/passwort-vergessen
Disallow /*/mot-de-passe-oublie
Disallow /*/contrasena-olvidada

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /
Allow /it/vini/sardegna/284?c=196$
Allow /it/vini/1-5-litri-magnum/658?c=373$
Allow /it/vini/1-5-litri-magnum/658?c=385$
Allow /it/vini/champagne/373?c=6548$
Allow /it/vini/champagne/373?c=6543$
Allow /it/vini/bianchi/196?c=2895$
Allow /it/vini/friuli-venezia-giulia/32?c=513$
Allow /it/vini/oltrepo-pavese-metodo-classico-docg/554?c=218$
Allow /it/vini/1-5-litri-magnum/658?c=1889$
Allow /it/vini/1-5-litri-magnum/658?c=218$
Allow /it/vini/pinot-meunier/1365?c=373$
Allow /it/vini/piemonte/256?c=266$
Allow /it/vini/pinot-nero/72?c=373$
Allow /it/vini/champagne/373?c=2877$
Allow /it/vini/dolci/266?c=3377$
Allow /it/vini/toscana/26?c=195$
Allow /it/vini/spumanti/218?c=3373$
Allow /it/vini/champagne/373?c=1600$
Allow /it/vini/1-5-litri-magnum/658?c=1250$
Allow /it/vini/champagne/373?c=6518$
Allow /it/vini/champagne/373?c=6453$
Allow /it/vini/borgogna/1003?c=196$
Allow /it/vini/champagne/373?c=7222$
Allow /it/vini/brunello-di-montalcino-docg/57?c=6062$
Allow /it/vini/marche/35?c=266$

Other Records

Field Value
sitemap https://www.xtrawine.com/sitemap_en.xml
sitemap https://www.xtrawine.com/sitemap_it.xml
sitemap https://www.xtrawine.com/sitemap_de.xml
sitemap https://www.xtrawine.com/sitemap_fr.xml
sitemap https://www.xtrawine.com/sitemap_es.xml
sitemap https://www.xtrawine.com/ch/sitemap_en-ch.xml
sitemap https://www.xtrawine.com/ch/sitemap_it-ch.xml
sitemap https://www.xtrawine.com/ch/sitemap_de-ch.xml
sitemap https://www.xtrawine.com/ch/sitemap_fr-ch.xml
sitemap https://www.xtrawine.com/hk/sitemap_en-hk.xml
sitemap https://www.xtrawine.com/hk/sitemap_tc.xml
sitemap https://www.xtrawine.com/hk/sitemap_sc.xml
sitemap https://www.xtrawine.com/uk/sitemap_en-uk.xml

Comments

  • https://www.xtrawine.com/robots.txt
  • Please see https://www.robotstxt.org/wc/norobots.html for reference.
  • https://megaindex.com/crawler