Log In Sign Up

viajecaminodesantiago.com
robots.txt

Robots Exclusion Standard data for viajecaminodesantiago.com

Resource Scan

Scan Details

Site Domain viajecaminodesantiago.com
Base Domain viajecaminodesantiago.com
Scan Status Ok
Last Scan7/14/2025, 7:50:38 AM
Next Scan 8/13/2025, 7:50:38 AM

Last Scan

Scanned7/14/2025, 7:50:38 AM
URL https://viajecaminodesantiago.com/robots.txt
Domain IPs 104.21.33.218, 172.67.150.195, 2606:4700:3032::6815:21da, 2606:4700:3032::ac43:96c3
Response IP 172.67.150.195
Found Yes
Hash f340e0a4e97b845eaf2c63d79ba815113062997a5b35cb1ff244fbdda8a1ffbf
SimHash 60d97c434ea7

Groups

*

Rule Path
Allow /*/page/1/
Allow /*/page/2/
Allow /*/page/3/
Allow /*/page/4/
Allow /*/page/5/
Allow /*/*/page/1/
Allow /*/*/page/2/
Allow /*/*/page/3/
Allow /*/*/page/4/
Allow /*/*/page/5/
Allow /*/*/*/page/1/
Allow /*/*/*/page/2/
Allow /*/*/*/page/3/
Allow /*/*/*/page/4/
Allow /*/*/*/page/5/
Allow /*/*/*/*/page/1/
Allow /*/*/*/*/page/2/
Allow /*/*/*/*/page/3/
Allow /*/*/*/*/page/4/
Allow /*/*/*/*/page/5/
Disallow /*/page/*/
Disallow /*/*/page/*/
Disallow /*/*/*/page/*/
Disallow /*/*/*/*/page/*/
Disallow /de/camino-*
Disallow /fr/camino-*
Disallow /reserva/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /en/preguntas/
Disallow /en/reserva/
Disallow /it/preguntas/
Disallow /de/preguntas/
Disallow /fr/preguntas/
Disallow /it/cassa/
Disallow /finalizar-compra/
Disallow /en/checkout/
Disallow /en/viajes-organizados/
Disallow /it/viajes-organizados/
Disallow /categoria-producto/$
Disallow /*/?orderby=$
Disallow /*/*/?orderby=$
Disallow /*/*/*/?orderby=$
Disallow /*/?post_type=$
Disallow /*/*/?post_type=$
Disallow /*/*/*/?post_type=$
Disallow /*/comment-page-*
Disallow /*/*/comment-page-*
Disallow /*/*/*/comment-page-*
Disallow /categoria-producto/sin-categorizar/
Disallow /xmlrpc.php
Disallow /*.sql$
Disallow /*.zip
Disallow /*.7zip
Disallow /*.tgz$
Disallow /*.gz$
Disallow /*.tar$
Disallow /*.svn$
Allow /wp-admin/admin-ajax.php
Allow /*.js
Allow /*.css
Disallow /*/?clang=all
Disallow /viajes-organizados/
Allow /viajes-organizados/a-tu-aire/
Allow /viajes-organizados/en-bicicleta/
Allow /viajes-organizados/viajes-escolares-estudios-institutos/
Allow /viajes-organizados/excursiones-galicia/
Allow /viajes-organizados/traslados/
Disallow /en/tours/
Allow /en/tours/your-own-pace/
Allow /en/tours/bicycle-pilgrimage/
Allow /en/tours/school-trips/
Allow /en/tours/day-trips-galicia/
Allow /en/tours/transfers/
Disallow /fr/voyage-organise/
Allow /fr/voyage-organise/chemin-votre-rythme/
Allow /fr/voyage-organise/chemin-du-groupe/
Allow /fr/voyage-organise/chemin-a-velo/
Allow /fr/voyage-organise/excursions-galice/
Allow /fr/voyage-organise/transferts/
Disallow /de/jakobsweg-organisiert/
Allow /de/jakobsweg-organisiert/weg-zu-fuss/
Allow /de/jakobsweg-organisiert/wandergruppen/
Allow /de/jakobsweg-organisiert/fahrradreisen/
Allow /de/jakobsweg-organisiert/abschlussfahrten/
Allow /de/jakobsweg-organisiert/ausfluge-galicien/
Allow /de/jakobsweg-organisiert/transfers/
Disallow /it/viaggi-organizzati/
Allow /it/viaggi-organizzati/esperienze-per-conto-proprio/
Allow /it/viaggi-organizzati/pellegrinaggio-in-bicicletta/
Allow /it/viaggi-organizzati/gite-scolastiche/
Allow /it/viaggi-organizzati/escursioni-galizia/
Allow /it/viaggi-organizzati/trasferimenti/

*

Rule Path
Allow /feed/$
Disallow /feed/
Disallow /comments/feed/
Disallow /*/feed/
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$
Disallow /*/?clang=all
Disallow /*/*/?clang=all

googlebot

Rule Path
Allow /*.css$
Allow /*.js$

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

orthogaffe

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://viajecaminodesantiago.com/sitemap_index.xml
Back to top

Comments

  • Bloqueo de feeds para crawlers
Back to top