libreriapelayo.es
robots.txt

Robots Exclusion Standard data for libreriapelayo.es

Resource Scan

Scan Details

Site Domain libreriapelayo.es
Base Domain libreriapelayo.es
Scan Status Ok
Last Scan2024-11-15T01:38:16+00:00
Next Scan 2024-12-15T01:38:16+00:00

Last Scan

Scanned2024-11-15T01:38:16+00:00
URL https://libreriapelayo.es/robots.txt
Redirect https://www.libreriapelayo.es/robots.txt
Redirect Domain www.libreriapelayo.es
Redirect Base libreriapelayo.es
Domain IPs 217.18.163.139
Redirect IPs 217.18.163.139
Response IP 217.18.163.139
Found Yes
Hash 0c634737d6550447956d536e6fa7212aa0a6cfd0330293181c4b46465a44d00d
SimHash 62df7890c613

Groups

*

Rule Path
Disallow /?ean
Disallow /?isbn
Disallow /*?pagSel
Disallow /*%26cuantos
Disallow /*%26orden
Disallow /*/admin/
Disallow /*/registro/
Disallow /*/cesta/
Disallow /*/cupdate/
Disallow /*/cup/
Disallow /*/contacto/
Disallow /*/busqueda/
Disallow /*/opiniones/
Disallow /*/smarty/
Disallow /*/avisoCookie.php
Disallow /*/avisoCookieMostrar.php
Disallow /*/mensaje.php
Disallow /*/avisadorStock.php

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

linkchecker

Rule Path
Disallow /

psbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

wget

Rule Path
Disallow /

eurobot

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

www-mechanize

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

gonzo

Rule Path
Disallow /

gonzo

Rule Path
Disallow /

sapphirewebcrawler

Rule Path
Disallow /

cabot

Rule Path
Disallow /

acontbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

catchbot

Rule Path
Disallow /

webrankspider

Rule Path
Disallow /

yacy

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

surveybot_ignoreip

Rule Path
Disallow /

yanga worldsearch bot

Rule Path
Disallow /

oozbot

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

naver

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

iisbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

citenikbot

Rule Path
Disallow /

charlotte

Rule Path
Disallow /

exabot

Rule Path
Disallow /

vedensbot

Rule Path
Disallow /

lexxebot

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

tagoobot

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

euripbot

Rule Path
Disallow /

butterfly

Rule Path
Disallow /

isara-search

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

nutch

Rule Path
Disallow /

nutch-agent

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

botonparade

Rule Path
Disallow /

jobs.de-robot

Rule Path
Disallow /

clewwa-bot

Rule Path
Disallow /

search17

Rule Path
Disallow /

spbot

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

speedy

Rule Path
Disallow /

catchbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

search17

Rule Path
Disallow /

envolk

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

bilbo

Rule Path
Disallow /

tineye

Rule Path
Disallow /

bixolabs

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

infometrics-bot

Rule Path
Disallow /

exdomain

Rule Path
Disallow /

xenu

Rule Path
Disallow /

peew

Rule Path
Disallow /

bixolabs

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

iccrawler - icjobs

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

flightdeckreportsbot

Rule Path
Disallow /

openwebspider

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

webintegration

Rule Path
Disallow /

webmeasurement-bot

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

suggybot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yahoo

Rule Path
Disallow /

slurp

Rule Path
Disallow /

noxtrumbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.libreriapelayo.es/sitemap.xml

Warnings

  • 4 invalid lines.