peruebooks.com
robots.txt

Robots Exclusion Standard data for peruebooks.com

Resource Scan

Scan Details

Site Domain peruebooks.com
Base Domain peruebooks.com
Scan Status Ok
Last Scan2024-06-27T11:40:54+00:00
Next Scan 2024-07-27T11:40:54+00:00

Last Scan

Scanned2024-06-27T11:40:54+00:00
URL https://peruebooks.com/robots.txt
Redirect https://www.peruebooks.com/robots.txt
Redirect Domain www.peruebooks.com
Redirect Base peruebooks.com
Domain IPs 104.21.48.130, 172.67.151.163, 2606:4700:3035::ac43:97a3, 2606:4700:3036::6815:3082
Redirect IPs 104.21.48.130, 172.67.151.163, 2606:4700:3035::ac43:97a3, 2606:4700:3036::6815:3082
Response IP 172.67.151.163
Found Yes
Hash 7bd4a817148fcd4454fbc2812fc994d995c5c98742a701b23d4d2db57fb3f86d
SimHash 116c4edcfe93

Groups

*

Rule Path
Disallow /images/
Disallow /acceso/
Disallow /admin/
Disallow /mi_pedido/
Disallow /ver_carrito/
Disallow /ayuda/
Disallow /contenidos/
Disallow /bookwire/
Disallow /cache/
Disallow /desarrollo2/
Disallow /elsevier/
Disallow /epubreader/
Disallow /css/
Disallow /js/
Disallow /templates/
Disallow /hybrid/
Disallow /hybridauth/
Disallow /boletines/
Disallow /images_autores/
Disallow /pops/
Disallow /inc/
Disallow /add/agrega_deseo/
Disallow /videos/
Disallow /request/as/ebook/
Disallow /paypal/
Disallow /tmp/
Disallow /session/
Disallow /add/

ahrefsbot/5.0

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot/1.1

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

adidum/1.0

Rule Path
Disallow /

ahrefsbot/5.0

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

brew-applet/0x20068888

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

cfnetwork/760.2.6

Rule Path
Disallow /

dotbot/1.1

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

everyonesocialbot

Rule Path
Disallow /

exabot/3.0

Rule Path
Disallow /

exalead previewer

Rule Path
Disallow /

genieo/1.0

Rule Path
Disallow /

gigabot/1.0

Rule Path
Disallow /

go 1.1 package

Rule Path
Disallow /

grapeshotcrawler/2.0

Rule Path
Disallow /

httrack 3.0x

Rule Path
Disallow /

istellabot/1.23.15

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

nutch-1.10

Rule Path
Disallow /

nutch-1.7

Rule Path
Disallow /

paperlibot/2.1

Rule Path
Disallow /

ripper

Rule Path
Disallow /

safesearch microdata crawler

Rule Path
Disallow /

sogou web spider/4.0

Rule Path
Disallow /

wbsearchbot/1.1

Rule Path
Disallow /

winhttp

Rule Path
Disallow /

xenu link sleuth/1.3.8

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

curl

Rule Path
Disallow /

coccoc/1.0

Rule Path
Disallow /

heritrix/1.12.1

Rule Path
Disallow /

linkdexbot/2.2

Rule Path
Disallow /

proximic

Rule Path
Disallow /

psbot-page

Rule Path
Disallow /

psbot/0.1

Rule Path
Disallow /

spbot/4.4.2

Rule Path
Disallow /

woobot/2.0

Rule Path
Disallow /

Comments

  • Users inutiles