Log In Sign Up

raulprietofernandez.net
robots.txt

Robots Exclusion Standard data for raulprietofernandez.net

Resource Scan

Scan Details

Site Domain raulprietofernandez.net
Base Domain raulprietofernandez.net
Scan Status Ok
Last Scan2024-11-17T21:52:54+00:00
Next Scan 2024-11-24T21:52:54+00:00

Last Scan

Scanned2024-11-17T21:52:54+00:00
URL https://raulprietofernandez.net/robots.txt
Redirect https://www.raulprietofernandez.net/robots.txt
Redirect Domain www.raulprietofernandez.net
Redirect Base raulprietofernandez.net
Domain IPs 104.21.85.215, 172.67.211.106, 2606:4700:3032::6815:55d7, 2606:4700:3033::ac43:d36a
Redirect IPs 104.21.85.215, 172.67.211.106, 2606:4700:3032::6815:55d7, 2606:4700:3033::ac43:d36a
Response IP 104.21.85.215
Found Yes
Hash 68a8f581ad01206a29d2f4e0a6c373e86436c6320750101b5dfa0c1145c1b8b5
SimHash e3de51c009f0

Groups

*

Rule Path
Disallow /*?
Disallow /mi-portfolio/*/item/*
Disallow /adform/IFrameManager.html
Disallow /webcams/
Disallow /enable_amazon
Disallow /disable_amazon
Disallow /images/blog/117/
Disallow /matomo/
Disallow /*.webp$
Allow /modules/mod_ap_smart_layerslider/assets/
Allow /plugins/system/bt_socialconnect_system/element/css/
Allow /modules/mod_ap_smart_layerslider/tmpl/themes/
Allow /modules/mod_jvlatest_news/tmpl/default/css/
Allow /plugins/system/jcemediabox/css/
Allow /plugins/system/jcemediabox/themes/standard/css/
Allow /components/com_k2/js/
Allow /plugins/system/jcemediabox/js/
Allow /plugins/system/EUCookieDirectiveLite/EUCookieDirectiveLite/
Disallow /administrator/
Disallow /adsense/
Disallow /awstats/
Disallow /BACKUPS/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /component/k2/*
Disallow /component/slogin/provider/*
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /logs_joomla/
Disallow /media/plg_jchoptimize/
Disallow /media/plg_jchoptimize/cache/js/
Disallow /modules/
Disallow /mydocs/
Disallow /plugins/
Disallow /stats/
Disallow /tasklist/
Disallow /templates/
Disallow /tmp/
Disallow /busridercamps/
Disallow /valladolidmasqueviajes/
Disallow /VIMEO/
Disallow /blog/etiqueta*
Disallow /*etiqueta*
Disallow /blog/etiqueta/
Disallow /blog/fecha/

unisterbot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

exabot

Rule Path
Disallow /

moreoverbot

Rule Path
Disallow /

cyberalert

Rule Path
Disallow /

newscan

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

lexxebot/1.0

Rule Path
Disallow /

nextgensearchbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

sitebot/0.1

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

netseer crawler

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

discobot

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

addthis.com

Rule Path
Disallow /

proximic

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

bl.uk_lddc_bot

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

bender

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

yasni

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

integromedb

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

wesee:search

Rule Path
Disallow /

admantx

Rule Path
Disallow /

spbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.raulprietofernandez.net/sitemap.xml
sitemap https://www.raulprietofernandez.net/sitemap_images.xml
sitemap https://www.raulprietofernandez.net/sitemap_videos.xml
Back to top

Comments

  • _ _ _____ _____ ______ __ __ ______
  • | | | |_ _| __ \| ____| | \/ | ____|
  • | |__| | | | | |__) | |__ | \ / | |__
  • | __ | | | | _ /| __| | |\/| | __|
  • | | | |_| |_| | \ \| |____ | | | | |____
  • |_| |_|_____|_| \_\______| |_| |_|______|
  • No permitir Indexar los siguientes patrones
  • Permitimos para bots (explore like googlebot) webmasters
  • Allow: /media/plg_jchoptimize/cache/
  • Bloqueo de X directorios completos
  • Problemas con etiquetas
  • Evitar que los bots cacheen los links de votacion
  • Disallow: /?option=com_jvportfolio&task=items.toggleVote&pfid=*
  • Disallow: /index.php?option=com_jvportfolio&task=items.toggleVote&pfid=*
  • Disallow: /index.php?option=com_jvportfolio*
  • Disallow: /?option=com_jvportfolio*
  • Evitar que cacheen los Bots X imagenes
  • User-agent: *
  • Disallow: /images/rpf-*.png
  • Disallow: /images/portfolio/raul-prieto-fernandez-snowboard-*.jpg
  • Agentes nocivos
Back to top

Warnings

  • 6 invalid lines.
Back to top