exprimeviajes.com
robots.txt

Robots Exclusion Standard data for exprimeviajes.com

Resource Scan

Scan Details

Site Domain exprimeviajes.com
Base Domain exprimeviajes.com
Scan Status Ok
Last Scan2024-09-28T11:26:36+00:00
Next Scan 2024-10-05T11:26:36+00:00

Last Scan

Scanned2024-09-28T11:26:36+00:00
URL https://exprimeviajes.com/robots.txt
Domain IPs 104.21.50.187, 172.67.165.136, 2606:4700:3034::6815:32bb, 2606:4700:3034::ac43:a588
Response IP 104.21.50.187
Found Yes
Hash 7e2a7c6172cb89bea116e3d04b183d23c68bc829552790fba548f222368a79d8
SimHash e9548050c8f0

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /gracias/
Disallow /aviso-legal/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /xmlrpc.php
Disallow /gracias
Allow /wp-includes/*.js
Allow /wp-includes/*.css
Disallow /comments/
Allow /*.css$
Allow /*.js$

compspybot
curious george
cybeye.com
docomo
exb language crawler
ezooms
flamingo_searchengine
genieo
genio
lwnutch
lexxebot
openwebindex
rediffnewsbot
seoengworldbot
scanmine
screaming frog seo spider
shopwiki
showyoubot
sosospider
wocbot
yeti
yeti
youdaobot
daumoa
gsa-crawler
libcrawl
linkdex
magpie-crawler
repparser
rogerbot
sindice-site-manager
sogou spider
sogou
woriobot
yacybot
yolinkbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://www.exprimeviajes.com/sitemap_index.xml
sitemap https://www.exprimeviajes.com/buscador/sitemap/

Comments

  • ____ _ _ _ _
  • ||o o| ___| |_ ___ _ __ _ __ ___ | |__ ___ | |_ __ _| |__ _ _ ___ ___ ___ ___ _ __ ___
  • ||===| / __| __/ _ \| '_ \| '__/ _ \| '_ \ / _ \| __/ _` | '_ \| | | / __|/ _ \ / __/ _ \| '_ ` _ \
  • .-.`---'-. \__ \ || (_) | |_) | | | (_) | |_) | (_) | || (_| | |_) | |_| \__ \ __/| (_| (_) | | | | | |
  • | | o .o | |___/\__\___/| .__/|_| \___/|_.__/ \___/ \__\__,_|_.__/ \__,_|___/\___(_)___\___/|_| |_| |_|
  • | | o:.o | |_|
  • | | |
  • `-".-.-.-' Esta web esta oficialmente en contra del abuso a robots
  • _| | : |_
  • (oOoOo)_)_)