vapo.es
robots.txt

Robots Exclusion Standard data for vapo.es

Resource Scan

Scan Details

Site Domain vapo.es
Base Domain vapo.es
Scan Status Ok
Last Scan2024-05-27T10:34:11+00:00
Next Scan 2024-06-26T10:34:11+00:00

Last Scan

Scanned2024-05-27T10:34:11+00:00
URL https://vapo.es/robots.txt
Domain IPs 104.26.10.224, 104.26.11.224, 172.67.70.87, 2606:4700:20::681a:ae0, 2606:4700:20::681a:be0, 2606:4700:20::ac43:4657
Response IP 104.26.10.224
Found Yes
Hash 757ba0344bf5d50351e949f4a56ea9c896f44ed7716cfa08450c2f4e39522257
SimHash a0197942ae51

Groups

*

Rule Path
Allow /
Disallow /pub/
Allow /pub/media/sitemap.xml
Allow /*.js
Allow /*.css
Disallow */checkout/
Allow /checkout/cart/
Disallow /customer/
Allow /customer/account/login/
Disallow */app/*
Disallow */bin/*
Disallow */dev/*
Disallow */lib/*
Allow */lib/*.js
Allow */lib/*.css
Disallow */phpserver/*
Disallow */pkginfo/*
Disallow */report/*
Disallow */setup/*
Disallow */update/*
Disallow */var/*
Disallow */vendor/*
Disallow */generated/*
Disallow */Magento_UI/*
Disallow */templates/*
Disallow */gtm/*
Disallow */paypal/*
Disallow */productalert/*
Disallow */catalog/product/view/*
Disallow */catalog/category/view/*
Disallow /wishlist/
Disallow /order/
Disallow /review/
Disallow /newsletter/
Disallow /*.php$

adsbot-google

Rule Path
Disallow */session_trace/*

orthogaffe

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

xenu

Rule Path
Disallow /

Other Records

Field Value
sitemap https://vapo.es/pub/media/sitemap.xml

Comments

  • Disable Crawling of Metric URLs (VAP-473)
  • Bots de Spam