Log In Sign Up

buscoempresas.com
robots.txt

Robots Exclusion Standard data for buscoempresas.com

Resource Scan

Scan Details

Site Domain buscoempresas.com
Base Domain buscoempresas.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-09-27T15:09:17+00:00
Next Scan 2024-11-26T15:09:17+00:00

Last Successful Scan

Scanned2024-07-30T15:07:51+00:00
URL https://buscoempresas.com/robots.txt
Redirect https://www.buscoempresas.com/robots.txt
Redirect Domain www.buscoempresas.com
Redirect Base buscoempresas.com
Domain IPs 2001:41d0:8:9192::1, 5.39.79.146
Response IP 5.39.79.146
Found Yes
Hash 94412b7a2f3340a55f7b65e92aba04a7869ae0d94f7eff53c4435f7240d5d3ca
SimHash b2993070cfe7

Groups

ubicrawler

Rule Path
Disallow /

wikiwix

Rule Path
Disallow /

doc

Rule Path
Disallow /

zaosite

Rule Path
Disallow /

heck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

express webpictures

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

moreoverbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ezooms.bot

Rule Path
Disallow /

tweetedtimes

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

bitlybot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

linkedinbot

Rule Path
Disallow /

komodiabot

Rule Path
Disallow /

jakarta commons

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

speedy spider

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

showyoubot

Rule Path
Disallow /

htmlparser

Rule Path
Disallow /

sinaabot

Rule Path
Disallow /

askpeterbot

Rule Path
Disallow /

indy library

Rule Path
Disallow /

yeti

Rule Path
Disallow /

siteintel.net bot

Rule Path
Disallow /

addsugarspiderbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

swebot

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

dcpbot

Rule Path
Disallow /

seoprofiler

Rule Path
Disallow /

percbotspider

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

comodospider

Rule Path
Disallow /

erippbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

webcollage

Rule Path
Disallow /

ltbot

Rule Path
Disallow /

gslfbot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

influencebot

Rule Path
Disallow /

sgroup crawler

Rule Path
Disallow /

curious george

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

dle_spider

Rule Path
Disallow /

blogshares spiders

Rule Path
Disallow /

jetslide

Rule Path
Disallow /

bintellibot

Rule Path
Disallow /

icorpusbot

Rule Path
Disallow /

animalstxt.org/bot

Rule Path
Disallow /

acoon

Rule Path
Disallow /

jayde nichebot

Rule Path
Disallow /

eqentia-bot

Rule Path
Disallow /

urllib

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

comodo-certificates-spider

Rule Path
Disallow /

open web analytics bot

Rule Path
Disallow /

admedia bot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

toplistbot

Rule Path
Disallow /

openindexspider

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

socialradarbot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

grepnetstatbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

pub-crawler

Rule Path
Disallow /

hotjava

Rule Path
Disallow /

proximic

Rule Path
Disallow /

integromedb

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

bot-pge.chlooe.com

Rule Path
Disallow /

procogbot

Rule Path
Disallow /

careerbot

Rule Path
Disallow /

compspybot

Rule Path
Disallow /

news bot

Rule Path
Disallow /

open web analytics bot webactiva_version

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

girafabot

Rule Path
Disallow /

peoplepal

Rule Path
Disallow /

webfetch

Rule Path
Disallow /

wordchampbot

Rule Path
Disallow /

xaldon webspider

Rule Path
Disallow /

sbl-bot

Rule Path
Disallow /

ucmore crawler app

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

domainvader

Rule Path
Disallow /

lssrocketcrawler

Rule Path
Disallow /

statsbot

Rule Path
Disallow /

woriobot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

undrip bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

pagesinventory

Rule Path
Disallow /

previewbot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

exb language crawler

Rule Path
Disallow /

procogseobot

Rule Path
Disallow /

queryseekerspider

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

linkscrawler

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

i-market-bot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap http://www.buscoempresas.com/sitemap.xml.gz
Back to top

Warnings

  • 4 invalid lines.
Back to top