Log In Sign Up

findmerr.com
robots.txt

Robots Exclusion Standard data for findmerr.com

Resource Scan

Scan Details

Site Domain findmerr.com
Base Domain findmerr.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-08-20T19:21:23+00:00
Next Scan 2024-11-18T19:21:23+00:00

Last Successful Scan

Scanned2024-03-31T18:17:09+00:00
URL https://findmerr.com/robots.txt
Domain IPs 89.47.162.214
Response IP 89.47.162.214
Found Yes
Hash aba0e53464dc5a053237f4aa435e787999b61e3c6bd09bba94675f10e03767dc
SimHash fbae6640f432

Groups

bl.uk_lddc_bot

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

addthis

Rule Path
Disallow /

addthis.com

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

affectv robot

Rule Path
Disallow /

b2w/0.1

Rule Path
Disallow /

bitlybot

Rule Path
Disallow /

bizzinformation

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

butterfly

Rule Path
Disallow /

careerbot

Rule Path
Disallow /

changedetection

Rule Path
Disallow /

cheesebot

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

compspybot

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

crescent

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotnetdotcom

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

exabot

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fast enterprise crawler

Rule Path
Disallow /

genieo

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

grub

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

integromedb

Rule Path
Disallow /

jetbot/1.0

Rule Path
Disallow /

larbin

Rule Path
Disallow /

linguatools

Rule Path
Disallow /

lipperhey

Rule Path
Disallow /

lnspiderguy

Rule Path
Disallow /

looksmart

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

miixpc

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

moget/2.1

Rule Path
Disallow /

muscat ferret

Rule Path
Disallow /

netmechanic

Rule Path
Disallow /

phantom.js bot

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

prowebwalker

Rule Path
Disallow /

proximic

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

purebot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

seomoz

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

snoopy

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

solomonobot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

spbot

Rule Path
Disallow /

spiderjack

Rule Path
Disallow /

speedy

Rule Path
Disallow /

stalker

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

teleport

Rule Path
Disallow /

telesoft

Rule Path
Disallow /

thesubot

Rule Path
Disallow /

thumbshots-de-bot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

websauger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

website quester

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webzip/4.0

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yamanalab-robot

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

zmeu

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

spiderling

Rule Path
Disallow /

webcrawler

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

arquivo-web-crawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

idg/it

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

admantx

Rule Path
Disallow /

mixrankbot

Rule Path
Disallow /

findxbot

Rule Path
Disallow /

yetibot

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

lcc

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

domaincrawler/3.0

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

domainappender

Rule Path
Disallow /

wiederfreibot

Rule Path
Disallow /

wiederfreibot/1.0

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

llc

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

riddler

Rule Path
Disallow /

deusu

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

ips-agent

Rule Path
Disallow /

garlikcrawler

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

hybridbot

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

ias_crawler

Rule Path
Disallow /

nekstbot

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

obot

Rule Path
Disallow /

netseer

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

lightspeedsystemscrawler

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

i4ds-bot

Rule Path
Disallow /

eyeotabot/1.0

Rule Path
Disallow /

lumtelbot/1.0

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://findmerr.com/sitemap/sitemap-root.xml
Back to top

Warnings

  • 4 invalid lines.
Back to top