Log In Sign Up

fbu.ro
robots.txt

Robots Exclusion Standard data for fbu.ro

Resource Scan

Scan Details

Site Domain fbu.ro
Base Domain fbu.ro
Scan Status Ok
Last Scan2024-07-05T11:02:30+00:00
Next Scan 2024-07-12T11:02:30+00:00

Last Scan

Scanned2024-07-05T11:02:30+00:00
URL https://fbu.ro/robots.txt
Redirect https://www.fbu.ro/robots.txt
Redirect Domain www.fbu.ro
Redirect Base fbu.ro
Domain IPs 93.113.174.227
Redirect IPs 93.113.174.227
Response IP 93.113.174.227
Found Yes
Hash 33c427a0324f7bd01a203dcfc343afa5bed379a881b3b72ed8d53e4f7f885510
SimHash 6b37548a4484

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Allow /

slurp

Rule Path
Allow /

msnbot

Rule Path
Allow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

spiderling

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

hpi-bi-crawler/0.1

Rule Path
Disallow /

hpi-bi-crawler

Rule Path
Disallow /

it2media-domain-crawler

Rule Path
Disallow /

solomonobot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

twikle

Rule Path
Disallow /

miadev

Rule Path
Disallow /

openindexspider

Rule Path
Disallow /

compspybot

Rule Path
Disallow /

infohelfer

Rule Path
Disallow /

butterfly

Rule Path
Disallow /

yet-another-spider

Rule Path
Disallow /

procogbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

careerbot

Rule Path
Disallow /

openindexdeepspider

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

twitmunin crawler

Rule Path
Disallow /

showyoubot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

netestate rss crawler

Rule Path
Disallow /

discobot

Rule Path
Disallow /

hometags

Rule Path
Disallow /

eventmachine

Rule Path
Disallow /

linkedinbot

Rule Path
Disallow /

evrinid iudex

Rule Path
Disallow /

rivva

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ssearch_bot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

moreoverbot

Rule Path
Disallow /

postrank

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

search17

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

domaincrawler/3.0

Rule Path
Disallow /

feedworker

Rule Path
Disallow /

webmastercoffee

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

thumbshots-de-bot

Rule Path
Disallow /

urlpuls

Rule Path
Disallow /

bizzinformation

Rule Path
Disallow /

ruky-roboter

Rule Path
Disallow /

blogscope

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

sindicebot

Rule Path
Disallow /

cligoorobot

Rule Path
Disallow /

eurobot

Rule Path
Disallow /

peew

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

webcrawler

Rule Path
Disallow /

http://www.uni-koblenz.de/~flocke/robot-info.txt

Rule Path
Disallow /

abby

Rule Path
Disallow /

aboutusbot

Rule Path
Disallow /

acontbot

Rule Path
Disallow /

acoon-robot

Rule Path
Disallow /

advista

Rule Path
Disallow /

antbot

Rule Path
Disallow /

amznkassocbot

Rule Path
Disallow /

blogpulselive

Rule Path
Disallow /

butterfly

Rule Path
Disallow /

cabot

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

charlotte

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

cizilla

Rule Path
Disallow /

djangotraineebot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dropcatcher.de

Rule Path
Disallow /

exabot

Rule Path
Disallow /

eventax

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

fairshare

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

galbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

iccrawler

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

icjobs

Rule Path
Disallow /

isara-search

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

lapozzbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mergeflow-feedfetcher

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

netluchs

Rule Path
Disallow /

newskraft

Rule Path
Disallow /

nutch

Rule Path
Disallow /

oneriot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

semager

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

shelob

Rule Path
Disallow /

si-bot

Rule Path
Disallow /

snoopy

Rule Path
Disallow /

speedy

Rule Path
Disallow /

suchbaer

Rule Path
Disallow /

technoratibot

Rule Path
Disallow /

teoma

Rule Path
Disallow /

toplistbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

webalta

Rule Path
Disallow /

webdatacentrebot

Rule Path
Disallow /

websitewiki

Rule Path
Disallow /

websitewiki

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yovadis

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /
Back to top

Warnings

  • 4 invalid lines.
Back to top