Log In Sign Up

businessbarometer.ie
robots.txt

Robots Exclusion Standard data for businessbarometer.ie

Resource Scan

Scan Details

Site Domain businessbarometer.ie
Base Domain businessbarometer.ie
Scan Status Ok
Last Scan2024-09-07T01:46:07+00:00
Next Scan 2024-10-07T01:46:07+00:00

Last Scan

Scanned2024-09-07T01:46:07+00:00
URL https://businessbarometer.ie/robots.txt
Redirect https://www.businessbarometer.ie/robots.txt
Redirect Domain www.businessbarometer.ie
Redirect Base businessbarometer.ie
Domain IPs 65.9.112.42, 65.9.112.43, 65.9.112.70, 65.9.112.90
Redirect IPs 65.9.112.42, 65.9.112.43, 65.9.112.70, 65.9.112.90
Response IP 18.165.122.102
Found Yes
Hash 972a4f5476eade466fb138c39aa5f112e3b5664cc4f0a242c0130b78c3f6d95a
SimHash 7013d990cf44

Groups

*

Rule Path
Disallow

dblbot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

yandex

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

aghaven.com

Rule Path
Disallow /

aghaven

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

hailoobot

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

naver

Rule Path
Disallow /

yeti

Rule Path
Disallow /

exabot

Rule Path
Disallow /

purebot

Rule Path
Disallow /

speedy

Rule Path
Disallow /

huaweisymantecspider

Rule Path
Disallow /

aspseek

Rule Path
Disallow /

asterias

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bravobrian

Rule Path
Disallow /

dloader(naverrobot)

Rule Path
Disallow /

dumbot

Rule Path
Disallow /

egotobot

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

generic

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

infonavirobot

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

larbin

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

naverrobot

Rule Path
Disallow /

nexabot

Rule Path
Disallow /

npbot

Rule Path
Disallow /

obot

Rule Path
Disallow /

owr_crawler

Rule Path
Disallow /

phpdig

Rule Path
Disallow /

psbot

Rule Path
Disallow /

puf

Rule Path
Disallow /

quepasacreep

Rule Path
Disallow /

rabaz

Rule Path
Disallow /

reaper

Rule Path
Disallow /

rpt-httpclient

Rule Path
Disallow /

scoutabout

Rule Path
Disallow /

semanticdiscovery

Rule Path
Disallow /

steeler

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

tutorgig

Rule Path
Disallow /

vsecrawler

Rule Path
Disallow /

garlikcrawler

Rule Path
Disallow /

checkprivacy.or.kr

Rule Path
Disallow /

http://www.checkprivacy.or.kr:6600/rs/privacy_enfaq.jsp

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

reportl

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

bubing

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

vebidoo

Rule Path
Disallow /

domainappender

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.businessbarometer.ie/sitemap.xml
Back to top

Warnings

  • 2 invalid lines.
Back to top