poggioantico.com
robots.txt

Robots Exclusion Standard data for poggioantico.com

Resource Scan

Scan Details

Site Domain poggioantico.com
Base Domain poggioantico.com
Scan Status Ok
Last Scan2024-09-07T03:25:14+00:00
Next Scan 2024-10-07T03:25:14+00:00

Last Scan

Scanned2024-09-07T03:25:14+00:00
URL https://poggioantico.com/robots.txt
Domain IPs 185.81.2.46
Response IP 185.81.2.46
Found Yes
Hash fee719bcad29cc452c848dd9ebe33ae6aabc7941afb1773b88bf9e22a77a81fb
SimHash 411a8844e4b3

Groups

*

Rule Path
Disallow /it/login
Disallow /en/login
Disallow /it/register
Disallow /en/register
Disallow /it/forgot-password
Disallow /en/forgot-password
Disallow /it/terms-conditions
Disallow /en/terms-conditions
Disallow /it/norme-imballaggio

aboundexbot
adressendeutschland.de
ahrefsbot
amagit.com
b2w/0.1
backdoorbot/1.0
baiduspider
black hole
blinkacrawler
botalot
bot-pge.chlooe.com
bullseye/1.0
ccbot
cityreview
coccoc
compspybot
dcpbot
disco pump 3.1
download ninja
download ninja
drupact
emailcollector
ezooms
findlinks
flightdeckreportsbot
followsite bot
fyberspider
fatbot
gurujibot
hloader
huaweisymantecspider
influencebot
integromedb
jyxobot
kenjin spider
linkaider
livedoor screenshot
metamojicrawler
mister pix
netants
netseer
nuhk
plukkie
qirina hurdler
r6 bot
radiation retriever 1.1
ronzoobot
ruky-roboter
search.kumkie.com
search17bot
sitesnagger
sosospider
spanner
suggybot
thenomad
tighttwatbot
tocrawl/urldispatcher
twiceler
url control
urlfan-bot
urly warning
vagabondo
webbandit
webbandit/3.50
webcopier
webreaper
websauger
web-sniffer
webstripper
webstripper/2.02
winwebbot
xenu link sleuth/1.3.8
xenu's
xenu's link sleuth 1.1c
yacybot
yioopbot
yodaobot
youdaobot
yowedobot
yrspider
zealbot
zeus
zeus 32297 webster pro v2.9 win32
zeus link scout
jikespider
voilabot
germcrawler
mj12bot
seznambot
zmeu
morfeus
snoopy

Rule Path
Disallow /

Comments

  • User Agent
  • End User Agent

Warnings

  • 2 invalid lines.