capodannoromaofferte.it robots.txt

*

Rule	Path
Disallow	/wp-login.php
Disallow	/wp-admin/
Disallow	/trackback/
Disallow	/xmlrpc.php
Disallow	/feed/

Rule

Path

Disallow

/wp-login.php

Disallow

/wp-admin/

Disallow

/trackback/

Disallow

/xmlrpc.php

Disallow

/feed/

scoutjet

Rule	Path
Disallow	/

Rule

Path

Disallow

/

abonti

Rule	Path
Disallow	/

Rule

Path

Disallow

/

abonti/0.92

Rule	Path
Disallow	/

Rule

Path

Disallow

/

aboutthedomain

Rule	Path
Disallow	/

Rule

Path

Disallow

/

add catalog

Rule	Path
Disallow	/

Rule

Path

Disallow

/

add catalog/2.1

Rule	Path
Disallow	/

Rule

Path

Disallow

/

advbot

Rule	Path
Disallow	/

Rule

Path

Disallow

/

advbot/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

/

affectv robot v1.0/nutch-1.6

Rule	Path
Disallow	/

Rule

Path

Disallow

/

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

/

aitellu

Rule	Path
Disallow	/

Rule

Path

Disallow

/

apache-httpclient/4.1.1 (java 1.5)

Rule	Path
Disallow	/

Rule

Path

Disallow

/

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

/

baidu spider

Rule	Path
Disallow	/

Rule

Path

Disallow

/

battleztar bazinga

Rule	Path
Disallow	/

Rule

Path

Disallow

/

battleztar bazinga/0.01

Rule	Path
Disallow	/

Rule

Path

Disallow

/

betabot

Rule	Path
Disallow	/

Rule

Path

Disallow

/

blackboard safeassign

Rule	Path
Disallow	/

Rule

Path

Disallow

/

blazer 1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

/

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

/

blexbot/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

/

blp_bbot

Rule	Path
Disallow	/

Rule

Path

Disallow

/

blp_bbot/0.1

Rule	Path
Disallow	/

Rule

Path

Disallow

/

boia-accessibility-agent

Rule	Path
Disallow	/

Rule

Path

Disallow

/

boia-accessibility-agent/pr 1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

/

bot for jce

Rule	Path
Disallow	/

Rule

Path

Disallow

/

bot/0.1 (bot for jce)

Rule	Path
Disallow	/

Rule

Path

Disallow

/

bubing

Rule	Path
Disallow	/

Rule

Path

Disallow

/

ca-crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

/

ca-crawler/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

/

cakephp

Rule	Path
Disallow	/

Rule

Path

Disallow

/

camelhttpstream/1.0 evolution/3.2.2

Rule	Path
Disallow	/

Rule

Path

Disallow

/

cb/nutch-1.7

Rule	Path
Disallow	/

Rule

Path

Disallow

/

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

/

ccbot/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

/

cliqzbot

Rule	Path
Disallow	/

Rule

Path

Disallow

/

cliqzbot/0.1

Rule	Path
Disallow	/

Rule

Path

Disallow

/

cms crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

/

coccoc

Rule	Path
Disallow	/

Rule

Path

Disallow

/

copyscape

Rule	Path
Disallow	/

Rule

Path

Disallow

/

crawler4j

Rule	Path
Disallow	/

Rule

Path

Disallow

/

crazywebcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

/

crazywebcrawler-spider

Rule	Path
Disallow	/

Rule

Path

Disallow

/

curl/7.15.3

Rule	Path
Disallow	/

Rule

Path

Disallow

/

curl/7.26.0

Rule	Path
Disallow	/

Rule

Path

Disallow

/

curl/7.32.0

Rule	Path
Disallow	/

Rule

Path

Disallow

/

curl/7.37.0

Rule	Path
Disallow	/

Rule

Path

Disallow

/

curl/php 5.3.29

Rule

Path

Disallow

/

cuwhois

Rule

Path

Disallow

/

cuwhois/1.0

Rule

Path

Disallow

/

dispatch/0.11.0

Rule

Path

Disallow

/

domainappender

Rule

Path

Disallow

/

domainappender /1.0

Rule

Path

Disallow

/

domainsigmacrawler

Rule

Path

Disallow

/

domainsigmacrawler/0.1

Rule

Path

Disallow

/

dotbot

Rule

Path

Disallow

/

ecommercebot

Rule

Path

Disallow

/

episerver link checker

Rule

Path

Disallow

/

euripbot

Rule

Path

Disallow

/

euripbot/2.0

Rule

Path

Disallow

/

exabot

Rule

Path

Disallow

/

findxbot

Rule

Path

Disallow

/

findxbot/1.0

Rule

Path

Disallow

/

flamingo_searchengine

Rule

Path

Disallow

/

flipboard robot

Rule

Path

Disallow

/

getrequest

Rule

Path

Disallow

/

getrequest/1.0

Rule

Path

Disallow

/

gigablastopensource

Rule

Path

Disallow

/

gigablastopensource/1.0

Rule

Path

Disallow

/

gluten free crawler

Rule

Path

Disallow

/

gluten free crawler/1.0

Rule

Path

Disallow

/

go 1.1 package http

Rule

Path

Disallow

/

haiula

Rule

Path

Disallow

/

haiula/1.4

Rule

Path

Disallow

/

haosouspider

Rule

Path

Disallow

/

heritrix

Rule

Path

Disallow

/

heritrix/1.14.4

Rule

Path

Disallow

/

heritrix/3.1.1

Rule

Path

Disallow

/

hivemind

Rule

Path

Disallow

/

http://git.io/tl_s2w

Rule

Path

Disallow

/

httpunit/1.x

Rule

Path

Disallow

/

hubspot links crawler 1.0

Rule

Path

Disallow

/

hypercrawl

Rule

Path

Disallow

/

hypercrawl/0.2

Rule

Path

Disallow

/

ichiro robot

Rule

Path

Disallow

/

image.coccoc/1.0

Rule

Path

Disallow

/

indy library

Rule

Path

Disallow

/

integrity/5

Rule

Path

Disallow

/

internaetboten

Rule

Path

Disallow

/

internaetboten/0.99

Rule

Path

Disallow

/

jakarta

Rule

Path

Disallow

/

jakarta commons

Rule

Path

Disallow

/

jakarta commons-httpclient

Rule

Path

Disallow

/

jakarta commons-httpclient/3.0.1

Rule

Path

Disallow

/

jakarta commons-httpclient/3.0-rcx

Rule

Path

Disallow

/

jakarta commons-httpclient/3.1

Rule

Path

Disallow

/

jamesbot

Rule

Path

Disallow

/

james bot

Rule

Path

Disallow

/

java/1.4.1_04

Rule

Path

Disallow

/

java/1.6.0_04

Rule

Path

Disallow

/

java/1.6.0_10-rc2

Rule

Path

Disallow

/

java/1.6.0_15

Rule

Path

Disallow

/

java/1.6.0_24

Rule

Path

Disallow

/

java/1.6.0_26

Rule

Path

Disallow

/

java/1.6.0_32

Rule

Path

Disallow

/

java/1.7.0_09

Rule

Path

Disallow

/

java/1.7.0_45

Rule

Path

Disallow

/

java/1.7.0_55

Rule

Path

Disallow

/

java/1.7.0_60

Rule

Path

Disallow

/

java/1.7.0_60-ea

Rule

Path

Disallow

/

java/1.7.0_65

Rule

Path

Disallow

/

java/1.7.0_67

Rule

Path

Disallow

/

java/1.7.0_71

Rule

Path

Disallow

/

java/1.8.0_20

Rule

Path

Disallow

/

java/1.8.0_25

Rule

Path

Disallow

/

java/1.8.0_31

Rule

Path

Disallow

/

jetbrains

Rule

Path

Disallow

/

jetbrains 5.0

Rule

Path

Disallow

/

kraken

Rule

Path

Disallow

/

kraken/0.1

Rule

Path

Disallow

/

kraken/nutch-2.2.1

Rule

Path

Disallow

/

larbin

Rule

Path

Disallow

/

libcurl

Rule

Path

Disallow

/

libcurl/7.15.3

Rule

Path

Disallow

/

libcurl/7.19.7

Rule

Path

Disallow

/

libcurl/7.21.0

Rule

Path

Disallow

/

libreoffice

Rule

Path

Disallow

/

link/1.0

Rule

Path

Disallow

/

linkdex

Rule

Path

Disallow

/

linkdexbot

Rule

Path

Disallow

/

linkdexbot/2.0

Rule

Path

Disallow

/

linkdexbot/2.1

Rule

Path

Disallow

/

linkdex.com/v2.0

Rule

Path

Disallow

/

linkdex.com/v2.1

Rule

Path

Disallow

/

linkdexbot-mobile/2.1

Rule

Path

Disallow

/

linkpadbot

Rule

Path

Disallow

/

linkpadbot/1.06

Rule

Path

Disallow

/

lipperhey

Rule

Path

Disallow

/

lipperhey seo service

Rule

Path

Disallow

/

lipperhey-kaus-australis

Rule

Path

Disallow

/

lipperhey-kaus-australis/5.0

Rule

Path

Disallow

/

listicka

Rule

Path

Disallow

/

lssrocketcrawler

Rule

Path

Disallow

/

lssrocketcrawler/1.0

Rule

Path

Disallow

/

lssrocketcrawler/1.0 lightspeedsystems

Rule

Path

Disallow

/

ltx71

Rule

Path

Disallow

/

lwnutch/nutch-1.4

Rule

Path

Disallow

/

magpie-crawler

Rule

Path

Disallow

/

mail.ru

Rule

Path

Disallow

/

mail.ru_bot

Rule

Path

Disallow

/

mail.ru_bot/2.0

Rule

Path

Disallow

/

mail.ru_bot/fast/2.0

Rule

Path

Disallow

/

maxpointcrawler

Rule

Path

Disallow

/

maxpointcrawler/nutch-1.1

Rule

Path

Disallow

/

md5sum

Rule

Path

Disallow

/

md5sum\x22

Rule

Path

Disallow

/

meanpathbot

Rule

Path

Disallow

/

megaindex.ru

Rule

Path

Disallow

/

megaindex.ru/2.0

Rule

Path

Disallow

/

mozilla/5.0 (compatible; megaindex.ru/2.0; +https://www.megaindex.ru/?tab=linkanalyze)

Rule

Path

Disallow

/

mozilla/5.0 (compatible; mj12bot/v1.4.5; http://www.majestic12.co.uk/bot.php?+)

Rule

Path

Disallow

/

mj12

Rule

Path

Disallow

/

mj12bot

Rule

Path

Disallow

/

mj12bot/v1.4.0

Rule

Path

Disallow

/

mj12bot/v1.2.4

Rule

Path

Disallow

/

mj12bot/v1.2.3

Rule

Path

Disallow

/

mj12bot/v1.0.8

Rule

Path

Disallow

/

mj12bot/v1.0.7

Rule

Path

Disallow

/

mj12bot/v1.0.6

Rule

Path

Disallow

/

mj12bot/v1.0.5

Rule

Path

Disallow

/

mj12bot/v1.4.5

Rule

Path

Disallow

/

mixbot

Rule

Path

Disallow

/

my nutch spider/nutch-1.9

Rule

Path

Disallow

/

nutch

Rule

Path

Disallow

/

my nutch spider/nutch-1.9

Rule

Path

Disallow

/

sky nutch crawler/nutch-1.9

Rule

Path

Disallow

/

tbot-nutch/nutch-1.10

Rule

Path

Disallow

/

lwnutch/nutch-1.4

Rule

Path

Disallow

/

nerdybot

Rule

Path

Disallow

/

netseer

Rule

Path

Disallow

/

ning/1.0

Rule

Path

Disallow

/

node.io

Rule

Path

Disallow

/

node.js

Rule

Path

Disallow

/

obot/2.3.1

Rule

Path

Disallow

/

omgilibot

Rule

Path

Disallow

/

omgilibot/0.4

Rule

Path

Disallow

/

openstat

Rule

Path

Disallow

/

openstat/0.1

Rule

Path

Disallow

/

optimizationcrawler

Rule

Path

Disallow

/

optimizationcrawler/0.2

Rule

Path

Disallow

/

pageanalyzer

Rule

Path

Disallow

/

pageanalyzer/1.1

Rule

Path

Disallow

/

pagesinventory

Rule

Path

Disallow

/

pagespeedbot

Rule

Path

Disallow

/

pagespeed/1.1

Rule

Path

Disallow

/

pagespeed/1.1 fetcher

Rule

Path

Disallow

/

pathdefender

Rule

Path

Disallow

/

pathdefender/1.0

Rule

Path

Disallow

/

perl lwp

Rule

Path

Disallow

/

plukkie

Rule

Path

Disallow

/

plukkie/1.5

Rule

Path

Disallow

/

pogs/2.0

Rule

Path

Disallow

/

privacy_enfaq.jsp

Rule

Path

Disallow

/

prlog

Rule

Path

Disallow

/

prlog/1.0

Rule

Path

Disallow

/

psbot

Rule

Path

Disallow

/

publiclibraryarchive.org

Rule

Path

Disallow

/

publiclibraryarchive.org/1.0

Rule

Path

Disallow

/

pycurl

Rule

Path

Disallow

/

python-urllib

Rule

Path

Disallow

/

python-urllib/1.17

Rule

Path

Disallow

/

python-urllib/2.5

Rule

Path

Disallow

/

python-urllib/2.6

Rule

Path

Disallow

/

python-urllib/2.7

Rule

Path

Disallow

/

r6_feedfetcher

Rule

Path

Disallow

/

r6_commentreader

Rule

Path

Disallow

/

riddler

Rule

Path

Disallow

/

rogerbot

Rule

Path

Disallow

/

rogerbot/1.0

Rule

Path

Disallow

/

rome client

Rule

Path

Disallow

/

rootlink

Rule

Path

Disallow

/

ru_bot/2.0

Rule

Path

Disallow

/

ruby

Rule

Path

Disallow

/

scrapy/0.24.4

Rule

Path

Disallow

/

semrushbot

Rule

Path

Disallow

/

semrushbot-sa

Rule

Path

Disallow

/

seznambot

Rule

Path

Disallow

/

showyoubot

Rule

Path

Disallow

/

sheerboredom.experimental.robot

Rule

Path

Disallow

/

sheerboredom.experimental.robot/0.2

Rule

Path

Disallow

/

sistrix

Rule

Path

Disallow

/

sistrix crawler

Rule

Path

Disallow

/

siteexplorer

Rule

Path

Disallow

/

siteexplorer/1.0b

Rule

Path

Disallow

/

skimbot

Rule

Path

Disallow

/

skimbot/1.0

Rule

Path

Disallow

/

smtbot

Rule

Path

Disallow

/

smtbot/1.0

Rule

Path

Disallow

/

sogou pic spider

Rule

Path

Disallow

/

sogou pic spider/3.0

Rule

Path

Disallow

/

sogou spider

Rule

Path

Disallow

/

sogou web spider

Rule

Path

Disallow

/

spbot

Rule

Path

Disallow

/

spbot/4.4.2

Rule

Path

Disallow

/

spiderbot/nutch-1.7

Rule

Path

Disallow

/

seoscanners

Rule

Path

Disallow

/

steeler

Rule

Path

Disallow

/

steeler/3.5

Rule

Path

Disallow

/

studiofaca

Rule

Path

Disallow

/

studiofaca search

Rule

Path

Disallow

/

sukibot

Rule

Path

Disallow

/

sukibot_heritrix

Rule

Path

Disallow

/

sukibot_heritrix/3.1.1

Rule

Path

Disallow

/

surveybot

Rule

Path

Disallow

/

stratagems kumo

Rule

Path

Disallow

/

stratagems

Rule

Path

Disallow

/

synthesio crawler release monalisa

Rule

Path

Disallow

/

trendictionbot

Rule

Path

Disallow

/

truebot

Rule

Path

Disallow

/

truebot/1.0

Rule

Path

Disallow

/

typhoeus

Rule

Path

Disallow

/

uipbot/1.0

Rule

Path

Disallow

/

umbot-ln

Rule

Path

Disallow

/

umbot-ln/1.0

Rule

Path

Disallow

/

updown_tester

Rule

Path

Disallow

/

urlchecker

Rule

Path

Disallow

/

webcookies

Rule

Path

Disallow

/

webcookies/1.0

Rule

Path

Disallow

/

webcopier vx.xa

Rule

Path

Disallow

/

web corpus crawler

Rule

Path

Disallow

/

web-sniffer

Rule

Path

Disallow

/

web-sniffer/1.1.0

Rule

Path

Disallow

/

wegtam

Rule

Path

Disallow

/

wegtam crawler

Rule

Path

Disallow

/

whatweb

Rule

Path

Disallow

/

whatweb/0.4.8-dev

Rule

Path

Disallow

/

worldbrewbot

Rule

Path

Disallow

/

worldbrewbot/2.1

Rule

Path

Disallow

/

worldwebheritage.org

Rule

Path

Disallow

/

worldwebheritage.org/1.0

Rule

Path

Disallow

/

www.deadlinkchecker.com

Rule

Path

Disallow

/

v1.0/1.2

Rule

Path

Disallow

/

vbseo

Rule

Path

Disallow

/

vericitecrawler

Rule

Path

Disallow

/

vericitecrawler/nutch-1.9

Rule

Path

Disallow

/

voila robot

Rule

Path

Disallow

/

voltron

Rule

Path

Disallow

/

vorboss web crawler

Rule

Path

Disallow

/

vorboss web crawler/nutch-2.3

Rule

Path

Disallow

/

xovibot

Rule

Path

Disallow

/

xovibot/2.0

Rule

Path

Disallow

/

yandex

Rule

Path

Disallow

/

yandex robot

Rule

Path

Disallow

/

yetibot

Rule

Path

Disallow

/

yisouspider

Rule

Path

Disallow

/

zzabmbot

Rule

Path

Disallow

/

zzabmbot/1.0

Rule

Path

Disallow

/

snk

Rule

Path

Disallow

/

Site Domain	capodannoromaofferte.it
Base Domain	capodannoromaofferte.it
Scan Status	Ok
Last Scan	2024-11-13T00:57:22+00:00
Next Scan	2024-11-20T00:57:22+00:00

Scanned	2024-11-13T00:57:22+00:00
URL	https://capodannoromaofferte.it/robots.txt
Redirect	https://www.capodannoromaofferte.it/robots.txt
Redirect Domain	www.capodannoromaofferte.it
Redirect Base	capodannoromaofferte.it
Domain IPs	89.46.107.239
Redirect IPs	89.46.107.239
Response IP	89.46.107.239
Found	Yes
Hash	656f6910596ba6e927f665dedc33b499b7f99fc771b6f83be211e8537abd736c
SimHash	51d1e346ee31

capodannoromaofferte.itrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

scoutjet

abonti

abonti/0.92

aboutthedomain

add catalog

add catalog/2.1

advbot

advbot/2.0

affectv robot v1.0/nutch-1.6

ahrefsbot

aitellu

apache-httpclient/4.1.1 (java 1.5)

baiduspider

baidu spider

battleztar bazinga

battleztar bazinga/0.01

betabot

blackboard safeassign

blazer 1.0

blexbot

blexbot/1.0

blp_bbot

blp_bbot/0.1

boia-accessibility-agent

boia-accessibility-agent/pr 1.0

bot for jce

bot/0.1 (bot for jce)

bubing

ca-crawler

ca-crawler/1.0

cakephp

camelhttpstream/1.0 evolution/3.2.2

cb/nutch-1.7

ccbot

ccbot/2.0

cliqzbot

cliqzbot/0.1

cms crawler

coccoc

copyscape

crawler4j

crazywebcrawler

crazywebcrawler-spider

curl/7.15.3

curl/7.26.0

curl/7.32.0

curl/7.37.0

curl/php 5.3.29

cuwhois

cuwhois/1.0

dispatch/0.11.0

domainappender

domainappender /1.0

domainsigmacrawler

domainsigmacrawler/0.1

dotbot

ecommercebot

episerver link checker

euripbot

euripbot/2.0

exabot

findxbot

findxbot/1.0

flamingo_searchengine

flipboard robot

getrequest

getrequest/1.0

gigablastopensource

gigablastopensource/1.0

gluten free crawler

gluten free crawler/1.0

go 1.1 package http

haiula

haiula/1.4

capodannoromaofferte.it
robots.txt