Log In Sign Up

analisi-periodo.it
robots.txt

Robots Exclusion Standard data for analisi-periodo.it

Resource Scan

Scan Details

Site Domain analisi-periodo.it
Base Domain analisi-periodo.it
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-21T02:56:12+00:00
Next Scan 2024-10-05T02:56:12+00:00

Last Successful Scan

Scanned2024-09-05T03:04:37+00:00
URL https://analisi-periodo.it/robots.txt
Domain IPs 77.81.225.78
Response IP 77.81.225.78
Found Yes
Hash 31693c9aead4879de33fa668779198bb42b788cb2465428a9be5312f45dbb5e0
SimHash e4d0799db7dc

Groups

*

Rule Path
Disallow /_ads/*
Disallow /_comuni/*
Disallow /_facebook/*
Disallow /_font/*
Disallow /_funzioni/*
Disallow /_google/*
Disallow /_javas/*
Disallow /_jsonld/*
Disallow /_mailer/*
Disallow /_pagina/*
Disallow /_twitter/*
Disallow /_utilita/*
Disallow /*.php
Disallow /*.sql
Disallow /*.csv
Disallow /*.jsonld
Disallow /*.xml

sitecheck.internetseer.com

Rule Path
Disallow /

zeabot

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

httrack

Rule Path
Disallow /

xenu

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

kspider

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

nimblecrawler

Rule Path
Disallow /

usyd-nlp-spider

Rule Path
Disallow /

shim-crawler

Rule Path
Disallow /

myengines-bot

Rule Path
Disallow /

kfsw-bot

Rule Path
Disallow /

sbider

Rule Path
Disallow /

localcombot

Rule Path
Disallow /

iccrawler

Rule Path
Disallow /

knowitall

Rule Path
Disallow /

dcbspider

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

cfetch

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

gonzo
gonzo
gonzop
gonzop

Rule Path
Disallow /

moni

Rule Path
Disallow /

georgios

Rule Path
Disallow /

cydralspider

Rule Path
Disallow /

objectssearch

Rule Path
Disallow /

hoowwwer

Rule Path
Disallow /

jemmathetourist

Rule Path
Disallow /

btbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

irlbot

Rule Path
Disallow /

becomebot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

amfibibot

Rule Path
Disallow /

gridbot

Rule Path
Disallow /

sna

Rule Path
Disallow /

tamu_cs_irl_crawler

Rule Path
Disallow /

npt

Rule Path
Disallow /

bruinbot

Rule Path
Disallow /

zipppbot

Rule Path
Disallow /

molbsy

Rule Path
Disallow /

phpdig

Rule Path
Disallow /

goforit.com

Rule Path
Disallow /

goforit

Rule Path
Disallow /

larbin

Rule Path
Disallow /

appie

Rule Path
Disallow /

libwww

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

sohu-search

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

webzip

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

linko

Rule Path
Disallow /

rpt-httpclient

Rule Path
Disallow /

dumbot

Rule Path
Disallow /

cowbot

Rule Path
Disallow /

superget

Rule Path
Disallow /

psbot

Rule Path
Disallow /

szukacz

Rule Path
Disallow /

antibot

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

jetbot

Rule Path
Disallow /

iconsurf

Rule Path
Disallow /

speedy

Rule Path
Disallow /

npbot

Rule Path
Disallow /

tutorgig

Rule Path
Disallow /

searchspider

Rule Path
Disallow /

lachesis

Rule Path
Disallow /

quepasacreep

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

haste

Rule Path
Disallow /

netresearchserver

Rule Path
Disallow /

nutch

Rule Path
Disallow /

nutchorg

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

steeler

Rule Path
Disallow /

ultraseek

Rule Path
Disallow /

spinne

Rule Path
Disallow /

spider_monkey

Rule Path
Disallow /

ixe crawler

Rule Path
Disallow /

coolbot

Rule Path
Disallow /

vse/.

Rule Path
Disallow /
Back to top

Comments

  • Sitemap: http://www.analisi-grammaticale.biz/sitemap_analisi-periodo_ns_amp.xml
  • Some bots are known to be trouble, particularly those designed to copy
  • entire sites. Please obey robots.txt.
Back to top

Warnings

  • 2 invalid lines.
Back to top