libero.it
robots.txt

Robots Exclusion Standard data for libero.it

Resource Scan

Scan Details

Site Domain libero.it
Base Domain libero.it
Scan Status Ok
Last Scan2024-04-30T18:56:14+00:00
Next Scan 2024-05-07T18:56:14+00:00

Last Scan

Scanned2024-04-30T18:56:14+00:00
URL https://libero.it/robots.txt
Redirect https://www.libero.it/robots.txt
Redirect Domain www.libero.it
Redirect Base libero.it
Domain IPs 213.209.17.209
Redirect IPs 18.164.174.100, 18.164.174.106, 18.164.174.12, 18.164.174.29
Response IP 18.165.171.54
Found Yes
Hash 93d5de0f6c9890f204fa570839d016dbc8e803d6071ab058fb915f37bf3dd886
SimHash b2dd31e08f43

Groups

*

Rule Path
Disallow /temicaldi.php?*
Disallow /magazine/guida-tv/*?
Disallow /magazine/*ricerca/*
Allow /annunci/*.js
Allow /annunci/*.css
Allow /annunci/*.jpg
Allow /annunci/*?browse=
Disallow /annunci/*itemindex*
Disallow /annunci/SaveAd/
Disallow /annunci/confirm-search/
Disallow /annunci/get-filter-results/
Disallow /annunci/get-top-box-results/
Disallow /annunci/login-saved-searches/
Disallow /annunci/manage-saved-searches/
Disallow /annunci/recover-password/
Disallow /annunci/register-saved-searches/
Disallow /annunci/SavedSearch/
Disallow /annunci/ss-logout/
Disallow /annunci/Subscriptions/
Disallow /annunci/update-frequency/
Disallow /annunci/update-password/
Disallow /annunci/Account/
Disallow /annunci/SingleAdPage/
Disallow /annunci/SingleAdPage/Home/
Disallow /annunci/SingleAdPage/Product/
Disallow /annunci/SingleAdPage/Similar/
Disallow /annunci/*ajax.svc*
Disallow /annunci/*_nif
Disallow /annunci/admanagement/*
Disallow /annunci/controls/*
Disallow /annunci/Controls/*
Disallow /annunci/data/*
Disallow /annunci/external-login/
Disallow /annunci/ExternalApi/
Disallow /annunci/get-results/*
Disallow /annunci/JsonProvider/Components
Disallow /annunci/mobile/search/
Disallow /annunci/Report/
Disallow /annunci/Rss/
Disallow /annunci/set-admin-cookie/
Disallow /annunci/SitemapHandler/
Disallow /annunci/PartnerIntegration/
Disallow /annunci/XmlProvider/
Disallow /annunci/api/
Disallow /annunci/*.aspx
Disallow /annunci/Reviews/
Disallow /annunci/serp/

ahrefsbot

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

blexbot

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

bloglines/3.1

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

cityreview

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

doc

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

dotbot

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

download ninja

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

exabot

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

fetch

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

grapeshot

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

grub-client

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

httrack

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

jyxobot/1

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

k2spider

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

larbin

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

libwww

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

linko

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

microsoft.url.control

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

msiecrawler

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

npbot

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

offline explorer

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

petalbot

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

proximic

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

psbot

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

semrushbot

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

sitecheck.internetseer.com

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

sitesnagger

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

speedy

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

teleport

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

teleportpro

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

ubicrawler

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

webcopier

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

webreaper

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

webstripper

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

webzip

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

wget

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

xenu

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

zao

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

zealbot

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

zyborg

Rule Path
Disallow /annunci/
Disallow /magazine/
Disallow /tv/

Other Records

Field Value
sitemap https://www.libero.it/magazine/sitemap/sitemap_magazine.xml
sitemap https://www.libero.it/tv/sitemap/sitemap.xml