virgilio.it
robots.txt

Robots Exclusion Standard data for virgilio.it

Resource Scan

Scan Details

Site Domain virgilio.it
Base Domain virgilio.it
Scan Status Ok
Last Scan2024-05-11T00:35:07+00:00
Next Scan 2024-05-18T00:35:07+00:00

Last Scan

Scanned2024-05-11T00:35:07+00:00
URL https://virgilio.it/robots.txt
Redirect https://www.virgilio.it/robots.txt
Redirect Domain www.virgilio.it
Redirect Base virgilio.it
Domain IPs 213.209.17.209
Redirect IPs 13.227.74.60, 13.227.74.63, 13.227.74.71, 13.227.74.95
Response IP 65.9.112.92
Found Yes
Hash 220e34ebdfe9f0b8828c16910d6424cf1e1ffa8425e5a5c03dfe957efba9363f
SimHash 476ee528ee2b

Groups

*

Rule Path
Allow /
Disallow /italia/*/elencotelefonico/
Allow /italia/*/elencotelefonico/index.html
Disallow /italia/*/aziende/
Allow /italia/*/aziende/index.html
Disallow /italia/*/elencotelefonico?
Disallow /italia/*/ricercalocale/
Disallow /italia/*/elencotelefonico_search/
Disallow /italia/*/api/
Disallow /italia/*/helper/
Disallow /italia/*/cinema_search/search
Disallow /italia/*/eventi_search/search
Disallow /italia/*/notizie_search/search
Disallow /italia/*/ricercalocale/search
Disallow /italia/*/ricercalocale/searchbu
Disallow /italia/*/scontipromozioni_search/search
Disallow /italia/*/5180/virgilio_citta/
Disallow /italia/*/foto/
Disallow /italia/*/fotolocal/
Disallow /italia/*/fotogallery/
Disallow /italia/*/cms/
Disallow /italia/*/rest/
Disallow /italia/*/promosms/
Disallow /italia/*/tag_adv/
Disallow /italia/*/palinsesti/
Disallow /italia/*/azienda/
Disallow /italia/*/smappares/
Disallow /italia/*/smappa2/
Disallow /italia/*/archivi/
Disallow /italia/*/mobile/
Disallow /video/api/
Disallow /video/cerca-video/
Disallow /motori/cerca/*
Disallow /motori/listino/ricerca/?*
Disallow /motori/wp-admin/
Allow /motori/wp-admin/admin-ajax.php
Disallow /motori/wp-login.php
Disallow /motori/wp-signup.php
Disallow /motori/remote-login.php
Disallow /motori/search/*
Disallow /motori/*?s=*

dotbot
dotbot/1.0
baiduspider
megaindex.ru
ahrefsbot
grapeshot
acunetix
awariorssbot
awariosmartbot
bomborabot
bubing

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.virgilio.it/video/sitemap/sitemap.xml
sitemap https://www.virgilio.it/video/sitemap/sitemap_news.xml
sitemap https://www.virgilio.it/motori/sitemap.xml
sitemap https://www.virgilio.it/motori/news-sitemap.xml