unilibro.it
robots.txt

Robots Exclusion Standard data for unilibro.it

Resource Scan

Scan Details

Site Domain unilibro.it
Base Domain unilibro.it
Scan Status Ok
Last Scan2024-09-03T10:29:33+00:00
Next Scan 2024-10-03T10:29:33+00:00

Last Scan

Scanned2024-09-03T10:29:33+00:00
URL https://unilibro.it/robots.txt
Redirect https://www.unilibro.it/robots.txt
Redirect Domain www.unilibro.it
Redirect Base unilibro.it
Domain IPs 107.154.148.2, 107.154.238.2
Redirect IPs 107.154.150.2
Response IP 107.154.150.2
Found Yes
Hash 7fb04bcfa579e2197d8a6dffdb960a693c2f174ebcf03b0e92fd97c879c7fdb3
SimHash 7ecf4464ec51

Groups

etaospider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

java1.3.1_06

Rule Path
Disallow /

java/1.4.2_02

Rule Path
Disallow /

java/1.4.1_01

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

teleport

Rule Path
Disallow /

xenu link

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

wget

Rule Path
Disallow /

netmechanic

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

*

Rule Path
Disallow /find_buy/visualizza_copertina.asp

*

Rule Path
Disallow /find_buy/vcDVD.asp

*

Rule Path
Disallow /find_buy/View_Image_terminal.asp

*

Rule Path
Disallow /find_buy/view_scritturaG.asp

*

Rule Path
Disallow /find_buy/view_scrittura.asp

*

Rule Path
Disallow /Find_Buy/IframeCarrello/Carrello.asp

*

Rule Path
Disallow /Find_Buy/input_to_Pozzo.asp

*

Rule Path
Disallow /Find_Buy/input_to_carrello.asp

*

Rule Path
Disallow /Find_Buy/visual_CopGame.asp

*

Rule Path
Disallow /find_buy/vcp.asp

*

Rule Path
Disallow /Find_Buy/vcm.asp

*

Rule Path
Disallow /Find_Buy/vcg.asp

*

Rule Path
Disallow /Find_Buy/vcg_zoom.asp

*

Rule Path
Disallow /Find_Buy/input_to_carrello_PD.asp

*

Rule Path
Disallow /Find_Buy/input_to_Carrello_multiplo.asp

*

Rule Path
Disallow /Find_Buy/input_to_Carrello_PD_multiplo.asp

*

Rule Path
Disallow /find_buy/tua_recensione.asp

*

Rule Path
Disallow /find_buy/tuo_commento.asp

*

Rule Path
Disallow /find_buy/consiglia_amico.asp

*

Rule Path
Disallow /manager/

*

Rule Path
Disallow /AggirnamentiDBs/

*

Rule Path
Disallow /Config/

*

Rule Path
Disallow /include/*.asp

*

Rule Path
Disallow /newsletter/

*

Rule Path
Disallow /fornitori/

*

Rule Path
Disallow /testcc.asp

*

Rule Path
Disallow /html5/

*

Rule Path
Disallow /libro/AsyncWidgets/RelatedEbooks

*

Rule Path
Disallow /book/AsyncWidgets/RelatedProductsNew

*

Rule Path
Disallow /ssl/

*

Rule Path
Disallow /SSL/

adsbot-google

Rule Path
Disallow /ssl/

*

Rule Path
Disallow /MyUnilibro/

*

Rule Path
Disallow /home/member/orders

*

Rule Path
Disallow /home/member/shipments

*

Rule Path
Disallow /home/member/MyUnilibro

*

Rule Path
Disallow /home/member/addreview

Other Records

Field Value
sitemap https://www.unilibro.it/sitemap-https.xml