prezzifarmaco.it
robots.txt

Robots Exclusion Standard data for prezzifarmaco.it

Resource Scan

Scan Details

Site Domain prezzifarmaco.it
Base Domain prezzifarmaco.it
Scan Status Ok
Last Scan2024-09-30T09:24:33+00:00
Next Scan 2024-10-07T09:24:33+00:00

Last Scan

Scanned2024-09-30T09:24:33+00:00
URL https://prezzifarmaco.it/robots.txt
Redirect https://www.prezzifarmaco.it/assets/robots.txt
Redirect Domain www.prezzifarmaco.it
Redirect Base prezzifarmaco.it
Domain IPs 104.21.12.6, 172.67.131.216, 2606:4700:3035::6815:c06, 2606:4700:3036::ac43:83d8
Redirect IPs 104.21.12.6, 172.67.131.216, 2606:4700:3035::6815:c06, 2606:4700:3036::ac43:83d8
Response IP 104.21.12.6
Found Yes
Hash 145f64aec6bbe69dfd70a9957d3e3ca9215d5a3d957c451c225fd6a6976f2c43
SimHash c258285b8f64

Groups

*

Rule Path
Disallow /admin/
Disallow /jumpto/
Disallow /tieni-d-occhio/
Disallow /ajax/cart/*
Disallow /ajax/ntfy/*
Disallow /ajax/minist*
Disallow /ajax/getShopOffer*
Disallow /ajax/offerts*
Disallow /ajax/*
Disallow /profilo
Disallow /carrello
Disallow /api/lists
Disallow /cerca/
Disallow /cerca/?q=*
Disallow /cerca/?q=apoquel*
Disallow /cerca?q=apoquel%2B16%2Bmg
Disallow /blog/*?embed=true
Disallow /blog/*/*/feed/
Disallow /captcha

geedoproductsearch

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

adsrvrbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

hypefactors

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.prezzifarmaco.it/sitemap.xml

Comments

  • disable MauiBot (crawler.feedback+wc@gmail.com)
  • disable http://law.di.unimi.it/BUbiNG.html
  • http://www.majestic12.co.uk/projects/dsearch/mj12bot.php
  • Backlink Analysis
  • https://megaindex.com/crawler
  • https://www.qwant.com/
  • http://cliqz.com/company/cliqzbot
  • http://openlinkprofiler.org/bot