minervamedica.it
robots.txt

Robots Exclusion Standard data for minervamedica.it

Resource Scan

Scan Details

Site Domain minervamedica.it
Base Domain minervamedica.it
Scan Status Ok
Last Scan2024-09-09T04:08:58+00:00
Next Scan 2024-10-09T04:08:58+00:00

Last Scan

Scanned2024-09-09T04:08:58+00:00
URL https://www.minervamedica.it/robots.txt
Domain IPs 94.125.232.221
Response IP 94.125.232.221
Found Yes
Hash cb22d307b54ea332a7bd8225a3a9a1044172853ed34853c19f5b17318dc9b5ba
SimHash 6a15d8504e90

Groups

*

Rule Path
Disallow /alert.php
Disallow /*/alert.php
Disallow /*/getpdf/*
Disallow /*/getfreepdf/*
Disallow /*/getpdf.php
Disallow /*/getfreepdf.php
Disallow /*/download.php
Disallow /*/freedownload.php
Disallow /*/admin/*
Disallow /*/phpMyAdmin/*
Disallow /*/contact/*
Disallow /*/contacts/*
Disallow /*/admin/*
Disallow /*/myadmin/*
Disallow /*/phpmyadmin/*
Disallow /*/config/*
Disallow /*/include/*
Disallow /*/bin/*
Disallow /*/scripts/*
Disallow /*/etc/*
Disallow /*/reserved
Disallow /*/admin
Disallow /*/phpMyAdmin
Disallow /getpdf/
Disallow /getfreepdf/
Disallow /contact/
Disallow /contacts/
Disallow /reserved/
Disallow /admin/
Disallow /phpMyAdmin/
Disallow /admin/
Disallow /myadmin/
Disallow /phpmyadmin/
Disallow /config/
Disallow /include/
Disallow /bin/
Disallow /scripts/
Disallow /etc/
Disallow /cover-flow/
Disallow /pdf/
Disallow /redirect.php
Disallow /*/redirect.php
Disallow /preview.php
Disallow /*/preview.php
Allow /

Other Records

Field Value
crawl-delay 15

dotbot

Rule Path
Disallow /

hotpage.fr

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

daumoa

Rule Path
Disallow /

spbot

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

flipboard

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

yandex

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

speedy

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

plumanalytics

Rule Path
Disallow /

com.plumanalytics

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

siteimprovebot

Rule Path
Disallow /

siteimprovebot-crawler

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

academicbotrtu

Rule Path
Disallow /

semanticscholarbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

docoloc

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.minervamedica.it/sitemap.xml.gz
sitemap http://www.minervamedica.it/sitemap_it.xml.gz

Warnings

  • 2 invalid lines.