Log In Sign Up

sunshine.it
robots.txt

Robots Exclusion Standard data for sunshine.it

Resource Scan

Scan Details

Site Domain sunshine.it
Base Domain sunshine.it
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-03T15:28:06+00:00
Next Scan 2024-10-10T15:28:06+00:00

Last Successful Scan

Scanned2024-09-25T15:27:16+00:00
URL https://sunshine.it/robots.txt
Redirect https://www.sunshine.it/robots.txt
Redirect Domain www.sunshine.it
Redirect Base sunshine.it
Domain IPs 62.149.128.151, 62.149.128.154, 62.149.128.157, 62.149.128.160, 62.149.128.163, 62.149.128.166, 62.149.128.72, 62.149.128.74, 89.46.105.43
Redirect IPs 89.46.105.43
Response IP 89.46.105.43
Found Yes
Hash dcc8da3e52228879ec6a1943a6a14ec81005b6bda43379edd461f2451dbabbc3
SimHash ba3037da24a2

Groups

*

Rule Path
Disallow /wp-admin/

scrapy

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

msnbot-media/1.1

Rule Path
Disallow /

msnbot-media/2.0b

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

majesticseo

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

xovi

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

search17

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

slysearch

Rule Path
Disallow /

findlinks

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

lb-spider

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

huaweisymantecspider

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

htdig

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

linkdex.com

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

edisterbot

Rule Path
Disallow /

swebot

Rule Path
Disallow /

picmole

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yeti-mobile

Rule Path
Disallow /

pagepeeker

Rule Path
Disallow /

catchbot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

netestatenecrawler

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

comodosslchecker

Rule Path
Disallow /

comodo-certificates-spider

Rule Path
Disallow /

gonzo

Rule Path
Disallow /

schrein

Rule Path
Disallow /

afiliaswebminingtool

Rule Path
Disallow /

suggybot

Rule Path
Disallow /

bdbrandprotect

Rule Path
Disallow /

bpimagewalker

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

lex

Rule Path
Disallow /

contentcrawler

Rule Path
Disallow /

dcpbot

Rule Path
Disallow /

kaloogabot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

icjobs

Rule Path
Disallow /

obot

Rule Path
Disallow /

webmastercoffee

Rule Path
Disallow /

qualidator

Rule Path
Disallow /

webinator

Rule Path
Disallow /

scooter

Rule Path
Disallow /

thunderstone

Rule Path
Disallow /

larbin

Rule Path
Disallow /

opidoobot

Rule Path
Disallow /

ips-agent

Rule Path
Disallow /

tineye

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

unister

Rule Path
Disallow /

reverseget

Rule Path
Disallow /

dotbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.sunshine.it/sitemap_index.xml
Back to top

Comments

  • Bei Fragen zu diesen Regeln oder Aenderungswuenschen koennen sie sich an uns wenden, erreichbar unter +39 379 150 6990
Back to top

Warnings

  • 2 invalid lines.
Back to top