planet360.info
robots.txt

Robots Exclusion Standard data for planet360.info

Archived Snapshots

Resource Scan

Scan Details

Site Domain	planet360.info
Base Domain	planet360.info
Scan Status	Ok
Last Scan	2024-09-23T07:16:58+00:00
Next Scan	2024-10-23T07:16:58+00:00

Last Scan

Scanned	2024-09-23T07:16:58+00:00
URL	https://www.planet360.info/robots.txt
Domain IPs	89.46.105.23
Response IP	89.46.105.23
Found	Yes
Hash	efdb621fa3e115592eb40f83d6bedbd8caae2520f710a7a0d20f336b49e37fb8
SimHash	59d1cb46c630

Groups

abonti

Rule	Path
Disallow	/

Rule

Path

Disallow

abonti/0.92

Rule	Path
Disallow	/

Rule

Path

Disallow

aboutthedomain

Rule	Path
Disallow	/

Rule

Path

Disallow

add catalog

Rule	Path
Disallow	/

Rule

Path

Disallow

add catalog/2.1

Rule	Path
Disallow	/

Rule

Path

Disallow

advbot

Rule	Path
Disallow	/

Rule

Path

Disallow

advbot/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

aitellu

Rule	Path
Disallow	/

Rule

Path

Disallow

apache-httpclient/4.1.1 (java 1.5)

Rule	Path
Disallow	/

Rule

Path

Disallow

battleztar bazinga

Rule	Path
Disallow	/

Rule

Path

Disallow

battleztar bazinga/0.01

Rule	Path
Disallow	/

Rule

Path

Disallow

betabot

Rule	Path
Disallow	/

Rule

Path

Disallow

blackboard safeassign

Rule	Path
Disallow	/

Rule

Path

Disallow

blazer 1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

blp_bbot

Rule	Path
Disallow	/

Rule

Path

Disallow

blp_bbot/0.1

Rule	Path
Disallow	/

Rule

Path

Disallow

boia-accessibility-agent

Rule	Path
Disallow	/

Rule

Path

Disallow

boia-accessibility-agent/pr 1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

bot for jce

Rule	Path
Disallow	/

Rule

Path

Disallow

bot/0.1 (bot for jce)

Rule	Path
Disallow	/

Rule

Path

Disallow

bubing

Rule	Path
Disallow	/

Rule

Path

Disallow

ca-crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

ca-crawler/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

cakephp

Rule	Path
Disallow	/

Rule

Path

Disallow

camelhttpstream/1.0 evolution/3.2.2

Rule	Path
Disallow	/

Rule

Path

Disallow

cb/nutch-1.7

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

cliqzbot

Rule	Path
Disallow	/

Rule

Path

Disallow

cliqzbot/0.1

Rule	Path
Disallow	/

Rule

Path

Disallow

coccoc

Rule	Path
Disallow	/

Rule

Path

Disallow

crawler4j

Rule	Path
Disallow	/

Rule

Path

Disallow

crazywebcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

crazywebcrawler-spider

Rule	Path
Disallow	/

Rule

Path

Disallow

curl/7.15.3

Rule	Path
Disallow	/

Rule

Path

Disallow

curl/7.26.0

Rule	Path
Disallow	/

Rule

Path

Disallow

curl/7.32.0

Rule	Path
Disallow	/

Rule

Path

Disallow

curl/7.37.0

Rule	Path
Disallow	/

Rule

Path

Disallow

curl/php 5.3.29

Rule	Path
Disallow	/

Rule

Path

Disallow

cuwhois

Rule	Path
Disallow	/

Rule

Path

Disallow

cuwhois/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

dispatch/0.11.0

Rule	Path
Disallow	/

Rule

Path

Disallow

domainappender

Rule	Path
Disallow	/

Rule

Path

Disallow

domainappender /1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

domainsigmacrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

domainsigmacrawler/0.1

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule

Path

Disallow

duggmirror

Rule

Path

Disallow

ecommercebot

Rule

Path

Disallow

episerver link checker

Rule

Path

Disallow

euripbot

Rule

Path

Disallow

euripbot/2.0

Rule

Path

Disallow

exabot

Rule

Path

Disallow

findxbot

Rule

Path

Disallow

findxbot/1.0

Rule

Path

Disallow

flipboard robot

Rule

Path

Disallow

getrequest

Rule

Path

Disallow

getrequest/1.0

Rule

Path

Disallow

gluten free crawler

Rule

Path

Disallow

gluten free crawler/1.0

Rule

Path

Disallow

go 1.1 package http

Rule

Path

Disallow

haiula

Rule

Path

Disallow

haiula/1.4

Rule

Path

Disallow

haosouspider

Rule

Path

Disallow

heritrix

Rule

Path

Disallow

heritrix/1.14.4

Rule

Path

Disallow

heritrix/3.1.1

Rule

Path

Disallow

hivemind

Rule

Path

Disallow

http://git.io/tl_s2w

Rule

Path

Disallow

httpunit/1.x

Rule

Path

Disallow

hypercrawl

Rule

Path

Disallow

hypercrawl/0.2

Rule

Path

Disallow

ichiro robot

Rule

Path

Disallow

image.coccoc/1.0

Rule

Path

Disallow

indy library

Rule

Path

Disallow

integrity/5

Rule

Path

Disallow

internaetboten

Rule

Path

Disallow

internaetboten/0.99

Rule

Path

Disallow

jakarta

Rule

Path

Disallow

jakarta commons

Rule

Path

Disallow

jakarta commons-httpclient

Rule

Path

Disallow

jakarta commons-httpclient/3.0.1

Rule

Path

Disallow

jakarta commons-httpclient/3.0-rcx

Rule

Path

Disallow

jakarta commons-httpclient/3.1

Rule

Path

Disallow

jamesbot

Rule

Path

Disallow

james bot

Rule

Path

Disallow

java/1.4.1_04

Rule

Path

Disallow

java/1.6.0_04

Rule

Path

Disallow

java/1.6.0_10-rc2

Rule

Path

Disallow

java/1.6.0_15

Rule

Path

Disallow

java/1.6.0_24

Rule

Path

Disallow

java/1.6.0_26

Rule

Path

Disallow

java/1.6.0_32

Rule

Path

Disallow

java/1.7.0_09

Rule

Path

Disallow

java/1.7.0_45

Rule

Path

Disallow

java/1.7.0_55

Rule

Path

Disallow

java/1.7.0_60

Rule

Path

Disallow

java/1.7.0_60-ea

Rule

Path

Disallow

java/1.7.0_65

Rule

Path

Disallow

java/1.7.0_67

Rule

Path

Disallow

java/1.7.0_71

Rule

Path

Disallow

java/1.8.0_20

Rule

Path

Disallow

java/1.8.0_25

Rule

Path

Disallow

java/1.8.0_31

Rule

Path

Disallow

jetbrains

Rule

Path

Disallow

jetbrains 5.0

Rule

Path

Disallow

kraken

Rule

Path

Disallow

kraken/0.1

Rule

Path

Disallow

kraken/nutch-2.2.1

Rule

Path

Disallow

larbin

Rule

Path

Disallow

libcurl

Rule

Path

Disallow

libcurl/7.15.3

Rule

Path

Disallow

libcurl/7.19.7

Rule

Path

Disallow

libcurl/7.21.0

Rule

Path

Disallow

libreoffice

Rule

Path

Disallow

link/1.0

Rule

Path

Disallow

linkdex

Rule

Path

Disallow

linkdexbot

Rule

Path

Disallow

linkdexbot/2.0

Rule

Path

Disallow

linkdexbot/2.1

Rule

Path

Disallow

linkdex.com/v2.0

Rule

Path

Disallow

linkdex.com/v2.1

Rule

Path

Disallow

linkdexbot-mobile/2.1

Rule

Path

Disallow

linkpadbot

Rule

Path

Disallow

linkpadbot/1.06

Rule

Path

Disallow

lipperhey

Rule

Path

Disallow

lipperhey seo service

Rule

Path

Disallow

lipperhey-kaus-australis

Rule

Path

Disallow

lipperhey-kaus-australis/5.0

Rule

Path

Disallow

listicka

Rule

Path

Disallow

lssrocketcrawler

Rule

Path

Disallow

lssrocketcrawler/1.0

Rule

Path

Disallow

lssrocketcrawler/1.0 lightspeedsystems

Rule

Path

Disallow

ltx71

Rule

Path

Disallow

lwnutch/nutch-1.4

Rule

Path

Disallow

maxpointcrawler

Rule

Path

Disallow

maxpointcrawler/nutch-1.1

Rule

Path

Disallow

md5sum

Rule

Path

Disallow

md5sum\x22

Rule

Path

Disallow

meanpathbot

Rule

Path

Disallow

my nutch spider/nutch-1.9

Rule

Path

Disallow

nerdybot

Rule

Path

Disallow

netseer

Rule

Path

Disallow

ning/1.0

Rule

Path

Disallow

node.io

Rule

Path

Disallow

node.js

Rule

Path

Disallow

obot/2.3.1

Rule

Path

Disallow

omgilibot

Rule

Path

Disallow

omgilibot/0.4

Rule

Path

Disallow

openstat

Rule

Path

Disallow

openstat/0.1

Rule

Path

Disallow

optimizationcrawler

Rule

Path

Disallow

optimizationcrawler/0.2

Rule

Path

Disallow

pathdefender

Rule

Path

Disallow

pathdefender/1.0

Rule

Path

Disallow

perl lwp

Rule

Path

Disallow

plukkie

Rule

Path

Disallow

plukkie/1.5

Rule

Path

Disallow

pogs/2.0

Rule

Path

Disallow

privacy_enfaq.jsp

Rule

Path

Disallow

prlog

Rule

Path

Disallow

prlog/1.0

Rule

Path

Disallow

psbot

Rule

Path

Disallow

pycurl

Rule

Path

Disallow

python-urllib

Rule

Path

Disallow

python-urllib/1.17

Rule

Path

Disallow

python-urllib/2.5

Rule

Path

Disallow

python-urllib/2.6

Rule

Path

Disallow

python-urllib/2.7

Rule

Path

Disallow

rogerbot

Rule

Path

Disallow

rogerbot/1.0

Rule

Path

Disallow

rome client

Rule

Path

Disallow

rootlink

Rule

Path

Disallow

scrapy/0.24.4

Rule

Path

Disallow

showyoubot

Rule

Path

Disallow

sheerboredom.experimental.robot

Rule

Path

Disallow

sheerboredom.experimental.robot/0.2

Rule

Path

Disallow

sistrix

Rule

Path

Disallow

sistrix crawler

Rule

Path

Disallow

skimbot

Rule

Path

Disallow

skimbot/1.0

Rule

Path

Disallow

smtbot

Rule

Path

Disallow

smtbot/1.0

Rule

Path

Disallow

sogou pic spider

Rule

Path

Disallow

sogou pic spider/3.0

Rule

Path

Disallow

sogou spider

Rule

Path

Disallow

sogou web spider

Rule

Path

Disallow

spbot

Rule

Path

Disallow

spbot/4.4.2

Rule

Path

Disallow

spiderbot/nutch-1.7

Rule

Path

Disallow

steeler

Rule

Path

Disallow

steeler/3.5

Rule

Path

Disallow

studiofaca

Rule

Path

Disallow

studiofaca search

Rule

Path

Disallow

sukibot

Rule

Path

Disallow

sukibot_heritrix

Rule

Path

Disallow

sukibot_heritrix/3.1.1

Rule

Path

Disallow

surveybot

Rule

Path

Disallow

synthesio crawler release monalisa

Rule

Path

Disallow

trendictionbot

Rule

Path

Disallow

truebot

Rule

Path

Disallow

truebot/1.0

Rule

Path

Disallow

typhoeus

Rule

Path

Disallow

uipbot/1.0

Rule

Path

Disallow

umbot-ln

Rule

Path

Disallow

umbot-ln/1.0

Rule

Path

Disallow

updown_tester

Rule

Path

Disallow

webcookies

Rule

Path

Disallow

webcookies/1.0

Rule

Path

Disallow

webcopier vx.xa

Rule

Path

Disallow

web corpus crawler

Rule

Path

Disallow

web-sniffer

Rule

Path

Disallow

web-sniffer/1.1.0

Rule

Path

Disallow

wegtam

Rule

Path

Disallow

wegtam crawler

Rule

Path

Disallow

whatweb

Rule

Path

Disallow

whatweb/0.4.8-dev

Rule

Path

Disallow

worldbrewbot

Rule

Path

Disallow

worldbrewbot/2.1

Rule

Path

Disallow

worldwebheritage.org

Rule

Path

Disallow

worldwebheritage.org/1.0

Rule

Path

Disallow

www.deadlinkchecker.com

Rule

Path

Disallow

v1.0/1.2

Rule

Path

Disallow

vbseo

Rule

Path

Disallow

vericitecrawler

Rule

Path

Disallow

vericitecrawler/nutch-1.9

Rule

Path

Disallow

voltron

Rule

Path

Disallow

vorboss web crawler

Rule

Path

Disallow

vorboss web crawler/nutch-2.3

Rule

Path

Disallow

yetibot

Rule

Path

Disallow

yisouspider

Rule

Path

Disallow

zzabmbot

Rule

Path

Disallow

zzabmbot/1.0

Rule

Path

Disallow

snk

Rule

Path

Disallow

*

Rule

Path

Disallow

/wp-login.php

Disallow

/wp-login.php?action=register

Disallow

/wp-signup.php

Disallow

/trackback/

Disallow

/xmlrpc.php

Disallow

/feed/

Disallow

/comments/

Disallow

*/trackback/

Disallow

*/feed/

Disallow

*/comments/

Other Records

Field

Value

sitemap

https://www.planet360.info/en/sitemap.xml

sitemap

https://www.planet360.info/ru/sitemap.xml

sitemap

https://www.planet360.info/sitemap.xml

Comments

global

Warnings

14 invalid lines.

planet360.inforobots.txt

Resource Scan

Scan Details

Last Scan

Groups

abonti

abonti/0.92

aboutthedomain

add catalog

add catalog/2.1

advbot

advbot/2.0

aitellu

apache-httpclient/4.1.1 (java 1.5)

battleztar bazinga

battleztar bazinga/0.01

betabot

blackboard safeassign

blazer 1.0

blexbot

blexbot/1.0

blp_bbot

blp_bbot/0.1

boia-accessibility-agent

boia-accessibility-agent/pr 1.0

bot for jce

bot/0.1 (bot for jce)

bubing

ca-crawler

ca-crawler/1.0

cakephp

camelhttpstream/1.0 evolution/3.2.2

cb/nutch-1.7

ccbot

ccbot/2.0

cliqzbot

cliqzbot/0.1

coccoc

crawler4j

crazywebcrawler

crazywebcrawler-spider

curl/7.15.3

curl/7.26.0

curl/7.32.0

curl/7.37.0

curl/php 5.3.29

cuwhois

cuwhois/1.0

dispatch/0.11.0

domainappender

domainappender /1.0

domainsigmacrawler

domainsigmacrawler/0.1

dotbot

duggmirror

ecommercebot

episerver link checker

euripbot

euripbot/2.0

exabot

findxbot

findxbot/1.0

flipboard robot

getrequest

getrequest/1.0

gluten free crawler

gluten free crawler/1.0

go 1.1 package http

haiula

haiula/1.4

haosouspider

heritrix

heritrix/1.14.4

heritrix/3.1.1

hivemind

http://git.io/tl_s2w

httpunit/1.x

hypercrawl

hypercrawl/0.2

ichiro robot

planet360.info
robots.txt