6tm.com
robots.txt
Robots Exclusion Standard data for 6tm.com
Resource Scan
Scan Details
| Site Domain | 6tm.com |
| Base Domain | 6tm.com |
| Scan Status | Ok |
| Last Scan | 2024-11-04T08:09:08+00:00 |
| Next Scan | 2024-12-04T08:09:08+00:00 |
Last Scan
| Scanned | 2024-11-04T08:09:08+00:00 |
| URL | https://6tm.com/robots.txt |
| Domain IPs | 35.210.190.4 |
| Response IP | 35.210.190.4 |
| Found | Yes |
| Hash | 5a03f9756d590484eed3ed635bed561cc4116269746873ce31ea5cd3b8f46cb1 |
| SimHash | 7717d246cb63 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*? |
| Disallow | /?s= |
| Disallow | */trackback |
| Disallow | /*/feed |
| Disallow | /*/comments |
| Disallow | /cgi-bin/ |
| Disallow | /*.php$ |
| Disallow | /*.js$ |
| Disallow | /*.inc$ |
| Disallow | /*.css$ |
| Disallow | /*.gz$ |
| Disallow | /*.swf$ |
| Disallow | /*.wmv$ |
| Disallow | /*.cgi$ |
| Disallow | /*.xhtml$ |
| Disallow | /*.pdf$ |
| Disallow | /wp-login.php |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /wp-content/cache/ |
| Disallow | /wp-content/themes/ |
| Disallow | /wp-content/plugins/ |
| Allow | /wp-content/uploads/ |
alexibot
alvinetspider
antenne hatena
apocalxexplorerbot
aqua_products
asterias
b2w/0.1
backdoorbot/1.0
bizinformation
black hole
blowfish/1.0
boitho.com-dc
bookmark search tool
botalot
builtbottough
bullseye/1.0
bunnyslippers
cazoodlebot
cegbfeieh
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
converacrawler
copernic
copyrightcheck
cosmos
crescent
crescent internet toolpak http ole control v.1.0
curious george
disco pump 3.1
discobot
dittospyder
dotbot
duggmirror
ecatch
emailcollector
emailsiphon
emailwolf
erocrawler
extractorpro
fairad client
fasterfox
flaming attackbot
flamingo_searchengine
foobot
gaisbot
getright/4.2
gigabot
go!zilla
grub
grub-client
harvest/1.5
heritrix
hloader
httplib
httrack
httrack 3.0
huaweisymantecspider
humanlinks
ia_archiver
ia_archiver/1.6
ichiro
igentia
infonavirobot
interget
irlbot
iron33/1.0.2
jennybot
jetbot
jikespider
kalooga
kenjin spider
keyword density/0.9
larbin
lexibot
lexxebot
libweb/clshttp
linkextractorpro
linkscan/8.1a unix
linkwalker
lnspiderguy
looksmart
lwp-trivial
lwp-trivial/1.34
mail.ru_bot
mata hari
microsoft url control
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
miixpc
miixpc/4.2
mister pix
mlbotbot
moget
moget/2.1
mozilla/4.0 (compatible; bullseye; windows 95)
ms search 4.0 robot
ms search 5.0 robot
msiecrawler
naverbot
netants
netattache
netmechanic
nicerspro
nutch
ocelli
offline explorer
openbot
openfind
openfind data gathere
openindexspider
oracle ultra search
penthesilea
perman
phpdig
propowerbot/2.14
prowebwalker
psbot
python-urllib
quepasacreep
queryn metasearch
radiation retriever 1.1
repomonkey
repomonkey bait & tackle/v1.01
rma
scoutjet
searchdaimon.com-dc
searchpreview
seznambot/3.0
shopwiki
sightupbot
sitebot
sitesnagger
ssource/robots-lahalle.txtitesucker
snapbot
sogou web spider
sosospider
spankbot
spanner
speedy
suggybot
superbot
superbot/2.6
surveybot
suzuran
szukacz/1.4
teleport
teleportpro
telesoft
the intraformant
thenomad
tighttwatbot
titan
tocrawl/urldispatcher
toscrawler
true_robot
true_robot/1.0
turingos
turnitinbot
twengabot
twiceler
updownerbot
url control
url_spider_pro
urlpouls
urly warning
vci
vci webviewer vci webviewer win32
web image collector
webauto
webbandit
webbandit/3.50
webcopier
webcopy
webenhancer
webmasterworld extractor
webmasterworldforumbot
webmirror
webreaper
websauger
website extractor
website quester
webster pro
webstripper
webstripper/2.02
webzip
webzip/4.0
wegobot
wget
wget/1.5.3
wget/1.6
wikiofeedbot
winhttrack
woozweb-monitoring
woriobot
www-collector-e
yacy
yacybit
yacybot
yahoo pipes 1.0
yahoo pipes 2.0
yeti
yodaobot
yrspider
zeus
zeus 32297 webster pro v2.9 win32
zeus link scout
zookabot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.6tm.com/sitemap_index.xml |
Warnings
- 1 invalid line.
Comments