support.clean-mx.com
robots.txt

Robots Exclusion Standard data for support.clean-mx.com

Resource Scan

Scan Details

Site Domain support.clean-mx.com
Base Domain clean-mx.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-09-10T00:14:29+00:00
Next Scan 2024-11-09T00:14:29+00:00

Last Successful Scan

Scanned2024-06-19T18:49:08+00:00
URL https://support.clean-mx.com/robots.txt
Domain IPs 88.99.62.141
Response IP 88.99.62.141
Found Yes
Hash 664e83ec5b25bdda9025c24fd87a160159e7290e12a02de57f84915d247956cc
SimHash 56e79562d9b9

Groups

bingbot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

experibot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

applebot

Rule Path
Disallow /

queryseekerspider

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

openhosebot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

yahoo!

Rule Path
Disallow /

integromedb

Rule Path
Disallow /

netestate

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

acoonbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

integromedb

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

integromedb

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

yandex

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

*

Rule Path
Allow /robots.txt
Allow /clean-mx/phishing
Allow /clean-mx/viruses
Allow /clean-mx/portals
Allow /clean-mx/rss
Allow /clean-mx/phishing.php
Allow /clean-mx/viruses.php
Allow /clean-mx/portals.php
Allow /google0a9029b8b7e97693.html
Allow /y_key_f62799a4afdb4ca9.html
Allow /urllist.txt
Allow /clean-mx/rss.php
Disallow /clean-mx/virusesevidence/
Disallow /clean-mx/evidence/
Disallow /clean-mx/portalsevidence/
Disallow /mrtg
Disallow /live
Disallow /phpmyadmin
Disallow /hausderkunst.de
Disallow /phpMyAdmin
Disallow /somekping
Disallow /apache2-default
Allow /clean-mx/anubis
Disallow /clean-mx/blog
Disallow /clean-mx/downloads
Disallow /clean-mx/ext*
Disallow /clean-mx/HTTP*
Disallow /clean-mx/jpgraph
Disallow /clean-mx/PT
Disallow /clean-mx/PTA
Disallow /clean-mx/spamcop
Disallow /clean-mx/templates
Disallow /clean-mx/tr
Disallow /clean-mx/xxx
Disallow /clean-mx/grid*