search-mymobile.com
robots.txt
Robots Exclusion Standard data for search-mymobile.com
Resource Scan
Scan Details
| Site Domain | search-mymobile.com |
| Base Domain | search-mymobile.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-04-16T21:09:59+00:00 |
| Next Scan | 2024-07-15T21:09:59+00:00 |
Last Successful Scan
| Scanned | 2022-08-26T21:27:43+00:00 |
| URL | https://search-mymobile.com/robots.txt |
| Response IP | 5.180.102.102 |
| Found | Yes |
| Hash | 15a82a9bd69aba0151d6f77a2871296acf3de115ee63391e4b4f9d80662d2c15 |
| SimHash | 659e52ab4596 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /eupanel/ |
| Disallow | /find/ |
| Disallow | /location/ |
| Disallow | /app/ |
| Disallow | /active/ |
| Disallow | /ajax/ |
| Disallow | /appleid/ |
| Disallow | /apps/ |
| Disallow | /appstore/ |
| Disallow | /auth/ |
| Disallow | /claim/ |
| Disallow | /blackhole/ |
| Disallow | /FindMy/ |
| Disallow | /Find-My/ |
| Disallow | /FlND/ |
| Disallow | /FMl/ |
| Disallow | /Mac/ |
| Disallow | /store/ |
| Disallow | /lPHONE/ |
| Disallow | /lost/ |
| Disallow | /locate/ |
| Disallow | /iTV/ |
| Disallow | /tracking/ |
| Disallow | /iPhone/ |
| Disallow | /fmi/ |
| Disallow | /FMl/ |
| Disallow | /gift/ |
| Disallow | /icloud/ |
| Disallow | /ID/ |
| Disallow | /imap/ |
| Disallow | /info/ |
| Disallow | /iPhone/ |
| Disallow | /iserver/ |
| Disallow | /it/ |
| Disallow | /link/ |
| Disallow | /loc/ |
| Disallow | /location/ |
| Disallow | /lock4/ |
| Disallow | /lock6/ |
| Disallow | /lost_support/ |
| Disallow | /map/ |
| Disallow | /pass/ |
| Disallow | /pass4/ |
| Disallow | /pass6/ |
| Disallow | /support/ |
| Disallow | /track/ |
*
| Rule | Path |
|---|---|
| Disallow | /eupanel/ |
| Disallow | /cgi-bin/ |
| Disallow | /.well-known/ |
| Disallow | /Find/index.php |
| Disallow | /Find/location/index.php |
| Disallow | /location/index.php |
| Disallow | /location/find/index.php |
| Disallow | /code/index.php |
| Disallow | /code/4/index.php |
| Disallow | /code/6/index.php |
| Disallow | /code/pass4/index.php |
| Disallow | /code/pass6/index.php |
| Disallow | /app/index.php |
| Disallow | /blackhole/index.php |
| Disallow | /FindMy/index.php |
| Disallow | /Find-My/index.php |
| Disallow | /FlND/index.php |
| Disallow | /FMl/index.php |
| Disallow | /Mac/index.php |
| Disallow | /store/index.php |
| Disallow | /lPHONE/index.php |
| Disallow | /lost/index.php |
| Disallow | /locate/index.php |
| Disallow | /iTV/index.php |
| Disallow | /tracking/index.php |
| Disallow | /iPhone/index.php |
| Disallow | /Active/index.php |
| Disallow | /ickit/index.php |
| Disallow | /ickit/ajax.php |
| Disallow | /ickit/ajax_app_id.php |
| Disallow | /ickit/ajax_code.php |
| Disallow | /appleid/index.php |
| Disallow | /apps/index.php |
| Disallow | /appstore/index.php |
| Disallow | /auth/index.php |
| Disallow | /claim/index.php |
| Disallow | /FindMy/index.php |
| Disallow | /fmi/index.php |
| Disallow | /FMl/index.php |
| Disallow | /gift/index.php |
| Disallow | /icloud/index.php |
| Disallow | /ID/index.php |
| Disallow | /imap/index.php |
| Disallow | /info/index.php |
| Disallow | /iPhone/index.php |
| Disallow | /iserver/index.php |
| Disallow | /it/index.php |
| Disallow | /link/index.php |
| Disallow | /loc/index.php |
| Disallow | /location/index.php |
| Disallow | /lock4/index.php |
| Disallow | /lock6/index.php |
| Disallow | /lost_support/index.php |
| Disallow | /map/index.php |
| Disallow | /pass/index.php |
| Disallow | /pass4/index.php |
| Disallow | /pass6/index.php |
| Disallow | /support/index.php |
| Disallow | /track/index.php |
nutch
jetbot/1.0
jetbot
teoma
webvac
stanford
stanford compsciclub
stanford compclub
stanford spiderboys
scooter
naver
dumbot
hatena antenna
grub-client
grub
looksmart
webzip
larbin
b2w/0.1
copernic
psbot
python-urllib
netmechanic
url_spider_pro
cherrypicker
emailcollector
emailsiphon
webbandit
emailwolf
extractorpro
copyrightcheck
crescent
sitesnagger
prowebwalker
cheesebot
lnspiderguy
mozilla
mozilla
mozilla/3
mozilla/4
mozilla/5
mozilla/4.0 (compatible; msie 4.0; windows nt)
mozilla/4.0 (compatible; msie 4.0; windows 95)
mozilla/4.0 (compatible; msie 4.0; windows 98)
mozilla/4.0 (compatible; msie 4.0; windows xp)
mozilla/4.0 (compatible; msie 4.0; windows 2000)
ia_archiver
ia_archiver/1.6
alexibot
teleport
teleportpro
stanford comp sci
miixpc
telesoft
website quester
moget/2.1
webzip/4.0
webstripper
websauger
webcopier
netants
mister pix
webauto
thenomad
www-collector-e
rma
libweb/clshttp
asterias
httplib
turingos
spanner
infonavirobot
harvest/1.5
bullseye/1.0
mozilla/4.0 (compatible; bullseye; windows 95)
crescent internet toolpak http ole control v.1.0
cherrypickerse/1.0
cherrypickerelite/1.0
webbandit/3.50
nicerspro
microsoft url control - 5.01.4511
dittospyder
foobot
webmasterworldforumbot
spankbot
botalot
lwp-trivial/1.34
lwp-trivial
http://www.webmasterworld.com bot
bunnyslippers
microsoft url control - 6.00.8169
urly warning
wget/1.6
wget/1.5.3
wget
linkwalker
cosmos
moget
hloader
humanlinks
linkextractorpro
offline explorer
mata hari
lexibot
web image collector
the intraformant
true_robot/1.0
true_robot
blowfish/1.0
http://www.searchengineworld.com bot
jennybot
miixpc/4.2
builtbottough
propowerbot/2.14
backdoorbot/1.0
tocrawl/urldispatcher
webenhancer
suzuran
vci webviewer vci webviewer win32
vci
szukacz/1.4
queryn metasearch
openfind data gathere
openfind
xenu's link sleuth 1.1c
xenu's
zeus
repomonkey bait & tackle/v1.01
repomonkey
microsoft url control
openbot
url control
zeus link scout
zeus 32297 webster pro v2.9 win32
webster pro
erocrawler
linkscan/8.1a unix
keyword density/0.9
kenjin spider
iron33/1.0.2
bookmark search tool
getright/4.2
fairad client
gaisbot
aqua_products
radiation retriever 1.1
webmasterworld extractor
flaming attackbot
oracle ultra search
msiecrawler
perman
searchpreview
sootle
es
enterprise_search/1.0
enterprise_search
ahrefsbot
mj12bot
rogerbot
exabot
dotbot
gigabot
blekkobot
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /blackhole/ |
Comments