flashresults.com
robots.txt

Robots Exclusion Standard data for flashresults.com

Resource Scan

Scan Details

Site Domain flashresults.com
Base Domain flashresults.com
Scan Status Ok
Last Scan2024-09-13T16:08:40+00:00
Next Scan 2024-10-13T16:08:40+00:00

Last Scan

Scanned2024-09-13T16:08:40+00:00
URL https://flashresults.com/robots.txt
Domain IPs 13.33.30.12, 13.33.30.122, 13.33.30.40, 13.33.30.82, 2600:9000:229f:1000:16:6db:a440:93a1, 2600:9000:229f:3200:16:6db:a440:93a1, 2600:9000:229f:4a00:16:6db:a440:93a1, 2600:9000:229f:5c00:16:6db:a440:93a1, 2600:9000:229f:5e00:16:6db:a440:93a1, 2600:9000:229f:6000:16:6db:a440:93a1, 2600:9000:229f:c000:16:6db:a440:93a1, 2600:9000:229f:fe00:16:6db:a440:93a1
Response IP 13.33.30.122
Found Yes
Hash dd0fb52b1465f9e4afe188994ecab72b59ab579ec0a3415cc195ee2855152bc9
SimHash 6a14dbe2d2b1

Groups

blp_bbot/0.1

Rule Path
Disallow /

blp_bbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

speedy spider

Rule Path
Disallow /

psbot

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

ask jeeves

Rule Path
Disallow /

daumoa

Rule Path
Disallow /

jaxified

Rule Path
Disallow /

yeti

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

yesupbot

Rule Path
Disallow /

ezooms/1.0

Rule Path
Disallow /

dotspotsbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

willow internet crawler by twotrees

Rule Path
Disallow /

largesmall crawler

Rule Path
Disallow /

spbot

Rule Path
Disallow /

mxbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

influencebot/0.9

Rule Path
Disallow /

kwaclebot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

msrbot

Rule Path
Disallow /

betabot

Rule Path
Disallow /

yahoo-newscrawler

Rule Path
Disallow /

lycos_spider

Rule Path
Disallow /

yahoomobile/1.0

Rule Path
Disallow /

domaincrawler 1.0

Rule Path
Disallow /

yahoo pipes 1.0

Rule Path
Disallow /

kscrawler

Rule Path
Disallow /

synapse

Rule Path
Disallow /

yandex

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

inagist.com url crawler

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

lmspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

r6_feedfetcher

Rule Path
Disallow /

nu_tch-princeton

Rule Path
Disallow /

sheenbot

Rule Path
Disallow /

msr-isrccrawler

Rule Path
Disallow /

abby

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

purebot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

msubot

Rule Path
Disallow /

cyberpatrol sitecat webbot

Rule Path
Disallow /

diribot

Rule Path
Disallow /

envolk

Rule Path
Disallow /

fast enterprise crawler 6

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

postrank

Rule Path
Disallow /

hailoobot

Rule Path
Disallow /

agbot

Rule Path
Disallow /

unwindfetchor/1.0

Rule Path
Disallow /

voyager/1.0

Rule Path
Disallow /

huaweisymantecspider

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mozilla/5.0 (compatible; butterfly/1.0; +http://labs.topsy.com/butterfly/) gecko/2009032608 firefox/3.0.8

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

suggybot

Rule Path
Disallow /

lemurwebcrawler

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

www.integromedb.org/crawler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

googlebot

Rule Path
Disallow /admin/
Disallow /services/
Disallow /*.axd
Disallow /*print%3Dtrue*
Disallow /cgi-bin/
Disallow /Fonts/
Disallow /Scripts/
Disallow /Stylesheets/
Disallow /images/
Disallow /logos/
Disallow /Jank/
Disallow /flashwest/
Disallow /pin-map/
Disallow /*.pdf$
Disallow /*.jpg$
Disallow /*.png$
Disallow /*.csv$
Disallow /*.gif$
Disallow /*.pdf$
Disallow /*.js$
Disallow /flashtexas*
Allow /

bingbot

Rule Path
Disallow /admin/
Disallow /images/
Disallow /services/
Disallow /cgi-bin/
Disallow /Fonts/
Disallow /Scripts/
Disallow /Stylesheets/
Disallow /site/
Disallow /flashtexas*
Disallow /logos/
Disallow /Jank/
Disallow /flashwest/
Disallow /pin-map/
Disallow /*.jpg$
Disallow /*.gif$
Disallow /*.png$
Disallow /*.csv$
Disallow /*.axd
Disallow /*.pdf$
Disallow /*.js$
Allow /

msnbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /admin/
Disallow /services/
Disallow /*.csv$
Disallow /*.axd
Allow /

*

Rule Path
Disallow /images/
Disallow /documents/
Disallow /admin/
Disallow /services/
Disallow /site/
Disallow /logos/
Disallow /Jank/
Disallow /flashwest/
Disallow /pin-map/
Disallow /flashtexas*
Disallow /*.js$
Disallow /*.css$
Disallow /*.jpg$
Disallow /*.png$
Disallow /*.csv$
Disallow /*.pdf$
Disallow /*.gif$
Disallow /*.axd
Disallow /*print%3Dtrue*

heritrix

Rule Path
Disallow /

twitterbot/1.0

Rule Path
Disallow /

mozilla/4.0+(compatible;+t-h-u-n-d-e-r-s-t-o-n-e)

Rule Path
Disallow /

swiftbot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.