2020.loraincounty.com
robots.txt
Robots Exclusion Standard data for 2020.loraincounty.com
Resource Scan
Scan Details
| Site Domain | 2020.loraincounty.com |
| Base Domain | loraincounty.com |
| Scan Status | Ok |
| Last Scan | 2024-09-11T14:14:30+00:00 |
| Next Scan | 2024-10-11T14:14:30+00:00 |
Last Scan
| Scanned | 2024-09-11T14:14:30+00:00 |
| URL | https://2020.loraincounty.com/robots.txt |
| Redirect | https://www.loraincounty.com:443/robots.txt |
| Redirect Domain | www.loraincounty.com |
| Redirect Base | loraincounty.com |
| Domain IPs | 104.21.67.50, 172.67.213.209, 2606:4700:3032::ac43:d5d1, 2606:4700:3034::6815:4332 |
| Redirect IPs | 104.21.67.50, 172.67.213.209, 2606:4700:3032::ac43:d5d1, 2606:4700:3034::6815:4332 |
| Response IP | 172.67.213.209 |
| Found | Yes |
| Hash | c415b885e8c8d666fbe5b381b826717d621bcea0fffcb381f545b3021e6cfa6a |
| SimHash | 725a52604d87 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/* |
| Disallow | /sports/* |
| Allow | / |
adequat
adequat-systems
alexibot
alvinetspider
amisoftware
antenne hatena
apocalxexplorerbot
asknread.com
asterias
augure
auramundi
backdoorbot/1.0
bizinformation
black hole
blowfish/1.0
blp_bbot
botalot
builtbottough
bullseye/1.0
mj12bot
megaindex.ru
bunnyslippers
cegbfeieh
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
codewisebot
coexel
converacrawler
copyrightcheck
corporama
cosmos
crescent
crescent internet toolpak http ole control v.1.0
disco pump 3.1
dittospyder
dotbot
ellisphere
emailcollector
emailsiphon
emailwolf
erocrawler
extractorpro
fetch
flamingo_searchengine
foobot
grub-client
hloader
httplib
httrack
httrack 3.0
humanlinks
hybridbot
igentia
infonavirobot
infoseek
jennybot
jetbot
jikespider
k2spider
kbcrawl
kenjin spider
knowings
leadbox
lexibot
libweb/clshttp
libwww
linguee bot
linkextractorpro
linkfluence
linkscan/8.1a unix
linkwalker
lwp-trivial
lwp-trivial/1.34
mata hari
meltwater
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
miixpc
miixpc/4.2
mister pix
mlbot
moget
moget/2.1
moreover
msiecrawler
mytwip
naverbot
netants
netattache
netmechanic
newsnow
newzbin
nicerspro
offline explorer
openfind
openindexspider
opinion-tracker
propowerbot/2.14
prowebwalker
proxem
psbot
quepasacreep
queryn metasearch
qwam content intelligence
readability.com
repomonkey
rma
score3
semrushbot
sightupbot
sindup
sitebot
sitecheck.internetseer.com
sitesnagger
sitesucker
sogou web spider
sosospider
spankbot
spanner
speedy
spotter
suggybot
superbot
superbot/2.6
suzuran
synthesio
szukacz/1.4
teleport
teleportpro
telesoft
the intraformant
thenomad
tighttwatbot
titan
tocrawl/urldispatcher
toscrawler
trendeo
trendybuzz
true_robot
true_robot/1.0
turingos
turnitinbot
urlpouls
urly warning
vci
vecteurplus
verticalsearch
vsw
web image collector
webauto
webbandit
webbandit/3.50
webcopier
webcopy
webenhancer
webmasterworldforumbot
webmirror
webreaper
websauger
website extractor
website quester
webster pro
webstripper
webstripper/2.02
webzip
wget
wikiofeedbot
winello
winhttrack
www-collector-e
xaldon_webspider
yacy
youmag
yrspider
zealbot
zeus
zite
zookabot
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 2 invalid lines.
Comments