kickofsport.com
robots.txt
Robots Exclusion Standard data for kickofsport.com
Resource Scan
Scan Details
| Site Domain | kickofsport.com |
| Base Domain | kickofsport.com |
| Scan Status | Ok |
| Last Scan | 2024-11-10T17:29:34+00:00 |
| Next Scan | 2024-11-17T17:29:34+00:00 |
Last Scan
| Scanned | 2024-11-10T17:29:34+00:00 |
| URL | https://kickofsport.com/robots.txt |
| Domain IPs | 104.21.85.58, 172.67.202.189, 2606:4700:3035::ac43:cabd, 2606:4700:3036::6815:553a |
| Response IP | 172.67.202.189 |
| Found | Yes |
| Hash | 45f64654c5af82a5bc6404d6ec6325a6283dd123067e4cf81c87228769a7df9b |
| SimHash | 719f52f3cfb2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
mj12bot
python-urllib
b2w/0.1
webzip
harvest/1.5
true_robot/1.0
rma
thenomad
spanner
lwp-trivial
websauger
microsoft url control - 6.00.8169
webstripper
grub-client
www-collector-e
backdoorbot/1.0
openbot
http://www.searchengineworld.com bot
searchpreview
webbandit
dittospyder
propowerbot/2.14
prowebwalker
zeus link scout
sootle
http://www.webmasterworld.com bot
miixpc/4.2
url control
ia_archiver
getright/4.2
lnspiderguy
erocrawler
mozilla/4
cherrypicker
jetbot/1.0
xenu's link sleuth 1.1c
mozilla/4.0 (compatible; msie 4.0; windows 2000)
szukacz/1.4
looksmart
alexibot
miixpc
offline explorer
zeus 32297 webster pro v2.9 win32
web image collector
nicerspro
cosmos
copernic
mister pix
blekkobot
emailwolf
netants
mozilla/4.0 (compatible; msie 4.0; windows 98)
lexibot
httplib
dotbot
gigabot
netmechanic
emailcollector
mozilla
perman
larbin
cheesebot
mozilla/4.0 (compatible; msie 4.0; windows 95)
vci
stanford compsciclub
wget/1.5.3
cherrypickerelite/1.0
repomonkey bait & tackle/v1.01
queryn metasearch
enterprise_search/1.0
foobot
webbandit/3.50
microsoft url control - 5.01.4511
flaming attackbot
wget/1.6
url_spider_pro
gaisbot
aqua_products
fairad client
mozilla/4.0 (compatible; msie 4.0; windows xp)
crescent
turingos
copyrightcheck
nutch
emailsiphon
openfind data gathere
crescent internet toolpak http ole control v.1.0
telesoft
webenhancer
es
botalot
infonavirobot
radiation retriever 1.1
webcopier
stanford compclub
jetbot
the intraformant
hatena antenna
webvac
zeus
naver
tocrawl/urldispatcher
openfind
psbot
xenu's
urly warning
true_robot
linkwalker
extractorpro
stanford
mata hari
wget
dumbot
mozilla/4.0 (compatible; bullseye; windows 95)
rogerbot
microsoft url control
humanlinks
jennybot
msiecrawler
semrushbot
iron33/1.0.2
exabot
bookmark search tool
stanford spiderboys
builtbottough
linkscan/8.1a unix
teoma
vci webviewer vci webviewer win32
keyword density/0.9
blexbot
oracle ultra search
webster pro
ahrefsbot
linkextractorpro
kenjin spider
lwp-trivial/1.34
mozilla/3
mozilla/5
blowfish/1.0
ia_archiver/1.6
becomebot
mozilla/4.0 (compatible; msie 4.0; windows nt)
scooter
cherrypickerse/1.0
spankbot
webmasterworld extractor
teleportpro
moget/2.1
bullseye/1.0
suzuran
webmasterworldforumbot
libweb/clshttp
mozilla
asterias
repomonkey
enterprise_search
moget
webauto
teleport
stanford comp sci
website quester
webzip/4.0
grub
bunnyslippers
sitesnagger
hloader
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.kickofsport.com/sitemap_index.xml |