discountacparts.com
robots.txt
Robots Exclusion Standard data for discountacparts.com
Resource Scan
Scan Details
| Site Domain | discountacparts.com |
| Base Domain | discountacparts.com |
| Scan Status | Ok |
| Last Scan | 2024-06-20T15:23:29+00:00 |
| Next Scan | 2024-07-20T15:23:29+00:00 |
Last Scan
| Scanned | 2024-06-20T15:23:29+00:00 |
| URL | https://discountacparts.com/robots.txt |
| Redirect | https://www.discountacparts.com/robots.txt |
| Redirect Domain | www.discountacparts.com |
| Redirect Base | discountacparts.com |
| Domain IPs | 104.22.10.28, 104.22.11.28, 172.67.13.240, 2606:4700:10::6816:a1c, 2606:4700:10::6816:b1c, 2606:4700:10::ac43:df0 |
| Redirect IPs | 104.22.10.28, 104.22.11.28, 172.67.13.240, 2606:4700:10::6816:a1c, 2606:4700:10::6816:b1c, 2606:4700:10::ac43:df0 |
| Response IP | 104.22.10.28 |
| Found | Yes |
| Hash | dd4318c28bb25395063b646c3f9b238164922ea5d0c2be179eaecfb4ecc41a34 |
| SimHash | 73da43c0c5b0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | / |
accoona
addsugarspiderbot
ahrefsbot
alexibot
anyapexbot
aqua_products
asterias
b2w/0.1
backdoorbot/1.0
becomebot
becomebot
beslistbot
billybobbot
bimbot
blekkobot
blexbot
blowfish/1.0
boitho
bookmark search tool
botalot
btbot
builtbottough
bullseye/1.0
bunnyslippers
catchbot
ccbot
cerberian
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
copernic
copyrightcheck
cosmos
cosmos
covario
crawler@wishpond.com
crazywebcrawler-spider
crescent
crescent internet toolpak http ole control v.1.0
datapatrol/nutch-1.0
diamondbot
discobot
dittospyder
dotbot
duggmirror
dumbot
emailcollector
emailsiphon
emailwolf
emeraldshield.com
enterprise_search
enterprise_search/1.0
envolk[its]spider
erocrawler
es
esperanzabot
etaospider
exabot
extractorpro
ezooms
fairad client
fast enterprise crawler
fast-webcrawler
fdse robot
fetch
flaming attackbot
foobot
furlbot
fyberspider
g2crawler
gaisbot
galaxybot
geniebot
getright/4.2
gigabot
girafabot
grub
grub-client
gsitecrawler
gumgum bot
halebot
happyfunbot
harvest/1.5
hatena antenna
hloader
holmes
htdig
http://www.searchengineworld.com bot
http://www.webmasterworld.com bot
httplib
httrack
humanlinks
ia_archiver
ia_archiver
ia_archiver/1.6
iaskspider
infonavirobot
internetseer.com
irlbot
iron33/1.0.2
issuecrawler
jaxified bot
jennybot
jetbot
jetbot/1.0
jyxobot
kenjin spider
keyword density/0.9
koepabot
l.webis
lapozzbot
larbin
ldspider
lexibot
libweb/clshttp
linguee bot
linkdex
linkextractorpro
linkscan/8.1a unix
linkwalker
lmspider
lnspiderguy
looksmart
lwp-trivial
lwp-trivial/1.34
mabontland
magpie-crawler
mata hari
microsoft url control
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
miixpc
miixpc/4.2
mister pix
mj12bot
moget
moget/2.1
mogimogi
mojeekbot
moreoverbot
morning paper
zealbot
msiecrawler
mvaclient
mxbot
naver
netants
netmechanic
netresearchserver
netseer crawler
newsgator
ng-search
nicebot
nicerspro
npbot
nusearch
nutch
nutchcvs
nymesis
obot
oegp
offline explorer
omgilibot
omniexplorer_bot
oodlebot
oozbot
openbot
openfind
openfind data gathere
oracle ultra search
orbiter
pagebiteshyperbot
peew
perman
polybot
postpost
propowerbot/2.14
prowebwalker
psbot
psbot - image search
pycurl
python-urllib
qseero
queryn metasearch
radian6
radiation retriever 1.1
rampybot
ravencrawler
repomonkey
repomonkey bait & tackle/v1.01
riddler
rma
rogerbot
ruby
rufusbot
sbider
sbider/nutch-1.0-dev
scooter
scrapy
scrapybot
scrubby
searchmetricsbot
searchpreview
searchsight
seekbot
semanticdiscovery
semrushbot
semrushbot-sa
sensis web crawler
seochat::bot
shopwiki
shoula robot
silk
sistrix
sitebot
sitecheck.internetseer.com
sitesnagger
slysearch
smtbot
snappy
sogou
sootle
spankbot
spanner
spbot
speedy spider
sputnikbot
spyfu
spyfu.com
sqworm
stanford
stanford comp sci
stanford compclub
stanford compsciclub
stanford spiderboys
suggybot
surveybot
suzuran
szukacz/1.4
teleport
teleportpro
telesoft
teoma
terrawizbot
the intraformant
thenomad
thesubot
tineye
tineye/1.1
tineye/1.1 (http://tineye.com/crawler.html)
tocrawl/urldispatcher
true_robot
true_robot/1.0
truwogps
turingos
turnitinbot
tweetedtimes bot
twengabot
uber
uber spider
updated
updownerbot
url control
url_spider_pro
urlfilebot
urly warning
vagabondo
vci
vci webviewer vci webviewer win32
voltron
vortex
voyager
vyu2
wbsearchbot
web image collector
webauto
webbandit
webbandit/3.50
webcollage
webcopier
webenhancer
webmasterworld extractor
webmasterworldforumbot
webreaper
websauger
website quester
websquash.com
webster pro
webstripper
webvac
webzip
webzip/4.0
wf84
wget
wget/1.5.3
wget/1.6
wishpond
womlpefactory
www-collector-e
xaldon_webspider
xenu
xenu link sleuth
xenu's
xenu's link sleuth 1.1c
yacy
yasaklibot
yooglifetchagent
zanrancrawler/0.2
zao/0.1 (http://www.kototoi.org/zao/)
zeus
zeus 32297 webster pro v2.9 win32
zeus link scout
zspider/0.9-dev http://feedback.redkolibri.com
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.discountacparts.com/sitemap.xml |
| sitemap | https://www.discountacparts.com/sitemap.xml.gz |
| sitemap | https://www.discountacparts.com/sitemap_images.xml |
| sitemap | https://www.discountacparts.com/sitemap_video.xml |
Warnings
- 2 invalid lines.
Comments