Log In Sign Up

nippon-tackle.com
robots.txt

Robots Exclusion Standard data for nippon-tackle.com

Resource Scan

Scan Details

Site Domain nippon-tackle.com
Base Domain nippon-tackle.com
Scan Status Ok
Last Scan2024-10-06T08:27:33+00:00
Next Scan 2024-11-05T08:27:33+00:00

Last Scan

Scanned2024-10-06T08:27:33+00:00
URL https://nippon-tackle.com/robots.txt
Redirect https://www.nippon-tackle.com/robots.txt
Redirect Domain www.nippon-tackle.com
Redirect Base nippon-tackle.com
Domain IPs 89.22.110.178
Redirect IPs 89.22.110.178
Response IP 89.22.110.178
Found Yes
Hash 24cd985370786b332e2ff1c92dfda33bacaff5e54da684a5873a90acbb76160e
SimHash 12cc3312e0a8

Groups

*

Rule Path
Disallow /admin/
Disallow /dbeS/
Disallow /360grad/
Disallow *.pdf
Disallow *_s*

adscanner
advanced backlink tracking bot
ahrefsbot
aihitbot
at-bot
backlinkcrawler
barkrowler
bidswitchbot
blexbot
ccbot
censysinspect
cliqzbot
cloudservermarketspider
coccoc
dataxu
df bot 1.0
domain re-animator bot
domains project
domainstatsbot
domaintaggingbot
dotbot
exabot
fr-crawler
grapeshotcrawler
haosouspider
hubspot crawler
iccrawler
implisensebot
intelx.io_bot
internet-structure-research-project-bot
jobboersebot
jusprog – domain crawler
kraken
linkdexbot
linkisbot
linkstats
lipperhey-kaus-australis
magpie-crawler
meanpathbot
megaindex.com
megaindex.ru
metajobbot
mindupbot
mindupbot (datenbutler.de)
mj12bot
netpeakcheckerbot
obot
openhosebot
plista
plukkie
qwantify
r6_commentreader
rogerbot
rytebot
safednsbot
screaming frog seo spider
searchmetricsbot
semanticbot
semrushbot
semrushbot-ba
semrushbot-coub
semrushbot-ct
semrushbot-si
semrushbot-swa
seobilitybot
seodiver
seokicks
seokicks-robot
seoscanners.net
serpstatbot
sg-orbiter
sistrix
sistrix crawler
similarweb
siteauditbot
smtbot
spbot
spiderbot
splitsignalbot
surdotlybot
surveybot
strucr
thumbsniper
trendictionbot
turnitinbot
um-ic
unisterbot
vebidoobot
wappalyzer
wbsearchbot
woorankreview
wotbox
xovi
yak

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.nippon-tackle.com/export/sitemap_index.xml
Back to top

Comments

  • JTL
  • Crawler
Back to top

Warnings

  • 3 invalid lines.
Back to top