Log In Sign Up

nordson.com
robots.txt

Robots Exclusion Standard data for nordson.com

Resource Scan

Scan Details

Site Domain nordson.com
Base Domain nordson.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-12T16:26:56+00:00
Next Scan 2024-11-19T16:26:56+00:00

Last Successful Scan

Scanned2024-10-12T05:53:04+00:00
URL https://nordson.com/robots.txt
Redirect https://www.nordson.com/robots.txt
Redirect Domain www.nordson.com
Redirect Base nordson.com
Domain IPs 52.149.193.222
Redirect IPs 20.119.8.0
Response IP 20.119.8.0
Found Yes
Hash c7f7a29dde77db920de0a4f094efaac1cb4474d830aa35dcc3119661c35bf2fe
SimHash 52cd52c286e2

Groups

obot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

spbot

Rule Path
Disallow /

prlog

Rule Path
Disallow /

wesee

Rule Path
Disallow /

exabot

Rule Path
Disallow /

garlik

Rule Path
Disallow /

seebot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

genieo

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

kraken

Rule Path
Disallow /

cukbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

go 1.1

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

httrack

Rule Path
Disallow /

riddler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

vegebot

Rule Path
Disallow /

linkdex

Rule Path
Disallow /

idmarch

Rule Path
Disallow /

goodzer

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

proximic

Rule Path
Disallow /

applebot

Rule Path
Disallow /

jamesbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

symfony2

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

bitlybot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

linkcheck

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

sitecheck

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

lipperhey

Rule Path
Disallow /

flipboard

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

spiderbot

Rule Path
Disallow /

toweyabot

Rule Path
Disallow /

tscoutbot

Rule Path
Disallow /

adbeat_bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sitemapbot

Rule Path
Disallow /

netshelter

Rule Path
Disallow /

aboutusbot

Rule Path
Disallow /

icevikatam

Rule Path
Disallow /

wappalyzer

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

screenerbot

Rule Path
Disallow /

businessbot

Rule Path
Disallow /

welikelinks

Rule Path
Disallow /

blp_bbot/0.1

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

alexatoolbar

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

speedy spider

Rule Path
Disallow /

searchmassive

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

duckduckbot/1.0

Rule Path
Disallow /

fast enterprise

Rule Path
Disallow /

crazywebcrawler

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

lssrocketcrawler

Rule Path
Disallow /

xenu link sleuth

Rule Path
Disallow /

expertsearchspider

Rule Path
Disallow /

wecrawlforthepeace

Rule Path
Disallow /

sitecheck-sitecrawl

Rule Path
Disallow /

gigablastopensource

Rule Path
Disallow /

kinglandsystemscorp

Rule Path
Disallow /

dow jones searchbot

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

linkcheck by siteimprove.com

Rule Path
Disallow /

sitecheck-sitecrawl by siteimprove.com

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.nordson.com/sitemap.xml
Back to top

Warnings

  • 2 invalid lines.
Back to top