distrelec.nl
robots.txt

Robots Exclusion Standard data for distrelec.nl

Resource Scan

Scan Details

Site Domain distrelec.nl
Base Domain distrelec.nl
Scan Status Ok
Last Scan2024-09-02T18:01:53+00:00
Next Scan 2024-10-02T18:01:53+00:00

Last Scan

Scanned2024-09-02T18:01:53+00:00
URL https://distrelec.nl/robots.txt
Redirect https://www.distrelec.nl/robots.txt
Redirect Domain www.distrelec.nl
Redirect Base distrelec.nl
Domain IPs 52.58.122.104
Redirect IPs 13.225.4.106, 13.225.4.112, 13.225.4.61, 13.225.4.92, 2600:9000:21b4:2000:1b:2b0c:a880:93a1, 2600:9000:21b4:4e00:1b:2b0c:a880:93a1, 2600:9000:21b4:6a00:1b:2b0c:a880:93a1, 2600:9000:21b4:7200:1b:2b0c:a880:93a1, 2600:9000:21b4:9800:1b:2b0c:a880:93a1, 2600:9000:21b4:a00:1b:2b0c:a880:93a1, 2600:9000:21b4:bc00:1b:2b0c:a880:93a1, 2600:9000:21b4:fc00:1b:2b0c:a880:93a1
Response IP 13.225.4.112
Found Yes
Hash 66e2d41b3648289613be0b679ac4cf689d18dcb6512d25d6f195f3ec986e246b
SimHash 795dc830ac9b

Groups

*

Rule Path
Disallow *?q=*&filter
Disallow *%26filterURL%3D*
Disallow */search
Disallow */cart
Disallow */checkout
Disallow */my-account
Disallow */login
Disallow *//app/etc/local.xml
Disallow */medias/sys_master/*.gz
Disallow */availability*
Disallow */bom-tool-upload*
Disallow */bom-tool*
Disallow *undefined*
Disallow */special-shops/*
Disallow */shop-in-shop/*
Disallow */Web/Downloads/*
Disallow */shopping/*
Disallow /compliance-document/*
Disallow */rs-welcome
Disallow */rs-registration

cazoodlebot
gigabot
admantx
wget
semvisubot
baiduspider
baiduspider-image
blexbot
yandexbot
yandex
sogou
exabot
spbot
fetchbot
betabot
linkpadbot
mail.ru_bot
seznambot
dotbot
yeti
smtbot
findxbot
genio
bubing
proximic
coccoc
grapeshotcrawler
savetheworldheritage.org
chatgpt-user
gptbot
claudebot
brightbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.distrelec.nl/sitemap_index.xml

Comments

  • Block Bad-Bots or Useless-Bot