stiho.nl
robots.txt

Robots Exclusion Standard data for stiho.nl

Resource Scan

Scan Details

Site Domain stiho.nl
Base Domain stiho.nl
Scan Status Ok
Last Scan2025-12-04T23:55:35+00:00
Next Scan 2025-12-18T23:55:35+00:00

Last Scan

Scanned2025-12-04T23:55:35+00:00
URL https://www.stiho.nl/robots.txt
Domain IPs 13.69.68.11
Response IP 13.69.68.11
Found Yes
Hash 6eef198d786d9bcb597240d644514ee02f3519d000dfc93e53c88f9150f95242
SimHash 121ddc42c4b8

Groups

*

Rule Path
Disallow /INTERSHOP/web/WFS/SLDSystem/
Disallow /INTERSHOP/web/BOS/SMC/
Disallow /inloggen
Disallow /uitloggen
Disallow /winkelmand
Disallow /INTERSHOP/web/WFS/stihoGroep-Stiho-Site/nl_NL/-/EUR/ViewCart
Disallow /viewdata
Disallow /INTERSHOP/web/WFS/stihoGroep-Stiho-Site/nl_NL/-/EUR/ViewCheckout
Disallow /account
Disallow /INTERSHOP/web/WFS/stihoGroep-Stiho-Site/nl_NL/-/EUR/DSG_AddressesM3
Disallow /INTERSHOP/web/WFS/stihoGroep-Stiho-Site/nl_NL/-/EUR/ViewAccount
Disallow /INTERSHOP/web/WFS/stihoGroep-Stiho-Site/nl_NL/-/EUR/ViewOrder
Disallow /INTERSHOP/web/WFS/stihoGroep-Stiho-Site/nl_NL/-/EUR/ViewMostPurchasedItems
Disallow /INTERSHOP/web/WFS/stihoGroep-Stiho-Site/nl_NL/-/EUR/ViewParametricSearch-SimpleOfferSearch
Disallow /INTERSHOP/web/WFS/stihoGroep-Stiho-Site/nl_NL/-/EUR/ViewSuggestSearch-Suggest
Disallow /INTERSHOP/web/WFS/stihoGroep-Stiho-Site/nl_NL/-/EUR/GetProductData
Disallow /*SearchParameter%3D
Disallow /*PageableID%3D
Disallow /filter
Disallow /zoeken

seokicks-robot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot/7~bl

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

kingkevinbot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

cazoodlebot

Rule Path
Disallow /

dotbot/1.0

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.stiho.nl/sitemap.xml

Comments

  • will be used by all Yandex robots
  • contentking
  • new agent exclusions 07-11-2022
  • exclude AI bots