stylight.be
robots.txt

Robots Exclusion Standard data for stylight.be

Resource Scan

Scan Details

Site Domain stylight.be
Base Domain stylight.be
Scan Status Ok
Last Scan2024-11-07T19:09:05+00:00
Next Scan 2024-11-14T19:09:05+00:00

Last Scan

Scanned2024-11-07T19:09:05+00:00
URL https://www.stylight.be/robots.txt
Domain IPs 35.157.77.128, 52.28.105.189
Response IP 35.157.77.128
Found Yes
Hash 5b5433422d327707641fbfc569ca60f9bcdb1a81a758d34b4fb6cfc117ab5089
SimHash 4617f111e198

Groups

adsbot-google
apis-google
mediapartners-google
adsbot-google-mobile

Rule Path
Disallow /apiGetSortList.action
Disallow /apiMultiselectFilterApply.action
Allow /*.action

googlebot-image
googlebot
bingbot
yandexbot

Rule Path
Disallow /*.action
Disallow /*tag%3D
Disallow /*freeShipping%3D
Disallow /*brand%3D
Disallow /*shop%3D
Disallow /*sortBy%3D
Disallow /*minPrice%3D
Disallow /*maxPrice%3D
Disallow /*searchstring%3D
Disallow */checkout/*
Disallow /insights/reports/?cat=
Disallow /insights/stylight-now/?cat=
Disallow /*excludeShop%3D
Allow /Prodotto/
Allow /Producto/
Allow /Produto/
Allow /Product/
Allow /Item/
Allow /Produkt/
Allow /Artikel/
Allow /Article/

ahrefsbot
semrushbot
screaming frog seo spider
blexbot
dotbot
mj12bot
barkrowler
sistrix
optimizer
gptbot
etaospider
ccbot
searchmetricsbot
botify
rytebot
dataforseobot
amazonbot

Product Comment
searchmetricsbot from conductor
Rule Path
Disallow /

*

Rule Path
Disallow */checkout/*
Disallow /*.action
Disallow /redirect.action
Disallow /redirectRealLink.action
Disallow /soldout.clickout
Disallow /track/
Disallow /api/
Disallow /Prodotto/
Disallow /Producto/
Disallow /Produto/
Disallow /Product/
Disallow /Item/
Disallow /Produkt/
Disallow /Artikel/
Disallow /Article/
Disallow /*tag%3D
Disallow /*freeShipping%3D
Disallow /*brand%3D
Disallow /*shop%3D
Disallow /*sortBy%3D
Disallow /*minPrice%3D
Disallow /*maxPrice%3D
Disallow /*searchstring%3D
Disallow /insights/reports/?cat=
Disallow /insights/stylight-now/?cat=
Disallow /*excludeShop%3D

Comments

  • You've found us!
  • If you can actually read this and understand then we'd love to working with intelligent folks like you, we're sure you're not a robot.
  • block crawlers