stylight.nl
robots.txt
Robots Exclusion Standard data for stylight.nl
Resource Scan
Scan Details
Site Domain | stylight.nl |
Base Domain | stylight.nl |
Scan Status | Ok |
Last Scan | 2024-11-08T15:26:10+00:00 |
Next Scan | 2024-11-15T15:26:10+00:00 |
Last Scan
Scanned | 2024-11-08T15:26:10+00:00 |
URL | https://stylight.nl/robots.txt |
Redirect | https://www.stylight.nl/robots.txt |
Redirect Domain | www.stylight.nl |
Redirect Base | stylight.nl |
Domain IPs | 35.157.77.128, 52.28.105.189 |
Redirect IPs | 35.157.77.128, 52.28.105.189 |
Response IP | 35.157.77.128 |
Found | Yes |
Hash | 5b5433422d327707641fbfc569ca60f9bcdb1a81a758d34b4fb6cfc117ab5089 |
SimHash | 4617f111e198 |
Groups
adsbot-google
apis-google
mediapartners-google
adsbot-google-mobile
Rule | Path |
---|---|
Disallow | /apiGetSortList.action |
Disallow | /apiMultiselectFilterApply.action |
Allow | /*.action |
googlebot-image
googlebot
bingbot
yandexbot
Rule | Path |
---|---|
Disallow | /*.action |
Disallow | /*tag%3D |
Disallow | /*freeShipping%3D |
Disallow | /*brand%3D |
Disallow | /*shop%3D |
Disallow | /*sortBy%3D |
Disallow | /*minPrice%3D |
Disallow | /*maxPrice%3D |
Disallow | /*searchstring%3D |
Disallow | */checkout/* |
Disallow | /insights/reports/?cat= |
Disallow | /insights/stylight-now/?cat= |
Disallow | /*excludeShop%3D |
Allow | /Prodotto/ |
Allow | /Producto/ |
Allow | /Produto/ |
Allow | /Product/ |
Allow | /Item/ |
Allow | /Produkt/ |
Allow | /Artikel/ |
Allow | /Article/ |
ahrefsbot
semrushbot
screaming frog seo spider
blexbot
dotbot
mj12bot
barkrowler
sistrix
optimizer
gptbot
etaospider
ccbot
searchmetricsbot
botify
rytebot
dataforseobot
amazonbot
Product | Comment |
---|---|
searchmetricsbot | from conductor |
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | */checkout/* |
Disallow | /*.action |
Disallow | /redirect.action |
Disallow | /redirectRealLink.action |
Disallow | /soldout.clickout |
Disallow | /track/ |
Disallow | /api/ |
Disallow | /Prodotto/ |
Disallow | /Producto/ |
Disallow | /Produto/ |
Disallow | /Product/ |
Disallow | /Item/ |
Disallow | /Produkt/ |
Disallow | /Artikel/ |
Disallow | /Article/ |
Disallow | /*tag%3D |
Disallow | /*freeShipping%3D |
Disallow | /*brand%3D |
Disallow | /*shop%3D |
Disallow | /*sortBy%3D |
Disallow | /*minPrice%3D |
Disallow | /*maxPrice%3D |
Disallow | /*searchstring%3D |
Disallow | /insights/reports/?cat= |
Disallow | /insights/stylight-now/?cat= |
Disallow | /*excludeShop%3D |
Comments