stylight.co.uk
robots.txt
Robots Exclusion Standard data for stylight.co.uk
Resource Scan
Scan Details
| Site Domain | stylight.co.uk |
| Base Domain | stylight.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-11-09T04:16:59+00:00 |
| Next Scan | 2024-11-16T04:16:59+00:00 |
Last Scan
| Scanned | 2024-11-09T04:16:59+00:00 |
| URL | https://stylight.co.uk/robots.txt |
| Redirect | https://www.stylight.co.uk/robots.txt |
| Redirect Domain | www.stylight.co.uk |
| Redirect Base | stylight.co.uk |
| Domain IPs | 35.157.77.128, 52.28.105.189 |
| Redirect IPs | 35.157.77.128, 52.28.105.189 |
| Response IP | 35.157.77.128 |
| Found | Yes |
| Hash | 5b5433422d327707641fbfc569ca60f9bcdb1a81a758d34b4fb6cfc117ab5089 |
| SimHash | 4617f111e198 |
Groups
adsbot-google
apis-google
mediapartners-google
adsbot-google-mobile
| Rule | Path |
|---|---|
| Disallow | /apiGetSortList.action |
| Disallow | /apiMultiselectFilterApply.action |
| Allow | /*.action |
googlebot-image
googlebot
bingbot
yandexbot
| Rule | Path |
|---|---|
| Disallow | /*.action |
| Disallow | /*tag%3D |
| Disallow | /*freeShipping%3D |
| Disallow | /*brand%3D |
| Disallow | /*shop%3D |
| Disallow | /*sortBy%3D |
| Disallow | /*minPrice%3D |
| Disallow | /*maxPrice%3D |
| Disallow | /*searchstring%3D |
| Disallow | */checkout/* |
| Disallow | /insights/reports/?cat= |
| Disallow | /insights/stylight-now/?cat= |
| Disallow | /*excludeShop%3D |
| Allow | /Prodotto/ |
| Allow | /Producto/ |
| Allow | /Produto/ |
| Allow | /Product/ |
| Allow | /Item/ |
| Allow | /Produkt/ |
| Allow | /Artikel/ |
| Allow | /Article/ |
ahrefsbot
semrushbot
screaming frog seo spider
blexbot
dotbot
mj12bot
barkrowler
sistrix
optimizer
gptbot
etaospider
ccbot
searchmetricsbot
botify
rytebot
dataforseobot
amazonbot
| Product | Comment |
|---|---|
| searchmetricsbot | from conductor |
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | */checkout/* |
| Disallow | /*.action |
| Disallow | /redirect.action |
| Disallow | /redirectRealLink.action |
| Disallow | /soldout.clickout |
| Disallow | /track/ |
| Disallow | /api/ |
| Disallow | /Prodotto/ |
| Disallow | /Producto/ |
| Disallow | /Produto/ |
| Disallow | /Product/ |
| Disallow | /Item/ |
| Disallow | /Produkt/ |
| Disallow | /Artikel/ |
| Disallow | /Article/ |
| Disallow | /*tag%3D |
| Disallow | /*freeShipping%3D |
| Disallow | /*brand%3D |
| Disallow | /*shop%3D |
| Disallow | /*sortBy%3D |
| Disallow | /*minPrice%3D |
| Disallow | /*maxPrice%3D |
| Disallow | /*searchstring%3D |
| Disallow | /insights/reports/?cat= |
| Disallow | /insights/stylight-now/?cat= |
| Disallow | /*excludeShop%3D |
Comments