stylight.co.uk
robots.txt
Robots Exclusion Standard data for stylight.co.uk
Resource Scan
Scan Details
| Site Domain | stylight.co.uk |
| Base Domain | stylight.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-05-24T17:20:00+00:00 |
| Next Scan | 2024-05-31T17:20:00+00:00 |
Last Scan
| Scanned | 2024-05-24T17:20:00+00:00 |
| URL | https://www.stylight.co.uk/robots.txt |
| Domain IPs | 18.156.20.157, 52.58.28.7 |
| Response IP | 18.156.20.157 |
| Found | Yes |
| Hash | c50e787b9955694563782beb70052440f7852d26dc0fa9fd48dadb6df8775273 |
| SimHash | 4a13fb00e198 |
Groups
googlebot-image
googlebot
bingbot
yandexbot
| Rule | Path |
|---|---|
| Disallow | /*.action |
| Disallow | /*tag%3D |
| Disallow | /*freeShipping%3D |
| Disallow | /*brand%3D |
| Disallow | /*shop%3D |
| Disallow | /*sortBy%3D |
| Disallow | /*page%3D |
| Disallow | /*sale%3D |
| Disallow | /*minPrice%3D |
| Disallow | /*maxPrice%3D |
| Disallow | /*searchstring%3D |
| Disallow | */checkout/* |
| Allow | /Prodotto/ |
| Allow | /Producto/ |
| Allow | /Produto/ |
| Allow | /Product/ |
| Allow | /Item/ |
| Allow | /Produkt/ |
| Allow | /Artikel/ |
| Allow | /Article/ |
ahrefsbot
semrushbot
screaming frog seo spider
blexbot
dotbot
mj12bot
barkrowler
sistrix
optimizer
gptbot
etaospider
ccbot
searchmetricsbot
botify
rytebot
| Product | Comment |
|---|---|
| searchmetricsbot | from conductor |
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | */checkout/* |
| Disallow | /*.action |
| Disallow | /redirect.action |
| Disallow | /redirectRealLink.action |
| Disallow | /soldout.clickout |
| Disallow | /track/ |
| Disallow | /api/ |
| Disallow | /Prodotto/ |
| Disallow | /Producto/ |
| Disallow | /Produto/ |
| Disallow | /Product/ |
| Disallow | /Item/ |
| Disallow | /Produkt/ |
| Disallow | /Artikel/ |
| Disallow | /Article/ |
| Disallow | /*tag%3D |
| Disallow | /*freeShipping%3D |
| Disallow | /*brand%3D |
| Disallow | /*shop%3D |
| Disallow | /*sortBy%3D |
| Disallow | /*page%3D |
| Disallow | /*sale%3D |
| Disallow | /*minPrice%3D |
| Disallow | /*maxPrice%3D |
| Disallow | /*searchstring%3D |
Comments