stylight.nl
robots.txt
Robots Exclusion Standard data for stylight.nl
Resource Scan
Scan Details
Site Domain | stylight.nl |
Base Domain | stylight.nl |
Scan Status | Ok |
Last Scan | 2024-06-07T10:53:13+00:00 |
Next Scan | 2024-06-14T10:53:13+00:00 |
Last Scan
Scanned | 2024-06-07T10:53:13+00:00 |
URL | https://stylight.nl/robots.txt |
Redirect | https://www.stylight.nl/robots.txt |
Redirect Domain | www.stylight.nl |
Redirect Base | stylight.nl |
Domain IPs | 18.200.77.107, 99.81.76.162 |
Redirect IPs | 18.184.234.100, 52.57.218.25 |
Response IP | 52.57.218.25 |
Found | Yes |
Hash | c50e787b9955694563782beb70052440f7852d26dc0fa9fd48dadb6df8775273 |
SimHash | 4a13fb00e198 |
Groups
googlebot-image
googlebot
bingbot
yandexbot
Rule | Path |
---|---|
Disallow | /*.action |
Disallow | /*tag%3D |
Disallow | /*freeShipping%3D |
Disallow | /*brand%3D |
Disallow | /*shop%3D |
Disallow | /*sortBy%3D |
Disallow | /*page%3D |
Disallow | /*sale%3D |
Disallow | /*minPrice%3D |
Disallow | /*maxPrice%3D |
Disallow | /*searchstring%3D |
Disallow | */checkout/* |
Allow | /Prodotto/ |
Allow | /Producto/ |
Allow | /Produto/ |
Allow | /Product/ |
Allow | /Item/ |
Allow | /Produkt/ |
Allow | /Artikel/ |
Allow | /Article/ |
ahrefsbot
semrushbot
screaming frog seo spider
blexbot
dotbot
mj12bot
barkrowler
sistrix
optimizer
gptbot
etaospider
ccbot
searchmetricsbot
botify
rytebot
Product | Comment |
---|---|
searchmetricsbot | from conductor |
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | */checkout/* |
Disallow | /*.action |
Disallow | /redirect.action |
Disallow | /redirectRealLink.action |
Disallow | /soldout.clickout |
Disallow | /track/ |
Disallow | /api/ |
Disallow | /Prodotto/ |
Disallow | /Producto/ |
Disallow | /Produto/ |
Disallow | /Product/ |
Disallow | /Item/ |
Disallow | /Produkt/ |
Disallow | /Artikel/ |
Disallow | /Article/ |
Disallow | /*tag%3D |
Disallow | /*freeShipping%3D |
Disallow | /*brand%3D |
Disallow | /*shop%3D |
Disallow | /*sortBy%3D |
Disallow | /*page%3D |
Disallow | /*sale%3D |
Disallow | /*minPrice%3D |
Disallow | /*maxPrice%3D |
Disallow | /*searchstring%3D |
Comments