lights.co.uk
robots.txt
Robots Exclusion Standard data for lights.co.uk
Resource Scan
Scan Details
Site Domain | lights.co.uk |
Base Domain | lights.co.uk |
Scan Status | Ok |
Last Scan | 2024-09-13T16:06:51+00:00 |
Next Scan | 2024-10-13T16:06:51+00:00 |
Last Scan
Scanned | 2024-09-13T16:06:51+00:00 |
URL | https://lights.co.uk/robots.txt |
Redirect | https://www.lights.co.uk/robots.txt |
Redirect Domain | www.lights.co.uk |
Redirect Base | lights.co.uk |
Domain IPs | 34.117.86.115 |
Redirect IPs | 34.117.86.115 |
Response IP | 34.117.86.115 |
Found | Yes |
Hash | f722dc570469e63d8ef30bb96097014fc5d89f58dd9d1ab03333d9c529f95877 |
SimHash | 4106f068cbf3 |
Groups
*
adidxbot
Product | Comment |
---|---|
adidxbot | explicit mentioning of bing ads bot. It does not adhere to the agent wildcard. |
Rule | Path | Comment |
---|---|---|
Disallow | /checkout/ | - |
Disallow | /customer/ | - |
Disallow | /wishlist/ | - |
Disallow | /catalogsearch/ | - |
Disallow | /app/ | - |
Disallow | /lib/ | - |
Disallow | /*.php$ | - |
Disallow | /*SID%3D | - |
Disallow | /index.php/ | - |
Disallow | /banner/ajax | - |
Disallow | /lw_related/ajax | - |
Disallow | /documents/ | - |
Disallow | */article/*nocache%3D | - |
Disallow | /bloom/widget/* | - |
Disallow | /*?*&* | block irrelevant filter combinations |
Disallow | /*?*~* | block irrelevant filter value combinations |
Disallow | /*?*~* | block tilde |
Disallow | /*?*&*&*p=* | block irrelevant filter combinations with pagination |
Disallow | /*?*~*&p=* | block irrelevant filter value combinations with pagination |
Disallow | /*?*~*&p=* | block tilde |
Allow | /*?*&p=* | allow relevant filter with pagination |
Disallow | /*?*___* | - |
Disallow | /*?*category=* | - |
Disallow | /*?*light_bulb=* | - |
Disallow | /*?SESSIONNAME=* | - |
Allow | /*utm_* | - |
Allow | /*lw_view%3Dnocontent* | - |
Allow | /*display%3Dproducts* | - |
Allow | /*lw_om_view%3Drecotop* | - |
Allow | /*block_sku%3D* | - |
Other Records
Field | Value |
---|---|
sitemap | https://www.lights.co.uk/media/sitemap/sitemap_en_gb.xml |
Comments