opticswarehouse.co.uk
robots.txt
Robots Exclusion Standard data for opticswarehouse.co.uk
Resource Scan
Scan Details
| Site Domain | opticswarehouse.co.uk |
| Base Domain | opticswarehouse.co.uk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-11-16T20:29:14+00:00 |
| Next Scan | 2026-02-14T20:29:14+00:00 |
Last Successful Scan
| Scanned | 2024-07-02T19:31:44+00:00 |
| URL | https://opticswarehouse.co.uk/robots.txt |
| Redirect | https://www.opticswarehouse.co.uk/robots.txt |
| Redirect Domain | www.opticswarehouse.co.uk |
| Redirect Base | opticswarehouse.co.uk |
| Domain IPs | 104.26.2.227, 104.26.3.227, 172.67.75.115, 2606:4700:20::681a:2e3, 2606:4700:20::681a:3e3, 2606:4700:20::ac43:4b73 |
| Redirect IPs | 104.26.2.227, 104.26.3.227, 172.67.75.115, 2606:4700:20::681a:2e3, 2606:4700:20::681a:3e3, 2606:4700:20::ac43:4b73 |
| Response IP | 172.67.75.115 |
| Found | Yes |
| Hash | 6f6b9eacfb8921e602d21834b38c4e2a5d04c8cc9a6a2d9d8144adcb46610449 |
| SimHash | 7d1fcd714a03 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /*?p= |
| Allow | /media/catalog/product/ |
| Disallow | /quickview/ |
| Disallow | /wishlist/ |
| Disallow | /magebird_popup/ |
| Disallow | /aw_store_credit/ |
| Disallow | /wishlist/ |
| Disallow | /magebird_popup/ |
| Disallow | /*filter_brand%3D* |
| Disallow | /*doing_wp_cron%3D* |
| Disallow | /*base_type%3D* |
| Disallow | /*?dir=* |
| Disallow | /*%26dir%3D* |
| Disallow | /*?mode=* |
| Disallow | /*%26mode%3D* |
| Disallow | /*?order=* |
| Disallow | /*%26order%3D* |
| Disallow | /*?p=*& |
| Disallow | /*?limit=* |
| Disallow | /*%26limit%3D* |
| Disallow | /*?price* |
| Disallow | /*%26price* |
| Disallow | /*%26price%3D* |
| Disallow | /*product_type* |
| Disallow | /*feefo_review* |
| Disallow | /*?sport* |
| Disallow | /*%26sport* |
| Disallow | /captcha/ |
| Disallow | /catalogsearch/ |
| Disallow | /catalog/product/gallery/image/ |
| Disallow | /?q=ajaxcart |
| Disallow | /catalog/ |
| Disallow | /customer/ |
| Disallow | /*?brand=* |
| Disallow | /*?* |
| Disallow | /media/resized/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.opticswarehouse.co.uk/sitemap.xml |
| sitemap | https://www.opticswarehouse.co.uk/sitemap.xml |