tomasgold.lt
robots.txt
Robots Exclusion Standard data for tomasgold.lt
Resource Scan
Scan Details
| Site Domain | tomasgold.lt |
| Base Domain | tomasgold.lt |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-01-03T21:44:33+00:00 |
| Next Scan | 2026-02-02T21:44:33+00:00 |
Last Successful Scan
| Scanned | 2025-10-20T05:15:24+00:00 |
| URL | https://tomasgold.lt/robots.txt |
| Domain IPs | 104.21.53.20, 172.67.207.199, 2606:4700:3036::6815:3514, 2606:4700:3036::ac43:cfc7 |
| Response IP | 104.21.53.20 |
| Found | Yes |
| Hash | 795f4e0012e251bf919391db28f76369ac9eb6629d666fdefc14db5c3b4df579 |
| SimHash | 4a514d46e2f0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*%26limit |
| Disallow | /*?limit |
| Disallow | /*?sort |
| Disallow | /*%26sort |
| Disallow | /*?order |
| Disallow | /*%26order |
| Disallow | /*?price |
| Disallow | /*%26price |
| Disallow | /*?brand_tabletpc |
| Disallow | /*%26brand_tabletpc |
| Disallow | /*?color_default |
| Disallow | /*%26color_default |
| Disallow | /*?filter_tag |
| Disallow | /*%26filter_tag |
| Disallow | /*?filter_name= |
| Disallow | /*%26filter_name%3D |
| Disallow | /*?filter_sub_category= |
| Disallow | /*%26filter_sub_category%3D |
| Disallow | /*?filter_description= |
| Disallow | /*%26filter_description%3D |
| Disallow | /*?mode |
| Disallow | /*%26mode |
| Disallow | /*?cat |
| Disallow | /*%26cat |
| Disallow | /*?dir |
| Disallow | /*%26dir |
| Disallow | /*?color |
| Disallow | /*%26color |
| Disallow | /*?product_id |
| Disallow | /*%26product_id |
| Disallow | /*?minprice |
| Disallow | /*%26minprice |
| Disallow | /*?maxprice |
| Disallow | /*%26maxprice |
| Disallow | /*?route=checkout%2F |
| Disallow | /*?route=account%2F |
| Disallow | /*?route=product%2Fsearch |
| Disallow | /*%26route%3Dproduct/search |
| Disallow | /*?search= |
| Disallow | /*%26search%3D |
| Disallow | /*?tag= |
| Disallow | /*%26tag%3D |
| Disallow | /*?lang= |
| Disallow | /*%26lang%3D |
| Disallow | /*?sort_order= |
| Disallow | /*%26sort_order%3D |
| Disallow | /*?order= |
| Disallow | /*%26order%3D |
| Disallow | /*?limit= |
| Disallow | /*%26limit%3D |
| Disallow | /admin/ |
| Disallow | /system/ |
| Disallow | /control69/ |
| Disallow | /*?keyword |
| Disallow | /*?av |
| Disallow | /*?route=affiliate%2F |
| Disallow | /*%26create%3D1 |
| Allow | /image/ |
| Allow | /*.css$ |
| Allow | /*.js$ |
| Allow | /*.svg$ |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://tomasgold.lt/sitemap.xml |