metanol.lv
robots.txt

Robots Exclusion Standard data for metanol.lv

Resource Scan

Scan Details

Site Domain metanol.lv
Base Domain metanol.lv
Scan Status Ok
Last Scan2024-06-12T06:57:27+00:00
Next Scan 2024-07-12T06:57:27+00:00

Last Scan

Scanned2024-06-12T06:57:27+00:00
URL http://metanol.lv/robots.txt
Domain IPs 193.109.246.19
Response IP 193.109.246.19
Found Yes
Hash 4a2d76baa2acd487b2bd0618ea2f14c4644bb180654836dca47faac7c99f9cc4
SimHash b0b805016387

Groups

*

Rule Path
Allow /*.js
Allow /*.css
Allow /*.jpg
Allow /*.png
Allow /*.gif
Allow /*?page
Allow /*?ref=
Disallow /*?
Disallow /confirm
Disallow /index/1
Disallow /index/3
Disallow /index/5
Disallow /index/7
Disallow /index/8
Disallow /index/9
Disallow /index/sub/
Disallow /panel/
Disallow /register
Disallow /register2
Disallow /verify
Disallow /stat/
Disallow /admin/
Disallow /informer/
Disallow /secure/
Disallow /poll/
Disallow /search/
Disallow /abnl/
Disallow /*_escaped_fragment_%3D
Disallow /*-*-*-*-987$
Disallow /shop/order
Disallow /shop/printorder
Disallow /shop/checkout
Disallow /shop/user
Disallow /shop/search
Disallow /*0-*-0-17$
Disallow /*-0-0-

Other Records

Field Value
sitemap http://metanol.lv/sitemap.xml