greenlist.kz
robots.txt
Robots Exclusion Standard data for greenlist.kz
Resource Scan
Scan Details
Site Domain | greenlist.kz |
Base Domain | greenlist.kz |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-08-30T10:33:50+00:00 |
Next Scan | 2024-11-28T10:33:50+00:00 |
Last Successful Scan
Scanned | 2024-04-10T10:14:21+00:00 |
URL | http://greenlist.kz/robots.txt |
Domain IPs | 185.125.91.90 |
Response IP | 185.125.91.90 |
Found | Yes |
Hash | cbdf589b15d530b41a99411e2542b2391ebfe5a5f45b9568bb8f6640b98ab9fd |
SimHash | 538fd272c995 |
Groups
*
Rule | Path |
---|---|
Disallow | /*/?lit= |
Disallow | /*/?param |
Disallow | /*/*page%3D1* |
Disallow | /*/map/ |
Disallow | /*/public |
Allow | /*/public/prodazha-biznesa-internet-proekta |
Disallow | /*/poisk |
Other Records
Field | Value |
---|---|
crawl-delay | 50 |
Other Records
Field | Value |
---|---|
sitemap | http://greenlist.kz/sitemap.xml |
Warnings
- `host` is not a known field.