aster.kz
robots.txt
Robots Exclusion Standard data for aster.kz
Resource Scan
Scan Details
Site Domain | aster.kz |
Base Domain | aster.kz |
Scan Status | Ok |
Last Scan | 2024-11-16T08:03:30+00:00 |
Next Scan | 2024-11-23T08:03:30+00:00 |
Last Scan
Scanned | 2024-11-16T08:03:30+00:00 |
URL | https://aster.kz/robots.txt |
Domain IPs | 5.35.105.113 |
Response IP | 5.35.105.113 |
Found | Yes |
Hash | 2f800accda02c2eca29dd741fe1168c581f7cde74cb24d6accf8f084f87c75ad |
SimHash | 885d1de63f93 |
Groups
*
Rule | Path |
---|---|
Disallow | /template/ |
Disallow | /cabinet/ |
Disallow | /favorites/ |
Disallow | /intro/ |
Disallow | /offline-adv/ |
Disallow | /verify-email/ |
Disallow | /emails/ |
Disallow | /*utm_source* |
Disallow | /500 |
Disallow | /aster-check-found* |
Disallow | /aster-check-full-report* |
Disallow | /aster-check-notfound* |
Disallow | /aster-check-pc* |
Disallow | /c2c/ |
Disallow | /c2c-owner/ |
Disallow | /credit/get* |
Disallow | /online-assessment/get* |
Disallow | /price-drop* |
Other Records
Field | Value |
---|---|
sitemap | https://aster.kz/sitemap.xml |
Warnings
- `clean-param` is not a known field.