android-1.ru
robots.txt
Robots Exclusion Standard data for android-1.ru
Resource Scan
Scan Details
Site Domain | android-1.ru |
Base Domain | android-1.ru |
Scan Status | Ok |
Last Scan | 2024-11-14T02:53:56+00:00 |
Next Scan | 2024-11-21T02:53:56+00:00 |
Last Scan
Scanned | 2024-11-14T02:53:56+00:00 |
URL | https://android-1.ru/robots.txt |
Domain IPs | 104.26.12.119, 104.26.13.119, 172.67.70.172, 2606:4700:20::681a:c77, 2606:4700:20::681a:d77, 2606:4700:20::ac43:46ac |
Response IP | 172.67.70.172 |
Found | Yes |
Hash | 399e3ae85642a3d6dbe0b6c6137b9103c497688723f8a0ddbcb7b981353f23c6 |
SimHash | 1980a9125c23 |
Groups
*
Rule | Path |
---|---|
Disallow | /engine/* |
Disallow | /user/* |
Disallow | /*do%3Dsearch |
Disallow | /search/* |
Disallow | /download/* |
Disallow | /lastnews/* |
Disallow | /newposts/* |
Disallow | /favorites/ |
Disallow | /rules.html |
Disallow | /statistics.html |
Disallow | /addnews.html |
Disallow | /*do%3D* |
Disallow | /*__cf_chl_managed_tk__%3D* |
Disallow | /*ref%3D* |
Disallow | /*target%3D* |
Disallow | /*refer_uri_app%3D* |
Disallow | /*author%3D* |
Disallow | /*hl%3D* |
Disallow | /*ya_url%3D* |
Disallow | /*__cf_chl_captcha_tk__%3D* |
Allow | /xfsearch/ |
Allow | /engine/classes/js/ |
Allow | /engine/classes/min/index.php |
Allow | /engine/data/emoticons/ |
Allow | /engine/classes/*.css |
Allow | /engine/classes/*.js |
Allow | /templates/androidus-warm/style/*.css |
Allow | /templates/androidus-warm/js/*.js |
Other Records
Field | Value |
---|---|
sitemap | https://android-1.ru/sitemap.xml |
sitemap | https://android-1.ru/google_news.xml |
Warnings
- `host` is not a known field.