hunting.ru
robots.txt
Robots Exclusion Standard data for hunting.ru
Resource Scan
Scan Details
| Site Domain | hunting.ru |
| Base Domain | hunting.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-14T11:09:14+00:00 |
| Next Scan | 2024-11-21T11:09:14+00:00 |
Last Scan
| Scanned | 2024-11-14T11:09:14+00:00 |
| URL | https://hunting.ru/robots.txt |
| Redirect | https://www.hunting.ru/robots.txt |
| Redirect Domain | www.hunting.ru |
| Redirect Base | hunting.ru |
| Domain IPs | 104.26.8.236, 104.26.9.236, 172.67.71.116, 2606:4700:20::681a:8ec, 2606:4700:20::681a:9ec, 2606:4700:20::ac43:4774 |
| Redirect IPs | 104.26.8.236, 104.26.9.236, 172.67.71.116, 2606:4700:20::681a:8ec, 2606:4700:20::681a:9ec, 2606:4700:20::ac43:4774 |
| Response IP | 104.26.9.236 |
| Found | Yes |
| Hash | fb0347a519149e6fe949c930a0813f723aec9a18688b6baeacb9e761a5068ae5 |
| SimHash | e901c0f76252 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */complain/* |
| Disallow | */vote/* |
| Disallow | /comments/* |
| Disallow | /users/all/sort* |
| Disallow | /users/?* |
| Disallow | /users/dnevnik* |
| Disallow | /users/login/*url_referer%3D* |
| Disallow | /users/all/page* |
| Disallow | /forum/search/* |
| Disallow | /forum/members/* |
| Disallow | /forum_new/* |
| Disallow | /forum/find-new/* |
| Disallow | */add-reply* |
| Disallow | */reply* |
| Disallow | /hybrid_auth/* |
| Disallow | */undefined |
| Disallow | /forum/birthdaycalendar/ |
| Disallow | /forum/help/* |
| Disallow | /forum/misc/* |
| Disallow | /forum/proxy.php* |
| Disallow | */mark-read* |
| Disallow | /forum/watched/* |
| Disallow | /search/*?* |
| Disallow | /forum/online/ |
| Disallow | /video/tag/* |
| Disallow | /blogs/tag/* |
| Disallow | /news/tag/* |
| Disallow | */no-text* |
| Disallow | /forum/javascript* |
| Disallow | /pages |
| Disallow | /subscribe |
| Disallow | */poll/results* |
| Disallow | /users/recover/ |
| Disallow | /lenta-of-records* |
| Disallow | /record-wire* |
| Disallow | /new-on-forum* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.hunting.ru/sitemap/sitemap_articles.xml |
| sitemap | https://www.hunting.ru/sitemap/sitemap_blogs.xml |
| sitemap | https://www.hunting.ru/sitemap/sitemap_gallery.xml |
| sitemap | https://www.hunting.ru/sitemap/sitemap_reports.xml |
| sitemap | https://www.hunting.ru/sitemap/sitemap_tidings.xml |
| sitemap | https://www.hunting.ru/sitemap/sitemap_video.xml |
| sitemap | https://www.hunting.ru/sitemap/sitemap_news.xml |
| sitemap | https://www.hunting.ru/forum/sitemap.php |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.
Comments