b17.ru
robots.txt
Robots Exclusion Standard data for b17.ru
Resource Scan
Scan Details
Site Domain | b17.ru |
Base Domain | b17.ru |
Scan Status | Ok |
Last Scan | 2024-06-28T06:54:38+00:00 |
Next Scan | 2024-07-12T06:54:38+00:00 |
Last Scan
Scanned | 2024-06-28T06:54:38+00:00 |
URL | https://b17.ru/robots.txt |
Redirect | https://www.b17.ru/robots.txt |
Redirect Domain | www.b17.ru |
Redirect Base | b17.ru |
Domain IPs | 104.22.12.217, 104.22.13.217, 172.67.15.140, 2606:4700:10::6816:cd9, 2606:4700:10::6816:dd9, 2606:4700:10::ac43:f8c |
Redirect IPs | 104.22.12.217, 104.22.13.217, 172.67.15.140, 2606:4700:10::6816:cd9, 2606:4700:10::6816:dd9, 2606:4700:10::ac43:f8c |
Response IP | 172.67.15.140 |
Found | Yes |
Hash | 3aef01878fd7b08a25d3a26d2cd2824ef2bf6f5d9e6e9f01abdcabc5e78933ed |
SimHash | 22df9be889b9 |
Groups
*
Rule | Path |
---|---|
Disallow | /*printmod%3D1 |
Disallow | /away.php |
Disallow | /away_image.php |
Disallow | /article.php |
Disallow | /article/*abc%3D |
Disallow | /article/*best%3D |
Disallow | /article/*fav%3D |
Disallow | /article/*mod%3D |
Disallow | /article/*tag%3D |
Disallow | /article/*sort%3D |
Disallow | /articles/*tag%3D |
Disallow | /articles/*razdel%3D |
Disallow | /article_print.php |
Disallow | /articles_external.php |
Disallow | /export_pdf.php |
Disallow | /bookmark.php |
Disallow | /books.php |
Disallow | /blog/*tag%3D |
Disallow | /blog/*best%3D |
Disallow | /blogs/*razdel%3D |
Disallow | /center_pay.php |
Disallow | /city_map.php |
Disallow | /chat.php |
Disallow | /consultation.php |
Disallow | /complaint.php |
Disallow | /comments.php |
Disallow | /courses/*tag%3D |
Disallow | /courses/*m%3D |
Disallow | /courses_file.php |
Disallow | /click.php |
Disallow | /dic/?search |
Disallow | /events/*tag%3D |
Disallow | /journal/*tag%3D |
Disallow | /forum/consultation_pay.php |
Disallow | /forum/forum_face.php |
Disallow | /forum/topic_print.php |
Disallow | /forum/post.php |
Disallow | /forum/*filter%3D |
Disallow | /forum/*search%3D |
Disallow | /forum/?f=* |
Disallow | /forum/?f_tip=* |
Disallow | /forum/topic*p%3Dall |
Disallow | /forum/topic*p%3D1000 |
Disallow | /forum/topic*vote_result%3D |
Disallow | /forum/topic*light%3D |
Disallow | /forum/topic_del.php |
Disallow | /forum/message_id.php |
Disallow | /forum/?mod=question |
Disallow | /forum/?mod=activ |
Disallow | /forum/?mod=search |
Disallow | /forum/foto/ |
Disallow | /foto/article/ |
Disallow | /foto/blog/ |
Disallow | /foto/away/ |
Disallow | /foto/comments/ |
Disallow | /foto/rkl/ |
Disallow | /foto/uploaded/ |
Disallow | /foto/uploaded_auto/ |
Disallow | /foto/qr/ |
Disallow | /foto/vuz/ |
Disallow | /js/ |
Disallow | /login.php |
Disallow | /login_fb.php |
Disallow | /login_vk.php |
Disallow | /login_recover.php |
Disallow | /masters.php |
Disallow | /masters/ |
Disallow | /masters_history.php |
Disallow | /media_load.php |
Disallow | /media/*tag%3D |
Disallow | /misc.php |
Disallow | /mailto%3A |
Disallow | /my.php |
Disallow | /online.php |
Disallow | /online/*tag%3D |
Disallow | /organizations/*search%3D |
Disallow | /pay.php |
Disallow | /pay_to.php |
Disallow | /profile.php |
Disallow | /privat.php |
Disallow | /photo.php?foto= |
Disallow | /psiholog/*fav%3D |
Disallow | /psiholog/*location%3D |
Disallow | /psiholog/*page_plus%3D |
Disallow | /psiholog/*price1%3D |
Disallow | /psiholog/*price2%3D |
Disallow | /psiholog/*sex%3D |
Disallow | /psiholog/*tag%3D |
Disallow | /psiholog/*%2C |
Disallow | /record.php |
Disallow | /register.php |
Disallow | /_search.php |
Disallow | /search.php |
Disallow | /status_info.php |
Disallow | /supervision/*tag%3D |
Disallow | /supervision/*sex%3D |
Disallow | /supervision/*metod%3D |
Disallow | /tests/?result= |
Disallow | /tests/?user= |
Disallow | /tests/?search= |
Disallow | /training/*fav%3D |
Disallow | /training/*tag%3D |
Disallow | /training_kalendar.php |
Disallow | /telefon_backend.php |
Disallow | /my_*.php |
Disallow | /bl_*.php |
Disallow | /bl_ |
Disallow | */*sort%3D |
Disallow | /index.php |
Disallow | /help/ |
Disallow | /unsubscribe.php |
Disallow | /video_backend.php |
Disallow | /webinar/*tag%3D |
Disallow | /zayavka.php |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
yandex
Rule | Path |
---|---|
Disallow | /*printmod%3D1 |
Disallow | /away.php |
Disallow | /away_image.php |
Disallow | /article.php |
Disallow | /article/*abc%3D |
Disallow | /article/*best%3D |
Disallow | /article/*fav%3D |
Disallow | /article/*mod%3D |
Disallow | /article/*tag%3D |
Disallow | /article/*sort%3D |
Disallow | /articles/*tag%3D |
Disallow | /articles/*razdel%3D |
Disallow | /article_print.php |
Disallow | /articles_external.php |
Disallow | /export_pdf.php |
Disallow | /bookmark.php |
Disallow | /books.php |
Disallow | /blog/*tag%3D |
Disallow | /blog/*best%3D |
Disallow | /blogs/*razdel%3D |
Disallow | /center_pay.php |
Disallow | /city_map.php |
Disallow | /chat.php |
Disallow | /consultation.php |
Disallow | /complaint.php |
Disallow | /comments.php |
Disallow | /courses/*tag%3D |
Disallow | /courses/*m%3D |
Disallow | /courses_file.php |
Disallow | /click.php |
Disallow | /dic/?search |
Disallow | /events/*tag%3D |
Disallow | /journal/*tag%3D |
Disallow | /forum/consultation_pay.php |
Disallow | /forum/forum_face.php |
Disallow | /forum/topic_print.php |
Disallow | /forum/post.php |
Disallow | /forum/*filter%3D |
Disallow | /forum/*search%3D |
Disallow | /forum/?f=* |
Disallow | /forum/?f_tip=* |
Disallow | /forum/topic*p%3Dall |
Disallow | /forum/topic*p%3D1000 |
Disallow | /forum/topic*vote_result%3D |
Disallow | /forum/topic*light%3D |
Disallow | /forum/topic_del.php |
Disallow | /forum/message_id.php |
Disallow | /forum/?mod=question |
Disallow | /forum/?mod=activ |
Disallow | /forum/?mod=search |
Disallow | /forum/foto/ |
Disallow | /foto/article/ |
Disallow | /foto/blog/ |
Disallow | /foto/away/ |
Disallow | /foto/comments/ |
Disallow | /foto/rkl/ |
Disallow | /foto/uploaded/ |
Disallow | /foto/uploaded_auto/ |
Disallow | /foto/qr/ |
Disallow | /foto/vuz/ |
Disallow | /js/ |
Disallow | /login.php |
Disallow | /login_fb.php |
Disallow | /login_vk.php |
Disallow | /login_recover.php |
Disallow | /masters.php |
Disallow | /masters/ |
Disallow | /masters_history.php |
Disallow | /media_load.php |
Disallow | /media/*tag%3D |
Disallow | /misc.php |
Disallow | /mailto%3A |
Disallow | /my.php |
Disallow | /online.php |
Disallow | /online/*tag%3D |
Disallow | /organizations/*search%3D |
Disallow | /pay.php |
Disallow | /pay_to.php |
Disallow | /profile.php |
Disallow | /privat.php |
Disallow | /photo.php?foto= |
Disallow | /psiholog/*fav%3D |
Disallow | /psiholog/*location%3D |
Disallow | /psiholog/*page_plus%3D |
Disallow | /psiholog/*price1%3D |
Disallow | /psiholog/*price2%3D |
Disallow | /psiholog/*sex%3D |
Disallow | /psiholog/*tag%3D |
Disallow | /psiholog/*%2C |
Disallow | /record.php |
Disallow | /register.php |
Disallow | /_search.php |
Disallow | /search.php |
Disallow | /status_info.php |
Disallow | /supervision/*tag%3D |
Disallow | /supervision/*sex%3D |
Disallow | /supervision/*metod%3D |
Disallow | /tests/?result= |
Disallow | /tests/?user= |
Disallow | /tests/?search= |
Disallow | /training/*fav%3D |
Disallow | /training/*tag%3D |
Disallow | /training_kalendar.php |
Disallow | /telefon_backend.php |
Disallow | /my_*.php |
Disallow | /bl_*.php |
Disallow | /bl_*/ |
Disallow | */*sort%3D |
Disallow | /index.php |
Disallow | /help/ |
Disallow | /unsubscribe.php |
Disallow | /video_backend.php |
Disallow | /webinar/*tag%3D |
Disallow | /zayavka.php |
Other Records
Field | Value |
---|---|
crawl-delay | 0.6 |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.