be-in.ru
robots.txt
Robots Exclusion Standard data for be-in.ru
Resource Scan
Scan Details
| Site Domain | be-in.ru |
| Base Domain | be-in.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-14T20:27:13+00:00 |
| Next Scan | 2024-11-21T20:27:13+00:00 |
Last Scan
| Scanned | 2024-11-14T20:27:13+00:00 |
| URL | https://be-in.ru/robots.txt |
| Redirect | https://www.be-in.ru/robots.txt |
| Redirect Domain | www.be-in.ru |
| Redirect Base | be-in.ru |
| Domain IPs | 104.26.12.200, 104.26.13.200, 172.67.70.209, 2606:4700:20::681a:cc8, 2606:4700:20::681a:dc8, 2606:4700:20::ac43:46d1 |
| Redirect IPs | 104.26.12.200, 104.26.13.200, 172.67.70.209, 2606:4700:20::681a:cc8, 2606:4700:20::681a:dc8, 2606:4700:20::ac43:46d1 |
| Response IP | 172.67.70.209 |
| Found | Yes |
| Hash | fbc2119051f739cacdd8484cbdd44209bb80887ccb55a27169f36bffc8f958ca |
| SimHash | 5f51ad04ec31 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /ajax/ |
| Disallow | /api/ |
| Disallow | /banners/ |
| Disallow | /associate/ |
| Disallow | /cabinet/ |
| Disallow | /click_fashion/ |
| Disallow | /click_recomended_network/ |
| Disallow | /click/ |
| Disallow | /complete/ |
| Disallow | /core/ |
| Disallow | /disconnect/ |
| Disallow | /filter/ |
| Disallow | /forgot-password/ |
| Disallow | /banners/get_banner/ |
| Disallow | /login/ |
| Disallow | /logout/ |
| Disallow | /newsletter/ |
| Disallow | /personal/ |
| Disallow | /search/ |
| Disallow | /select2/ |
| Disallow | /send-activity/ |
| Disallow | /socialauth/complete/ |
| Disallow | /tinymce/ |
| Disallow | /user-activity/ |
| Disallow | /go/ |
| Disallow | /cart/ |
| Disallow | /order/ |
| Disallow | /other-cities-network/ |
| Disallow | /likes/ajax/like/ |
| Disallow | *thing*page%3D |
| Disallow | /brands/*/collection/?page= |
| Disallow | /catalog/city/*/type/*page%3D |
| Disallow | /catalog/city/*/kind/*page%3D |
| Allow | /catalog/city/*/type/*/prices/ |
| Disallow | /network/*-collection/*page%3D |
| Disallow | /mall/*page%3D |
| Disallow | /mall/*/collection-kind/*page%3D |
| Disallow | /mall/*/collection-type/*page%3D |
| Disallow | */target/ |
| Disallow | /word/*page%3D |
| Disallow | *sm_byp |
| Disallow | *fb_comment_id |
| Disallow | *fb_xd_fragment |
| Disallow | */amp/ |
| Disallow | *cid%3D |
| Disallow | *android-app |
| Disallow | *com.google.android |
| Disallow | *fb_ |
| Disallow | *search%3D |
| Disallow | *searchid%3D |
| Disallow | *sa%3D |
| Disallow | *cx%3D |
| Disallow | *sqi%3D |
| Disallow | *search_text%3D |
| Disallow | *price%3D |
| Disallow | *wtf_ |
yandex
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /ajax/ |
| Disallow | /api/ |
| Disallow | /banners/ |
| Disallow | /associate/ |
| Disallow | /cabinet/ |
| Disallow | /click_fashion/ |
| Disallow | /click_recomended_network/ |
| Disallow | /click/ |
| Disallow | /complete/ |
| Disallow | /core/ |
| Disallow | /disconnect/ |
| Disallow | /filter/ |
| Disallow | /forgot-password/ |
| Disallow | /banners/get_banner/ |
| Disallow | /login/ |
| Disallow | /logout/ |
| Disallow | /newsletter/ |
| Disallow | /personal/ |
| Disallow | /search/ |
| Disallow | /select2/ |
| Disallow | /send-activity/ |
| Disallow | /socialauth/complete/ |
| Disallow | /tinymce/ |
| Disallow | /user-activity/ |
| Disallow | /go/ |
| Disallow | /cart/ |
| Disallow | /order/ |
| Disallow | /other-cities-network/ |
| Disallow | /likes/ajax/like/ |
| Disallow | *thing*page%3D |
| Disallow | /brands/*/collection/?page= |
| Disallow | /catalog/city/*/type/*page%3D |
| Disallow | /catalog/city/*/kind/*page%3D |
| Allow | /catalog/city/*/type/*/prices/ |
| Disallow | /network/*-collection/*page%3D |
| Disallow | /mall/*page%3D |
| Disallow | /mall/*/collection-kind/*page%3D |
| Disallow | /mall/*/collection-type/*page%3D |
| Disallow | */target/ |
| Disallow | /word/*page%3D |
| Disallow | *sm_byp |
| Disallow | *fb_comment_id |
| Disallow | *fb_xd_fragment |
| Disallow | */amp/ |
| Disallow | *cid%3D |
| Disallow | *android-app |
| Disallow | *com.google.android |
| Disallow | *fb_ |
| Disallow | *search%3D |
| Disallow | *searchid%3D |
| Disallow | *sa%3D |
| Disallow | *cx%3D |
| Disallow | *sqi%3D |
| Disallow | *search_text%3D |
| Disallow | *price%3D |
| Disallow | *wtf_ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.be-in.ru/sitemap.xml |
| sitemap | https://www.be-in.ru/sitemap.xml |
Warnings
- `host` is not a known field.