restaurantguru.ru
robots.txt
Robots Exclusion Standard data for restaurantguru.ru
Resource Scan
Scan Details
| Site Domain | restaurantguru.ru |
| Base Domain | restaurantguru.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-12T06:39:40+00:00 |
| Next Scan | 2024-11-19T06:39:40+00:00 |
Last Scan
| Scanned | 2024-11-12T06:39:40+00:00 |
| URL | https://restaurantguru.ru/robots.txt |
| Domain IPs | 104.26.12.52, 104.26.13.52, 172.67.70.26, 2606:4700:20::681a:c34, 2606:4700:20::681a:d34, 2606:4700:20::ac43:461a |
| Response IP | 172.67.70.26 |
| Found | Yes |
| Hash | 62990e0389167cde6356bff6e9576c8b345f4a5c516566cff47a3b3f66a054c0 |
| SimHash | dc81c1504171 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /assistant |
| Disallow | /pierre_assistant |
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /slink/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /emotions?h=* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
| Allow | / |
googlebot-mobile
| Rule | Path |
|---|---|
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /slink/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /emotions?h=* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
| Allow | / |
applebot
| Rule | Path |
|---|---|
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /slink/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /emotions?h=* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
yandex
| Rule | Path |
|---|---|
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /slink/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /emotions?h=* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
| Allow | / |
twitterbot
| Rule | Path |
|---|---|
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
| Allow | / |
googleother
| Rule | Path |
|---|---|
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /slink/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /emotions?h=* |
| Disallow | /amp/* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /widget-demo* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
*
| Rule | Path |
|---|---|
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /slink/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /emotions?h=* |
| Disallow | /amp/* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /widget-demo* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |