Log In Sign Up

restaurantguru.ru
robots.txt

Robots Exclusion Standard data for restaurantguru.ru

Resource Scan

Scan Details

Site Domain restaurantguru.ru
Base Domain restaurantguru.ru
Scan Status Ok
Last Scan2024-09-30T04:10:32+00:00
Next Scan 2024-10-07T04:10:32+00:00

Last Scan

Scanned2024-09-30T04:10:32+00:00
URL https://restaurantguru.ru/robots.txt
Domain IPs 104.26.12.52, 104.26.13.52, 172.67.70.26, 2606:4700:20::681a:c34, 2606:4700:20::681a:d34, 2606:4700:20::ac43:461a
Response IP 104.26.13.52
Found Yes
Hash 82b795d1e270be4a42ca34e29032e6f4279fa2c654ed16f443309c4f8c6b9c02
SimHash dca9c0524371

Groups

googlebot

Rule Path
Disallow /assistant
Disallow /pierre_assistant
Disallow /image/*
Disallow /web/*
Disallow /link/*
Disallow /slink/*
Disallow /ajax/*
Disallow /user/*
Disallow /login/*
Disallow /compare/*
Disallow /search*
Disallow /*/reviews*
Disallow /*/emotions*
Disallow /*/load-menu
Disallow /get-widget*
Disallow /geohelp*
Disallow /emotions?h=*
Disallow /malls/*
Disallow /islands/*
Disallow /desktop_init*
Disallow /widget-landing?id=*
Disallow /widget-awards?id=*
Disallow /comment-widget-preview?*
Disallow /qr-menu-landing*
Disallow /award_calls/
Disallow /awards_center/
Disallow /landing/
Disallow /promo-dishes*
Allow /

googlebot-mobile

Rule Path
Disallow /image/*
Disallow /web/*
Disallow /link/*
Disallow /slink/*
Disallow /ajax/*
Disallow /user/*
Disallow /login/*
Disallow /compare/*
Disallow /search*
Disallow /*/reviews*
Disallow /*/emotions*
Disallow /*/load-menu
Disallow /get-widget*
Disallow /geohelp*
Disallow /emotions?h=*
Disallow /malls/*
Disallow /islands/*
Disallow /desktop_init*
Disallow /widget-landing?id=*
Disallow /widget-awards?id=*
Disallow /comment-widget-preview?*
Disallow /qr-menu-landing*
Disallow /award_calls/
Disallow /awards_center/
Disallow /landing/
Disallow /promo-dishes*
Allow /

mediapartners-google

Rule Path
Allow /

applebot

Rule Path
Disallow /image/*
Disallow /web/*
Disallow /link/*
Disallow /slink/*
Disallow /ajax/*
Disallow /user/*
Disallow /login/*
Disallow /compare/*
Disallow /search*
Disallow /*/reviews*
Disallow /*/emotions*
Disallow /*/load-menu
Disallow /get-widget*
Disallow /geohelp*
Disallow /emotions?h=*
Disallow /malls/*
Disallow /islands/*
Disallow /desktop_init*
Disallow /widget-landing?id=*
Disallow /widget-awards?id=*
Disallow /comment-widget-preview?*
Disallow /qr-menu-landing*
Disallow /award_calls/
Disallow /awards_center/
Disallow /landing/
Disallow /promo-dishes*
Allow /

Other Records

Field Value
crawl-delay 1

yandex

Rule Path
Disallow /image/*
Disallow /web/*
Disallow /link/*
Disallow /slink/*
Disallow /ajax/*
Disallow /user/*
Disallow /login/*
Disallow /compare/*
Disallow /search*
Disallow /*/reviews*
Disallow /*/emotions*
Disallow /*/load-menu
Disallow /get-widget*
Disallow /geohelp*
Disallow /emotions?h=*
Disallow /malls/*
Disallow /islands/*
Disallow /desktop_init*
Disallow /widget-landing?id=*
Disallow /widget-awards?id=*
Disallow /comment-widget-preview?*
Disallow /qr-menu-landing*
Disallow /award_calls/
Disallow /awards_center/
Disallow /landing/
Disallow /promo-dishes*
Allow /

twitterbot

Rule Path
Disallow /image/*
Disallow /web/*
Disallow /link/*
Disallow /ajax/*
Disallow /user/*
Disallow /login/*
Disallow /compare/*
Disallow /search*
Disallow /*/reviews*
Disallow /*/load-menu
Disallow /get-widget*
Disallow /geohelp*
Disallow /malls/*
Disallow /islands/*
Disallow /desktop_init*
Disallow /widget-landing?id=*
Disallow /widget-awards?id=*
Disallow /comment-widget-preview?*
Disallow /qr-menu-landing*
Disallow /award_calls/
Disallow /awards_center/
Disallow /landing/
Disallow /promo-dishes*
Allow /

googleother

Rule Path
Disallow /image/*
Disallow /web/*
Disallow /link/*
Disallow /slink/*
Disallow /ajax/*
Disallow /user/*
Disallow /login/*
Disallow /compare/*
Disallow /search*
Disallow /*/reviews*
Disallow /*/emotions*
Disallow /*/load-menu
Disallow /get-widget*
Disallow /geohelp*
Disallow /emotions?h=*
Disallow /amp/*
Disallow /malls/*
Disallow /islands/*
Disallow /desktop_init*
Disallow /widget-landing?id=*
Disallow /widget-awards?id=*
Disallow /comment-widget-preview?*
Disallow /qr-menu-landing*
Disallow /widget-demo*
Disallow /award_calls/
Disallow /awards_center/
Disallow /landing/
Disallow /promo-dishes*

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /image/*
Disallow /web/*
Disallow /link/*
Disallow /slink/*
Disallow /ajax/*
Disallow /user/*
Disallow /login/*
Disallow /compare/*
Disallow /search*
Disallow /*/reviews*
Disallow /*/emotions*
Disallow /*/load-menu
Disallow /get-widget*
Disallow /geohelp*
Disallow /emotions?h=*
Disallow /amp/*
Disallow /malls/*
Disallow /islands/*
Disallow /desktop_init*
Disallow /widget-landing?id=*
Disallow /widget-awards?id=*
Disallow /comment-widget-preview?*
Disallow /qr-menu-landing*
Disallow /widget-demo*
Disallow /award_calls/
Disallow /awards_center/
Disallow /landing/
Disallow /promo-dishes*

Other Records

Field Value
crawl-delay 1

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top