restaurantguru.com.br
robots.txt

Robots Exclusion Standard data for restaurantguru.com.br

Resource Scan

Scan Details

Site Domain restaurantguru.com.br
Base Domain restaurantguru.com.br
Scan Status Ok
Last Scan2024-09-26T08:58:14+00:00
Next Scan 2024-10-03T08:58:14+00:00

Last Scan

Scanned2024-09-26T08:58:14+00:00
URL https://restaurantguru.com.br/robots.txt
Domain IPs 104.26.4.163, 104.26.5.163, 172.67.74.71, 2606:4700:20::681a:4a3, 2606:4700:20::681a:5a3, 2606:4700:20::ac43:4a47
Response IP 104.26.5.163
Found Yes
Hash 82b795d1e270be4a42ca34e29032e6f4279fa2c654ed16f443309c4f8c6b9c02
SimHash dca9c0524371

Groups

googlebot

Rule Path
Disallow /assistant
Disallow /pierre_assistant
Disallow /image/*
Disallow /web/*
Disallow /link/*
Disallow /slink/*
Disallow /ajax/*
Disallow /user/*
Disallow /login/*
Disallow /compare/*
Disallow /search*
Disallow /*/reviews*
Disallow /*/emotions*
Disallow /*/load-menu
Disallow /get-widget*
Disallow /geohelp*
Disallow /emotions?h=*
Disallow /malls/*
Disallow /islands/*
Disallow /desktop_init*
Disallow /widget-landing?id=*
Disallow /widget-awards?id=*
Disallow /comment-widget-preview?*
Disallow /qr-menu-landing*
Disallow /award_calls/
Disallow /awards_center/
Disallow /landing/
Disallow /promo-dishes*
Allow /

googlebot-mobile

Rule Path
Disallow /image/*
Disallow /web/*
Disallow /link/*
Disallow /slink/*
Disallow /ajax/*
Disallow /user/*
Disallow /login/*
Disallow /compare/*
Disallow /search*
Disallow /*/reviews*
Disallow /*/emotions*
Disallow /*/load-menu
Disallow /get-widget*
Disallow /geohelp*
Disallow /emotions?h=*
Disallow /malls/*
Disallow /islands/*
Disallow /desktop_init*
Disallow /widget-landing?id=*
Disallow /widget-awards?id=*
Disallow /comment-widget-preview?*
Disallow /qr-menu-landing*
Disallow /award_calls/
Disallow /awards_center/
Disallow /landing/
Disallow /promo-dishes*
Allow /

mediapartners-google

Rule Path
Allow /

applebot

Rule Path
Disallow /image/*
Disallow /web/*
Disallow /link/*
Disallow /slink/*
Disallow /ajax/*
Disallow /user/*
Disallow /login/*
Disallow /compare/*
Disallow /search*
Disallow /*/reviews*
Disallow /*/emotions*
Disallow /*/load-menu
Disallow /get-widget*
Disallow /geohelp*
Disallow /emotions?h=*
Disallow /malls/*
Disallow /islands/*
Disallow /desktop_init*
Disallow /widget-landing?id=*
Disallow /widget-awards?id=*
Disallow /comment-widget-preview?*
Disallow /qr-menu-landing*
Disallow /award_calls/
Disallow /awards_center/
Disallow /landing/
Disallow /promo-dishes*
Allow /

Other Records

Field Value
crawl-delay 1

yandex

Rule Path
Disallow /image/*
Disallow /web/*
Disallow /link/*
Disallow /slink/*
Disallow /ajax/*
Disallow /user/*
Disallow /login/*
Disallow /compare/*
Disallow /search*
Disallow /*/reviews*
Disallow /*/emotions*
Disallow /*/load-menu
Disallow /get-widget*
Disallow /geohelp*
Disallow /emotions?h=*
Disallow /malls/*
Disallow /islands/*
Disallow /desktop_init*
Disallow /widget-landing?id=*
Disallow /widget-awards?id=*
Disallow /comment-widget-preview?*
Disallow /qr-menu-landing*
Disallow /award_calls/
Disallow /awards_center/
Disallow /landing/
Disallow /promo-dishes*
Allow /

twitterbot

Rule Path
Disallow /image/*
Disallow /web/*
Disallow /link/*
Disallow /ajax/*
Disallow /user/*
Disallow /login/*
Disallow /compare/*
Disallow /search*
Disallow /*/reviews*
Disallow /*/load-menu
Disallow /get-widget*
Disallow /geohelp*
Disallow /malls/*
Disallow /islands/*
Disallow /desktop_init*
Disallow /widget-landing?id=*
Disallow /widget-awards?id=*
Disallow /comment-widget-preview?*
Disallow /qr-menu-landing*
Disallow /award_calls/
Disallow /awards_center/
Disallow /landing/
Disallow /promo-dishes*
Allow /

googleother

Rule Path
Disallow /image/*
Disallow /web/*
Disallow /link/*
Disallow /slink/*
Disallow /ajax/*
Disallow /user/*
Disallow /login/*
Disallow /compare/*
Disallow /search*
Disallow /*/reviews*
Disallow /*/emotions*
Disallow /*/load-menu
Disallow /get-widget*
Disallow /geohelp*
Disallow /emotions?h=*
Disallow /amp/*
Disallow /malls/*
Disallow /islands/*
Disallow /desktop_init*
Disallow /widget-landing?id=*
Disallow /widget-awards?id=*
Disallow /comment-widget-preview?*
Disallow /qr-menu-landing*
Disallow /widget-demo*
Disallow /award_calls/
Disallow /awards_center/
Disallow /landing/
Disallow /promo-dishes*

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /image/*
Disallow /web/*
Disallow /link/*
Disallow /slink/*
Disallow /ajax/*
Disallow /user/*
Disallow /login/*
Disallow /compare/*
Disallow /search*
Disallow /*/reviews*
Disallow /*/emotions*
Disallow /*/load-menu
Disallow /get-widget*
Disallow /geohelp*
Disallow /emotions?h=*
Disallow /amp/*
Disallow /malls/*
Disallow /islands/*
Disallow /desktop_init*
Disallow /widget-landing?id=*
Disallow /widget-awards?id=*
Disallow /comment-widget-preview?*
Disallow /qr-menu-landing*
Disallow /widget-demo*
Disallow /award_calls/
Disallow /awards_center/
Disallow /landing/
Disallow /promo-dishes*

Other Records

Field Value
crawl-delay 1

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10