restaurantguru.it
robots.txt
Robots Exclusion Standard data for restaurantguru.it
Resource Scan
Scan Details
| Site Domain | restaurantguru.it |
| Base Domain | restaurantguru.it |
| Scan Status | Ok |
| Last Scan | 2024-10-31T10:10:53+00:00 |
| Next Scan | 2024-11-07T10:10:53+00:00 |
Last Scan
| Scanned | 2024-10-31T10:10:53+00:00 |
| URL | https://restaurantguru.it/robots.txt |
| Domain IPs | 104.26.4.141, 104.26.5.141, 172.67.72.180, 2606:4700:20::681a:48d, 2606:4700:20::681a:58d, 2606:4700:20::ac43:48b4 |
| Response IP | 104.26.4.141 |
| Found | Yes |
| Hash | 82b795d1e270be4a42ca34e29032e6f4279fa2c654ed16f443309c4f8c6b9c02 |
| SimHash | dca9c0524371 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /assistant |
| Disallow | /pierre_assistant |
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /slink/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/emotions* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /emotions?h=* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
| Allow | / |
googlebot-mobile
| Rule | Path |
|---|---|
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /slink/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/emotions* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /emotions?h=* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
| Allow | / |
applebot
| Rule | Path |
|---|---|
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /slink/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/emotions* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /emotions?h=* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
yandex
| Rule | Path |
|---|---|
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /slink/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/emotions* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /emotions?h=* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
| Allow | / |
twitterbot
| Rule | Path |
|---|---|
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
| Allow | / |
googleother
| Rule | Path |
|---|---|
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /slink/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/emotions* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /emotions?h=* |
| Disallow | /amp/* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /widget-demo* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
*
| Rule | Path |
|---|---|
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /slink/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/emotions* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /emotions?h=* |
| Disallow | /amp/* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /widget-demo* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |