restaurant-guru.in
robots.txt
Robots Exclusion Standard data for restaurant-guru.in
Resource Scan
Scan Details
| Site Domain | restaurant-guru.in |
| Base Domain | restaurant-guru.in |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-09-17T23:22:15+00:00 |
| Next Scan | 2024-12-16T23:22:15+00:00 |
Last Successful Scan
| Scanned | 2024-05-21T18:58:39+00:00 |
| URL | https://restaurant-guru.in/robots.txt |
| Domain IPs | 34.49.210.248 |
| Response IP | 34.49.210.248 |
| Found | Yes |
| Hash | b28a7127bd23244ef309e8bd92bb38e743a2cac2182e046e4b0626167850c6bd |
| SimHash | d081c0504771 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /slink/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/emotions* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /emotions?h=* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
| Allow | / |
googlebot-mobile
| Rule | Path |
|---|---|
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /slink/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/emotions* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /emotions?h=* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
| Allow | / |
applebot
| Rule | Path |
|---|---|
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /slink/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/emotions* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /emotions?h=* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
yandex
| Rule | Path |
|---|---|
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /slink/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/emotions* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /emotions?h=* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
| Allow | / |
twitterbot
| Rule | Path |
|---|---|
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /image/* |
| Disallow | /web/* |
| Disallow | /link/* |
| Disallow | /slink/* |
| Disallow | /ajax/* |
| Disallow | /user/* |
| Disallow | /login/* |
| Disallow | /compare/* |
| Disallow | /search* |
| Disallow | /*/reviews* |
| Disallow | /*/emotions* |
| Disallow | /*/load-menu |
| Disallow | /get-widget* |
| Disallow | /geohelp* |
| Disallow | /emotions?h=* |
| Disallow | /amp/* |
| Disallow | /malls/* |
| Disallow | /islands/* |
| Disallow | /desktop_init* |
| Disallow | /widget-landing?id=* |
| Disallow | /widget-awards?id=* |
| Disallow | /comment-widget-preview?* |
| Disallow | /qr-menu-landing* |
| Disallow | /widget-demo* |
| Disallow | /award_calls/ |
| Disallow | /awards_center/ |
| Disallow | /landing/ |
| Disallow | /promo-dishes* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |