s.mognavi.jp
robots.txt

Robots Exclusion Standard data for s.mognavi.jp

Resource Scan

Scan Details

Site Domain s.mognavi.jp
Base Domain mognavi.jp
Scan Status Ok
Last Scan5/28/2025, 7:14:34 PM
Next Scan 6/27/2025, 7:14:34 PM

Last Scan

Scanned5/28/2025, 7:14:34 PM
URL https://s.mognavi.jp/robots.txt
Domain IPs 163.43.90.91
Response IP 163.43.90.91
Found Yes
Hash 4ca5daed61bfd50e8cf821d609a2b7e3bed28e1c71fdf1f06d4756aa38fbbd25
SimHash 435ede852787

Groups

mediapartners

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

googlebot

Rule Path
Disallow /do/api/ec/
Disallow /do/api/food/
Disallow /do/api/assessment/

googlebot-mobile

Rule Path
Disallow

baiduspider

Rule Path
Disallow /

baiduimagespider

Rule Path
Disallow /

baidumobaider

Rule Path
Disallow /

y!j-srd/1.0

Rule Path
Disallow /

y!j-mbs/1.0

Rule Path
Disallow /

becomejpbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

naver

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

tagoo

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

zanrancrawler

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /food/*/contentsType/*
Disallow /food/*/kuchikomi/userCommentKbn/
Disallow /food/*/userCommentKbn/
Disallow /food/*/shopping
Disallow /food/*/video
Disallow /food/*/photo
Disallow /food/*/spec
Disallow /do/kuchikomi/list
Disallow /do/food/iframe/
Disallow /do/food/qrcode/
Disallow /do/food/output/
Disallow /do/food/output/detail2/
Disallow /do/food/output/detail2/param/foodId/
Disallow /do/food/show/param/requestUri/
Disallow /do/food/show/param/userCommentId/
Disallow /do/food/ecsite/*
Disallow /do/login/assessment/entry
Disallow /do/blogparts/crawl/param/foodId/
Disallow /do/compound/show/*
Disallow /do/compound/search/food/
Disallow /do/enqute/list/param/enquteId/
Disallow /user/*/favuser-kuchikomi-list*
Disallow /user/*/favfood-kuchikomi-list*
Disallow /user/*/community-thread-list*
Disallow /middleCategoryCode/
Disallow /param/
Disallow /do/api/*
Disallow /do/enquete/*
Disallow /do/food/trackback/*
Disallow /do/food/add_my_list*
Disallow /do/food/ecsite/*
Disallow /do/mogtomo/ads/overlay*
Disallow /do/ad/jackad/category_jack_ad*

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

facebot/1.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Comments

  • Noindex: /do/api/*
  • Noindex: /do/whats_new/data*