Log In Sign Up

mdpr.jp
robots.txt

Robots Exclusion Standard data for mdpr.jp

Resource Scan

Scan Details

Site Domain mdpr.jp
Base Domain mdpr.jp
Scan Status Ok
Last Scan2024-11-14T08:56:00+00:00
Next Scan 2024-11-21T08:56:00+00:00

Last Scan

Scanned2024-11-14T08:56:00+00:00
URL https://mdpr.jp/robots.txt
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 151.101.130.132
Found Yes
Hash ae24a82bc9d4a879e825e7f43570acb37821fa29e4b6734987fbf614e48eea0c
SimHash 563cc472d7cb

Groups

*

Rule Path
Disallow /api/
Disallow /watch
Disallow /search

baiduspider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

eyemonit

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://feed.mdpr.jp/rss/google_news_sitemap.xml
Back to top

Comments

  • https://www.baidu.com/search/robots_jp.html
  • http://help.sogou.com/guide.html
  • http://help.sogou.com/guide.html
  • https://yandex.com/support/webmaster/controlling-robot/robots-txt.html
  • https://ahrefs.com/ja/robot
  • https://www.trendiction.com/bot
  • https://mj12bot.com/
  • https://www.mediatoolkit.com/robot
  • http://www.eyemon.it/
  • https://dataforseo.com/dataforseo-bot
  • https://moz.com/help/moz-procedures/crawlers/dotbot
Back to top