Log In Sign Up

renso-ruigo.com
robots.txt

Robots Exclusion Standard data for renso-ruigo.com

Resource Scan

Scan Details

Site Domain renso-ruigo.com
Base Domain renso-ruigo.com
Scan Status Ok
Last Scan2024-11-16T08:25:19+00:00
Next Scan 2024-11-23T08:25:19+00:00

Last Scan

Scanned2024-11-16T08:25:19+00:00
URL https://renso-ruigo.com/robots.txt
Domain IPs 160.16.63.134
Response IP 160.16.63.134
Found Yes
Hash 05100c6c8b3adda460675ee679c3466e9662459134eff4a605b147c55b262d65
SimHash 33973816c5e2

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

amazon-kendra

Rule Path
Disallow /
Back to top

Comments

  • 20170218
  • bingbot のアクセスが多いので頻度を減らす
  • 同じサーバーにあるサブドメインにもファイルを置く
  • AIによる学習を拒否
Back to top