Log In Sign Up

kylrth.com
robots.txt

Robots Exclusion Standard data for kylrth.com

Resource Scan

Scan Details

Site Domain kylrth.com
Base Domain kylrth.com
Scan Status Ok
Last Scan2025-11-10T03:53:47+00:00
Next Scan 2025-11-17T03:53:47+00:00

Last Scan

Scanned2025-11-10T03:53:47+00:00
URL https://kylrth.com/robots.txt
Domain IPs 185.199.108.153, 185.199.109.153, 185.199.110.153, 185.199.111.153
Response IP 185.199.110.153
Found Yes
Hash 6feadf0c0eb72c5cb639681bf33c587cebcbd61de8fa2cb4f026278d0717e0e1
SimHash d210413a6ab3

Groups

*

Rule Path
Allow /

adsbot

Rule Path
Disallow /
Allow /ads.txt
Allow /app-ads.txt

chatgpt-user
gptbot

Rule Path
Disallow /

turnitinbot
npbot
slysearch
blexbot
checkmarknetwork/1.0
brandverity/1.0

Rule Path
Disallow /

ahrefsbot
mj12bot
semrushbot
dotbot
seokicks

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://kylrth.com/sitemap.xml
Back to top

Comments

  • If you are a human and would like to scrape my site for a specific purpose, please consider
  • downloading and building the static site using the instructions at
  • https://github.com/kylrth/kylrth.github.io, or reaching out to say hi.
  • no online advertising
  • disallow for ML model training
  • disallow bots that use content to stop plagiarism and intellectual property violations
  • (see https://seirdy.one/robots.txt)
  • disallow SEO web crawlers
Back to top