Log In Sign Up

razor.tv
robots.txt

Robots Exclusion Standard data for razor.tv

Resource Scan

Scan Details

Site Domain razor.tv
Base Domain razor.tv
Scan Status Ok
Last Scan2024-09-21T11:36:18+00:00
Next Scan 2024-09-28T11:36:18+00:00

Last Scan

Scanned2024-09-21T11:36:18+00:00
URL https://razor.tv/robots.txt
Redirect https://www.razor.tv/robots.txt
Redirect Domain www.razor.tv
Redirect Base razor.tv
Domain IPs 108.156.133.115, 108.156.133.66, 108.156.133.8, 108.156.133.90
Redirect IPs 13.35.210.105, 13.35.210.3, 13.35.210.30, 13.35.210.32
Response IP 13.35.210.30
Found Yes
Hash b0a1899ebd3569f061e963aca167aba50270c9b192b6b1b05d56fe505aef3c4f
SimHash 805099a06333

Groups

*

Rule Path
Disallow /protected
Disallow /admin
Disallow /cron

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /
Back to top

Comments

  • For new training only
  • Not for training, only for user requests
  • Marker for disabling Bard and Vertex AI
  • Multi-purpose, commercial uses; including LLMs
Back to top