Log In Sign Up

streaminghub.com
robots.txt

Robots Exclusion Standard data for streaminghub.com

Resource Scan

Scan Details

Site Domain streaminghub.com
Base Domain streaminghub.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-25T22:43:18+00:00
Next Scan 2026-03-27T22:43:18+00:00

Last Successful Scan

Scanned2026-01-26T05:03:28+00:00
URL https://streaminghub.com/robots.txt
Domain IPs 104.21.59.141, 172.67.179.72, 2606:4700:3030::6815:3b8d, 2606:4700:3036::ac43:b348
Response IP 172.67.179.72
Found Yes
Hash d35208734f26a797dd760fd27f9565d4dcfee11a8012e730e0cfd023e6e03c77
SimHash 050cce00e790

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

yandex

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

petalbot

Rule Path
Disallow /
Back to top

Comments

  • Block all user-agents by default
  • Allow major search engines
  • Disallow common bad bots
  • Specify the preferred host
Back to top

Warnings

  • `host` is not a known field.
Back to top