juststream.tax
robots.txt

Robots Exclusion Standard data for juststream.tax

Resource Scan

Scan Details

Site Domain juststream.tax
Base Domain juststream.tax
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-31T23:27:04+00:00
Next Scan 2024-06-30T23:27:04+00:00

Last Successful Scan

Scanned2024-04-09T23:14:47+00:00
URL https://juststream.tax/robots.txt
Redirect https://juststream.zone/robots.txt
Redirect Domain juststream.zone
Redirect Base juststream.zone
Domain IPs 104.21.42.11, 172.67.198.27, 2606:4700:3032::6815:2a0b, 2606:4700:3032::ac43:c61b
Redirect IPs 104.21.22.174, 172.67.205.246, 2606:4700:3032::6815:16ae, 2606:4700:3034::ac43:cdf6
Response IP 104.21.22.174
Found Yes
Hash 930e9e0dd3787b04dfae4f0996df6235100216621899e8daae69c93b077b020c
SimHash 3f4a29d6ea23

Groups

*

Rule Path
Disallow /engine/go.php
Disallow /user/
Disallow /newposts/
Disallow /lastnews/
Disallow /catalog/
Disallow /favorites/
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /?do=*
Disallow /go/*
Disallow /episode/*
Disallow /tags/*
Disallow /2012/
Disallow /2013/
Disallow /2014/
Disallow /2015/
Disallow /2016/
Disallow /2017/
Disallow /2018/
Disallow /2019/
Disallow /2020/
Disallow /2021/
Disallow /2022/
Disallow /2023/
Disallow /2024/
Disallow /2025/