monstream.cx
robots.txt
Robots Exclusion Standard data for monstream.cx
Resource Scan
Scan Details
Site Domain | monstream.cx |
Base Domain | monstream.cx |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-03T22:55:10+00:00 |
Next Scan | 2024-11-01T22:55:10+00:00 |
Last Successful Scan
Scanned | 2024-03-14T22:49:03+00:00 |
URL | https://monstream.cx/robots.txt |
Redirect | https://monstream.app/robots.txt |
Redirect Domain | monstream.app |
Redirect Base | monstream.app |
Domain IPs | 104.21.23.85, 172.67.209.219, 2606:4700:3036::ac43:d1db, 2606:4700:3037::6815:1755 |
Redirect IPs | 104.21.18.155, 172.67.182.180, 2606:4700:3035::6815:129b, 2606:4700:3037::ac43:b6b4 |
Response IP | 104.21.18.155 |
Found | Yes |
Hash | 930e9e0dd3787b04dfae4f0996df6235100216621899e8daae69c93b077b020c |
SimHash | 3f4a29d6ea23 |
Groups
*
Rule | Path |
---|---|
Disallow | /engine/go.php |
Disallow | /user/ |
Disallow | /newposts/ |
Disallow | /lastnews/ |
Disallow | /catalog/ |
Disallow | /favorites/ |
Disallow | /*subaction%3Duserinfo |
Disallow | /*subaction%3Dnewposts |
Disallow | /?do=* |
Disallow | /go/* |
Disallow | /episode/* |
Disallow | /tags/* |
Disallow | /2012/ |
Disallow | /2013/ |
Disallow | /2014/ |
Disallow | /2015/ |
Disallow | /2016/ |
Disallow | /2017/ |
Disallow | /2018/ |
Disallow | /2019/ |
Disallow | /2020/ |
Disallow | /2021/ |
Disallow | /2022/ |
Disallow | /2023/ |
Disallow | /2024/ |
Disallow | /2025/ |