blackstreaming.org
robots.txt
Robots Exclusion Standard data for blackstreaming.org
Resource Scan
Scan Details
Site Domain | blackstreaming.org |
Base Domain | blackstreaming.org |
Scan Status | Ok |
Last Scan | 2025-03-12T16:10:58+00:00 |
Next Scan | 2025-04-11T16:10:58+00:00 |
Last Scan
Scanned | 2025-03-12T16:10:58+00:00 |
URL | https://blackstreaming.org/robots.txt |
Redirect | https://www.blackstreaming.org/robots.txt |
Redirect Domain | www.blackstreaming.org |
Redirect Base | blackstreaming.org |
Domain IPs | 104.21.37.236, 172.67.215.53, 2606:4700:3031::6815:25ec, 2606:4700:3033::ac43:d735 |
Redirect IPs | 104.21.37.236, 172.67.215.53, 2606:4700:3031::6815:25ec, 2606:4700:3033::ac43:d735 |
Response IP | 172.67.215.53 |
Found | Yes |
Hash | 228f5aab3d65d95e8c4733a98f9acd2cebbb89e8bd050d45c831082befa4207b |
SimHash | 6b4a2dd7e823 |
Groups
*
Rule | Path |
---|---|
Disallow | /engine/go.php |
Disallow | /user/ |
Disallow | /newposts/ |
Disallow | /lastnews/ |
Disallow | /catalog/ |
Disallow | /favorites/ |
Disallow | /statistics.html |
Disallow | /dmca.html |
Disallow | /rules.html |
Disallow | /*subaction%3Duserinfo |
Disallow | /*subaction%3Dnewposts |
Disallow | /?do=* |
Disallow | /go/* |
Disallow | /episode/* |
Disallow | /tags/* |
Disallow | /2012/ |
Disallow | /2013/ |
Disallow | /2014/ |
Disallow | /2015/ |
Disallow | /2016/ |
Disallow | /2017/ |
Disallow | /2018/ |
Disallow | /2019/ |
Disallow | /2020/ |
Disallow | /2021/ |
Disallow | /2022/ |
Disallow | /2023/ |
Disallow | /2024/ |
Disallow | /2025/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.blackstreaming.org/sitemap.xml |