rustarchives.com
robots.txt
Robots Exclusion Standard data for rustarchives.com
Resource Scan
Scan Details
| Site Domain | rustarchives.com |
| Base Domain | rustarchives.com |
| Scan Status | Ok |
| Last Scan | 2025-06-14T22:22:06+00:00 |
| Next Scan | 2025-07-14T22:22:06+00:00 |
Last Scan
| Scanned | 2025-06-14T22:22:06+00:00 |
| URL | https://rustarchives.com/robots.txt |
| Domain IPs | 104.21.70.115, 172.67.223.23, 2606:4700:3035::ac43:df17, 2606:4700:3037::6815:4673 |
| Response IP | 172.67.223.23 |
| Found | Yes |
| Hash | ed769840ce85ff56a432ea91a7a60cb96d7d0bc630ab599fe651062825e261aa |
| SimHash | bc659905e9d3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /login |
| Disallow | /register |
| Disallow | /register |
| Disallow | /signup |
| Disallow | /discount |
| Disallow | /live |
| Disallow | /link |
| Disallow | /bet |
| Disallow | /now |
| Disallow | /download |
| Disallow | /addcart |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rustarchives.com/sitemap.xml |