shaov.net
robots.txt
Robots Exclusion Standard data for shaov.net
Resource Scan
Scan Details
| Site Domain | shaov.net |
| Base Domain | shaov.net |
| Scan Status | Ok |
| Last Scan | 2026-01-31T18:04:23+00:00 |
| Next Scan | 2026-03-02T18:04:23+00:00 |
Last Scan
| Scanned | 2026-01-31T18:04:23+00:00 |
| URL | https://shaov.net/robots.txt |
| Redirect | https://www.shaov.net/robots.txt |
| Redirect Domain | www.shaov.net |
| Redirect Base | shaov.net |
| Domain IPs | 173.236.255.7 |
| Redirect IPs | 173.236.255.7 |
| Response IP | 173.236.255.7 |
| Found | Yes |
| Hash | 411b9646c423be4c29f4a985834fc96c230c6eaca5b1d87fca113f5ff683dced |
| SimHash | 420ec8c1e1b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /_p_m_a/* |
| Disallow | /mp3s/* |
| Disallow | /video/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
yandex
| Rule | Path |
|---|---|
| Disallow | /_p_m_a/* |
| Disallow | /mp3s/* |
| Disallow | /video/* |
| Disallow | /forum/*?sid=* |
| Disallow | /forum/adm/* |
| Disallow | /forum/download/* |
| Disallow | /forum/faq.php |
| Disallow | /forum/mcp.php |
| Disallow | /forum/memberlist.php |
| Disallow | /forum/posting.php |
| Disallow | /forum/report.php |
| Disallow | /forum/search.php |
| Disallow | /forum/ucp.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://shaov.net/forum/sitemap.xml |
| sitemap | https://shaov.net/sitemap.xml |
| sitemap | https://shaov.net/forum/sitemap.xml |
| sitemap | https://shaov.net/sitemap.xml |
Warnings
- `host` is not a known field.