netall.ru
robots.txt
Robots Exclusion Standard data for netall.ru
Resource Scan
Scan Details
| Site Domain | netall.ru |
| Base Domain | netall.ru |
| Scan Status | Ok |
| Last Scan | 2024-05-02T10:08:22+00:00 |
| Next Scan | 2024-06-01T10:08:22+00:00 |
Last Scan
| Scanned | 2024-05-02T10:08:22+00:00 |
| URL | https://netall.ru/robots.txt |
| Redirect | https://www.netall.ru/robots.txt |
| Redirect Domain | www.netall.ru |
| Redirect Base | netall.ru |
| Domain IPs | 91.219.165.13 |
| Redirect IPs | 91.219.165.13 |
| Response IP | 91.219.165.13 |
| Found | Yes |
| Hash | a808984d987a6d48cf7429ce6010353309c3b59a29acd377f55fe5308c2c94b9 |
| SimHash | 430ede6a4e89 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bitrix/ |
| Disallow | /admin/ |
| Disallow | /upload/ |
| Disallow | /mobile/ |
| Disallow | /search/ |
| Disallow | /remote_content/ |
| Disallow | /afisha/search.php |
| Disallow | /direct/search.php |
| Disallow | /direct/search_words.php |
| Disallow | /servinfo/gals2.php |
| Disallow | /archive.php |
| Disallow | /af_lite |
| Disallow | *?spart=* |
| Disallow | *print* |
| Disallow | *sort* |
| Disallow | *profile* |
| Disallow | *reg* |
| Disallow | *search* |
| Disallow | /auto/gnn/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.netall.ru/sitemap.xml |
| sitemap | https://www.netall.ru/sitemap_main.xml |
| sitemap | https://www.netall.ru/sitemap_news.xml |
| sitemap | https://www.netall.ru/sitemap_direct.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.