internet-law.ru
robots.txt
Robots Exclusion Standard data for internet-law.ru
Resource Scan
Scan Details
| Site Domain | internet-law.ru |
| Base Domain | internet-law.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-17T04:22:13+00:00 |
| Next Scan | 2024-11-24T04:22:13+00:00 |
Last Scan
| Scanned | 2024-11-17T04:22:13+00:00 |
| URL | https://internet-law.ru/robots.txt |
| Domain IPs | 2001:1bb0:e000:1e::2ae, 81.177.141.30 |
| Response IP | 81.177.141.30 |
| Found | Yes |
| Hash | dcd9860ab77ff894343a9965f97e51426bbbe2218e3feeeb1caa801414e74d94 |
| SimHash | 59449ee42bb3 |
Groups
yandex
yandex
| Rule | Path |
|---|---|
| Disallow | /forum/avatars/ |
| Disallow | /forum/Packages/ |
| Disallow | /forum/Smileys/ |
| Disallow | /forum/Sources/ |
| Disallow | /forum/Themes/ |
| Disallow | /forum/*sort |
| Disallow | /forum/*wap |
| Disallow | /forum/*imode |
| Disallow | /forum/*printpage |
| Disallow | /forum/index.php?action=pm |
| Disallow | /forum/index.php?action=profile* |
| Disallow | /forum/go.php |
| Disallow | /search/ |
| Disallow | /template/go.php |
| Disallow | /template/standard/rotator.txt |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://internet-law.ru/sitemap.xml |
| sitemap | https://internet-law.ru/map/sitemap-main.xml |
| sitemap | https://internet-law.ru/map/sitemap-docs.xml |
| sitemap | https://internet-law.ru/map/sitemap-gosts1.xml |
| sitemap | https://internet-law.ru/map/sitemap-gosts2.xml |
| sitemap | https://internet-law.ru/map/sitemap-gosts3.xml |
| sitemap | https://internet-law.ru/map/sitemap-stroyka-text.xml |
| sitemap | https://internet-law.ru/map/sitemap-stroyka-doc.xml |
| sitemap | https://internet-law.ru/forum/index.php?action=sitemap;xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.