polonsil.ru
robots.txt
Robots Exclusion Standard data for polonsil.ru
Resource Scan
Scan Details
| Site Domain | polonsil.ru |
| Base Domain | polonsil.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-15T07:32:22+00:00 |
| Next Scan | 2024-11-22T07:32:22+00:00 |
Last Scan
| Scanned | 2024-11-15T07:32:22+00:00 |
| URL | https://polonsil.ru/robots.txt |
| Domain IPs | 95.131.27.117, 95.131.27.118, 95.131.27.120 |
| Response IP | 95.131.27.117 |
| Found | Yes |
| Hash | fffa098ff6125a42646539bae173144016d12c6b589997e201b26a8d5e8048b5 |
| SimHash | 6848dc559491 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /gqapi |
| Disallow | /photos |
| Disallow | /pedia |
| Disallow | /videos |
| Disallow | /gadgets |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /gqapi |
| Disallow | /photos |
| Disallow | /pedia |
| Disallow | /videos |
| Disallow | /gadgets |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
*
| Rule | Path |
|---|---|
| Disallow | /api |
| Disallow | /gqapi |
| Disallow | /photos |
| Disallow | /pedia |
| Disallow | /videos |
| Disallow | /gadgets |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://polonsil.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.