prodzer.ru
robots.txt
Robots Exclusion Standard data for prodzer.ru
Resource Scan
Scan Details
| Site Domain | prodzer.ru |
| Base Domain | prodzer.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-16T23:18:13+00:00 |
| Next Scan | 2024-11-23T23:18:13+00:00 |
Last Scan
| Scanned | 2024-11-16T23:18:13+00:00 |
| URL | https://prodzer.ru/robots.txt |
| Domain IPs | 5.188.131.51 |
| Response IP | 5.188.131.51 |
| Found | Yes |
| Hash | 2e62eda1c7664ca189510753b85a79bf5241941e7122691aa596b15a2f057fd9 |
| SimHash | 44588cf08bb3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /admin |
| Disallow | /404 |
| Disallow | /peoplespeak |
| Disallow | /users |
| Disallow | /offers |
| Disallow | /test-banners |
| Disallow | /api |
| Disallow | /search |
| Disallow | /newspapers |
| Disallow | *?date= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://prodzer.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.