oren1.ru
robots.txt
Robots Exclusion Standard data for oren1.ru
Resource Scan
Scan Details
| Site Domain | oren1.ru |
| Base Domain | oren1.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-04T07:48:37+00:00 |
| Next Scan | 2024-11-11T07:48:37+00:00 |
Last Scan
| Scanned | 2024-11-04T07:48:37+00:00 |
| URL | https://oren1.ru/robots.txt |
| Domain IPs | 5.188.131.51 |
| Response IP | 5.188.131.51 |
| Found | Yes |
| Hash | 57e5d8723b8c4d5c040f931107e5be00c0b4043d259e2504e53d9910398fe030 |
| SimHash | 44188e70cbb7 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /admin |
| Disallow | /404 |
| Disallow | /peoplespeak |
| Disallow | /users |
| Disallow | /offers |
| Disallow | /test-banners |
| Disallow | /api |
| Disallow | /search |
| Disallow | /newspapers |
| Disallow | *?date= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://oren1.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.