s-stroy.ru
robots.txt
Robots Exclusion Standard data for s-stroy.ru
Resource Scan
Scan Details
| Site Domain | s-stroy.ru |
| Base Domain | s-stroy.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-24T04:34:16+00:00 |
| Next Scan | 2024-10-23T04:34:16+00:00 |
Last Successful Scan
| Scanned | 2024-06-26T04:32:54+00:00 |
| URL | https://s-stroy.ru/robots.txt |
| Domain IPs | 45.12.236.176 |
| Response IP | 45.12.236.176 |
| Found | Yes |
| Hash | 9ffba27cc44db743c10eb48ad512e46bda798dd376a6b5e4aee82ad53fb99b90 |
| SimHash | 40345b46f013 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */search/ |
| Disallow | */compare/ |
| Disallow | */basket/ |
| Disallow | */favorites/ |
| Disallow | */checkout/ |
| Disallow | */promotions/ |
| Disallow | */profile/ |
| Disallow | */filter/ |
| Disallow | */arrFilter |
| Disallow | *.html |
googlebot
| Rule | Path |
|---|---|
| Disallow | */search/ |
| Disallow | */compare/ |
| Disallow | */basket/ |
| Disallow | */favorites/ |
| Disallow | */checkout/ |
| Disallow | */promotions/ |
| Disallow | */profile/ |
| Disallow | */filter/ |
| Disallow | *.html |
Warnings
- `clean-param` is not a known field.