faw-cars.ru
robots.txt
Robots Exclusion Standard data for faw-cars.ru
Resource Scan
Scan Details
| Site Domain | faw-cars.ru |
| Base Domain | faw-cars.ru |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-10-30T02:01:45+00:00 |
| Next Scan | 2024-11-06T02:01:45+00:00 |
Last Successful Scan
| Scanned | 2024-10-22T02:01:13+00:00 |
| URL | https://faw-cars.ru/robots.txt |
| Domain IPs | 2a00:15f8:a000:5:1:11:5:546a, 2a00:15f8:a000:5:1:12:5:546a, 2a00:15f8:a000:5:1:13:5:546a, 2a00:15f8:a000:5:1:14:5:546a, 90.156.201.113, 90.156.201.42, 90.156.201.47, 90.156.201.84 |
| Response IP | 90.156.201.84 |
| Found | Yes |
| Hash | d55e9a9aa07a622b0c773cebdf0372ceb7a83122f16821d8ef2665d5f34f59a4 |
| SimHash | 2f46d47682a0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*action |
| Disallow | /*PHPSESSID |
| Disallow | /*%3B |
| Allow | /$ |
| Allow | /*board*.html$ |
| Allow | /*topic*.html$ |
| Allow | /*forum$ |
| Allow | /*page%3D* |
| Allow | /*.xml |
| Allow | /*.css$ |
| Allow | /*.js$ |
| Allow | /*.png$ |
| Allow | /*.jpg$ |
| Allow | /*.gif$ |
| Disallow | /*%3B |
| Disallow | /*PHPSESSID |
| Disallow | /go.php |
| Allow | /*board |
| Allow | /*topic |
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://faw-cars.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.