carsharing-auto.ru
robots.txt
Robots Exclusion Standard data for carsharing-auto.ru
Resource Scan
Scan Details
Site Domain | carsharing-auto.ru |
Base Domain | carsharing-auto.ru |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-28T12:12:03+00:00 |
Next Scan | 2024-11-26T12:12:03+00:00 |
Last Successful Scan
Scanned | 2024-05-01T12:09:54+00:00 |
URL | https://carsharing-auto.ru/robots.txt |
Domain IPs | 2a00:15f8:a000:5:1:11:0:8827, 2a00:15f8:a000:5:1:12:0:8827, 2a00:15f8:a000:5:1:13:0:8827, 2a00:15f8:a000:5:1:14:0:8827, 90.156.201.36, 90.156.201.37, 90.156.201.82, 90.156.201.98 |
Response IP | 90.156.201.82 |
Found | Yes |
Hash | fd34efc9bf9248863ea4462c620cad0f85709ec48aaa7e90f33e839b467be0eb |
SimHash | 6841fff30560 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Allow | */*.css |
Allow | */*.js |
Disallow | */wp-admin |
Disallow | */wp-json/ |
Disallow | */xmlrpc.php |
Disallow | */readme.html |
Disallow | /*? |
Disallow | /?s= |
Disallow | */tag/* |
Disallow | */page/* |
Disallow | */wp-json/* |
Disallow | */attachment/* |
Disallow | */feed |
Other Records
Field | Value |
---|---|
sitemap | https://carsharing-auto.ru/sitemap.xml |
Warnings
- `host` is not a known field.