carvak.com
robots.txt
Robots Exclusion Standard data for carvak.com
Resource Scan
Scan Details
Site Domain | carvak.com |
Base Domain | carvak.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-04-26T07:45:31+00:00 |
Next Scan | 2024-06-25T07:45:31+00:00 |
Last Successful Scan
Scanned | 2024-02-04T07:04:18+00:00 |
URL | https://carvak.com/robots.txt |
Redirect | https://www.carvak.com/robots.txt |
Redirect Domain | www.carvak.com |
Redirect Base | carvak.com |
Domain IPs | 52.84.229.37, 52.84.229.54, 52.84.229.65, 52.84.229.77 |
Redirect IPs | 52.84.229.37, 52.84.229.54, 52.84.229.65, 52.84.229.77 |
Response IP | 18.245.31.105 |
Found | Yes |
Hash | 72e70ef5bad980c4f71298270c4828e4369fa771d7e4e7b2b42130bfcb12875b |
SimHash | 639b5242c9e3 |
Groups
*
Rule | Path |
---|---|
Disallow | /reports/ |
*
Rule | Path |
---|---|
Disallow | /rezervasyon-secenekleri* |
*
Rule | Path |
---|---|
Disallow | /hotsale/ |
*
Rule | Path |
---|---|
Disallow | /arabani-sat-marka* |
*
Rule | Path |
---|---|
Disallow | /frontend/ |
*
Rule | Path |
---|---|
Disallow | /v2_product_aws/ |
*
Rule | Path |
---|---|
Disallow | /giris-yap/* |
*
Rule | Path |
---|---|
Disallow | /hesap-olustur |
*
Rule | Path |
---|---|
Disallow | *arabani* |
Disallow | *hesap-olustur* |
Disallow | *giris-yap* |
Disallow | */durum-Mevcut/* |
Disallow | */durum-Rezerve/* |
Disallow | */renk-Diger/* |
Disallow | */km-* |
Disallow | *fiyat* |
Disallow | *?q=* |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
Other Records
Field | Value |
---|---|
sitemap | https://www.carvak.com/sitemap-tr-0.xml |
Warnings
- 2 invalid lines.
Comments