carhub.ro
robots.txt
Robots Exclusion Standard data for carhub.ro
Resource Scan
Scan Details
Site Domain | carhub.ro |
Base Domain | carhub.ro |
Scan Status | Ok |
Last Scan | 2024-10-30T02:34:10+00:00 |
Next Scan | 2024-11-29T02:34:10+00:00 |
Last Scan
Scanned | 2024-10-30T02:34:10+00:00 |
URL | https://carhub.ro/robots.txt |
Redirect | https://www.carhub.ro/robots.txt |
Redirect Domain | www.carhub.ro |
Redirect Base | carhub.ro |
Domain IPs | 52.222.144.107, 52.222.144.52, 52.222.144.76, 52.222.144.88 |
Redirect IPs | 13.226.2.100, 13.226.2.46, 13.226.2.51, 13.226.2.99 |
Response IP | 3.164.206.116 |
Found | Yes |
Hash | 6c12d6ecb89117a463895d05bfb5f72d9e0e3089a9d2b8c29bf4664f6ac464de |
SimHash | 6b477f712aa7 |
Groups
*
Rule | Path |
---|---|
Disallow | /m2/ |
Disallow | /*2pau |
Disallow | /*2ptt |
Disallow | /*2ptu |
Disallow | /*2prp |
Disallow | /*2pdlst |
Disallow | /checkout/ |
Disallow | /*?product_list_order=* |
Other Records
Field | Value |
---|---|
sitemap | https://www.carhub.ro/sitemap.xml |
Warnings
- 10 invalid lines.
Comments