cari.co
robots.txt
Robots Exclusion Standard data for cari.co
Resource Scan
Scan Details
Site Domain | cari.co |
Base Domain | cari.co |
Scan Status | Ok |
Last Scan | 2024-10-01T17:12:33+00:00 |
Next Scan | 2024-10-08T17:12:33+00:00 |
Last Scan
Scanned | 2024-10-01T17:12:33+00:00 |
URL | https://cari.co/robots.txt |
Redirect | https://www.cari.co/robots.txt |
Redirect Domain | www.cari.co |
Redirect Base | cari.co |
Domain IPs | 103.177.95.132 |
Redirect IPs | 103.177.95.132 |
Response IP | 103.177.95.132 |
Found | Yes |
Hash | 5f0d27c9046b876d7a58296931ef2fa2cb2bad04fff071806d29cfdb8e44329e |
SimHash | 6d1cba8bc3f0 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /index.php?* |
Disallow | /ajax/* |
Disallow | /motor/view/* |
Disallow | /mobil/view/* |
Disallow | /rumah/view/* |
Disallow | /lowongan-kerja/view/* |
Disallow | /shopping/view/* |
Disallow | /index.php?keyword=* |
Disallow | /index.php?make=* |
Disallow | /CAR_FOLDER/* |
Disallow | /MOTOR_FOLDER/* |
Disallow | /HOMES_FOLDER/* |
Disallow | /JOBS_FOLDER/* |
Disallow | /SHOPPING_FOLDER/* |