cars.cari.com.ng
robots.txt

Robots Exclusion Standard data for cars.cari.com.ng

Resource Scan

Scan Details

Site Domain cars.cari.com.ng
Base Domain cari.com.ng
Scan Status Ok
Last Scan2024-09-25T01:33:47+00:00
Next Scan 2024-10-25T01:33:47+00:00

Last Scan

Scanned2024-09-25T01:33:47+00:00
URL https://cars.cari.com.ng/robots.txt
Domain IPs 144.76.139.199
Response IP 144.76.139.199
Found Yes
Hash c66267268cdcc7d98b10b0b348666f91331f7ab83bc96b5c409ab2a84ace5e01
SimHash 4d1c9abbc0f0

Groups

*

Rule Path
Allow /
Disallow /index.php?*
Disallow /ajax/*
Disallow /motor/view/*
Disallow /mobil/view/*
Disallow /rumah/view/*
Disallow /lowongan-kerja/view/*
Disallow /shopping/view/*
Disallow /index.php?keyword=*
Disallow /index.php?make=*
Disallow /CAR_FOLDER/*
Disallow /MOTOR_FOLDER/*
Disallow /HOMES_FOLDER/*
Disallow /JOBS_FOLDER/*
Disallow /SHOPPING_FOLDER/*
Disallow /keyword/*
Disallow /lowogan-kerja/*
Disallow /cars/view/*
Disallow /motorcycles/view/*
Disallow /homes/view/*
Disallow /jobs/view/*