tangerang.olx.co.id
robots.txt
Robots Exclusion Standard data for tangerang.olx.co.id
Resource Scan
Scan Details
| Site Domain | tangerang.olx.co.id |
| Base Domain | olx.co.id |
| Scan Status | Ok |
| Last Scan | 2025-11-11T21:26:32+00:00 |
| Next Scan | 2025-12-11T21:26:32+00:00 |
Last Scan
| Scanned | 2025-11-11T21:26:32+00:00 |
| URL | https://tangerang.olx.co.id/robots.txt |
| Redirect | https://www.olx.co.id/robots.txt |
| Redirect Domain | www.olx.co.id |
| Redirect Base | olx.co.id |
| Domain IPs | 23.54.118.36, 23.54.118.38, 2600:1413:b000:6::17d5:2bc4, 2600:1413:b000:6::17d5:2bd0 |
| Redirect IPs | 23.45.207.70, 23.45.207.85, 2600:1413:b000:6::17d5:2bc4, 2600:1413:b000:6::17d5:2bd0 |
| Response IP | 23.54.118.36 |
| Found | Yes |
| Hash | 275699b797ca7ca8f5cc8dcd01fc6b5f2eb8575da4ca58475b9a011fb29d7d5e |
| SimHash | 6d514b0d6590 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /post/ |
| Disallow | /edit/ |
| Disallow | /account/ |
| Disallow | /chat/ |
| Disallow | /profile/ |
| Disallow | /payments/ |
| Disallow | /nf/ |
| Disallow | /items$ |
| Disallow | */*?*filter=*price_ |
| Disallow | */*?*filter=*condition_ |
| Disallow | */*?*filter=*cartype_ |
| Disallow | */*?*filter=*mileage_ |
| Disallow | */*?*filter=*transmission_ |
| Disallow | */*?*filter=*year_ |
Comments