yogyakartacity.olx.co.id
robots.txt

Robots Exclusion Standard data for yogyakartacity.olx.co.id

Resource Scan

Scan Details

Site Domain yogyakartacity.olx.co.id
Base Domain olx.co.id
Scan Status Ok
Last Scan2025-08-13T21:04:23+00:00
Next Scan 2025-09-12T21:04:23+00:00

Last Scan

Scanned2025-08-13T21:04:23+00:00
URL https://yogyakartacity.olx.co.id/robots.txt
Redirect https://www.olx.co.id/robots.txt
Redirect Domain www.olx.co.id
Redirect Base olx.co.id
Domain IPs 125.56.219.2, 23.32.29.106, 2600:1413:5000:12::1737:27e9, 2600:1413:5000:12::1737:27f4
Redirect IPs 2600:1413:5000:12::1737:27e9, 2600:1413:5000:12::1737:27f4, 96.17.96.17, 96.17.96.25
Response IP 23.45.207.85
Found Yes
Hash 275699b797ca7ca8f5cc8dcd01fc6b5f2eb8575da4ca58475b9a011fb29d7d5e
SimHash 6d514b0d6590

Groups

*

Rule Path
Disallow /api/
Disallow /post/
Disallow /edit/
Disallow /account/
Disallow /chat/
Disallow /profile/
Disallow /payments/
Disallow /nf/
Disallow /items$
Disallow */*?*filter=*price_
Disallow */*?*filter=*condition_
Disallow */*?*filter=*cartype_
Disallow */*?*filter=*mileage_
Disallow */*?*filter=*transmission_
Disallow */*?*filter=*year_

Comments

  • Base Filters
  • Cars Filters
  • Generated on 2023-07-25T10:40:38.725Z