olx.qa
robots.txt
Robots Exclusion Standard data for olx.qa
Resource Scan
Scan Details
| Site Domain | olx.qa |
| Base Domain | olx.qa |
| Scan Status | Ok |
| Last Scan | 2024-11-09T18:37:38+00:00 |
| Next Scan | 2024-11-16T18:37:38+00:00 |
Last Scan
| Scanned | 2024-11-09T18:37:38+00:00 |
| URL | https://olx.qa/robots.txt |
| Redirect | https://www.dubizzle.qa/robots.txt |
| Redirect Domain | www.dubizzle.qa |
| Redirect Base | dubizzle.qa |
| Domain IPs | 13.33.88.122, 13.33.88.17, 13.33.88.37, 13.33.88.78 |
| Redirect IPs | 104.18.4.85, 104.18.5.85, 2606:4700::6812:455, 2606:4700::6812:555 |
| Response IP | 104.18.5.85 |
| Found | Yes |
| Hash | 35fe1eaafdff2fd6a37772e3adf01d78915b1966005f3f205c97e25a2b7a89e0 |
| SimHash | 38950b614d12 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax/ |
| Disallow | /adminpanel/ |
| Disallow | /myaccount/ |
| Disallow | /adprint/ |
| Disallow | /ad/leaflet/ |
| Disallow | /ad/contact/ |
| Disallow | /payment/ |
| Disallow | /adding/confirm/ |
| Disallow | /adding/confirmpage/ |
| Disallow | /i2/ad/abuse/ |
| Disallow | /m/ad/abuse/ |
| Disallow | /apple-app-site-association |
| Disallow | /profile/ |
| Disallow | /en/profile/ |
| Disallow | *ref%* |
| Disallow | *search%* |
| Disallow | *search%5B* |
| Disallow | *sorting%3D* |
| Disallow | *minPhotoCount%3D* |
| Disallow | *product%3D* |
| Disallow | */changelang/* |
| Disallow | *sort_by%3D* |
| Disallow | *back%3D* |
| Disallow | /account |
| Disallow | /en/account |
| Disallow | /captchaChallenge |
| Disallow | /en/captchaChallenge |
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /post/ |
| Disallow | /edit/ |
| Disallow | /chat/ |
| Disallow | /profile/ |
| Disallow | /payments/ |
| Disallow | /nf/ |
| Disallow | /deal_of_the_week/ |
| Disallow | /en/deal_of_the_week/ |
| Disallow | /featuredAgencies |
| Disallow | /en/featuredAgencies |
| Disallow | /api/ |
| Disallow | /recommended_properties* |
| Disallow | /profolio/ |
| Disallow | /en/profolio/ |
| Disallow | /cp/ |
| Disallow | /en/cp/ |
| Disallow | /nova/ |
| Disallow | /en/nova/ |
| Disallow | *filter%3D* |
| Disallow | */model-*/q-* |
| Disallow | */raw-filters* |
Comments