msg.olx.com.pk
robots.txt
Robots Exclusion Standard data for msg.olx.com.pk
Resource Scan
Scan Details
| Site Domain | msg.olx.com.pk |
| Base Domain | olx.com.pk |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-07-07T20:36:39+00:00 |
| Next Scan | 2024-10-05T20:36:39+00:00 |
Last Successful Scan
| Scanned | 2022-05-16T13:26:11+00:00 |
| URL | https://msg.olx.com.pk/robots.txt |
| Redirect | https://www.olx.com.pk/robots.txt |
| Redirect Domain | www.olx.com.pk |
| Redirect Base | olx.com.pk |
| Response IP | 104.18.14.28 |
| Found | Yes |
| Hash | 761c2a35a6c6227a83d317c282d77b60c552ff436e3dc57e08c8ddf146fdf430 |
| SimHash | 0fd36b2d61b2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /post/ |
| Disallow | /edit/ |
| Disallow | /account/ |
| Disallow | /chat/ |
| Disallow | /profile/ |
| Disallow | /payments/ |
| Disallow | /nf/ |
| Disallow | */*?*%5B |
| Disallow | */*?*%5B |
| Disallow | *_and_* |
| Disallow | */*?*filter=*cartype_ |
| Disallow | */*?*filter=*mileage_ |
| Disallow | */*?*filter=*transmission_ |
| Disallow | */*?*filter=*year_ |
| Disallow | */*?*filter=*bathrooms_ |
| Disallow | */*?*filter=*bedrooms_ |
| Disallow | */*?*filter=*brokerfree_ |
| Disallow | */*?*filter=*pets_ |
| Disallow | */*?*filter=*surface_ |
| Disallow | */*?*filter=*furnished_ |
| Disallow | /deal_of_the_week/ |
| Disallow | /en/deal_of_the_week/ |
| Disallow | /featuredAgencies |
| Disallow | /en/featuredAgencies |
| Disallow | /api/ |
| Disallow | /recommended_properties* |
| Disallow | /profolio/ |
| Disallow | /en/profolio/ |
| Disallow | /cp/ |
| Disallow | /en/cp/ |
| Disallow | /nova/ |
| Disallow | /en/nova/ |
| Disallow | /en-pk/ |
Comments