olx.pt
robots.txt
Robots Exclusion Standard data for olx.pt
Resource Scan
Scan Details
| Site Domain | olx.pt |
| Base Domain | olx.pt |
| Scan Status | Ok |
| Last Scan | 2024-04-26T22:37:39+00:00 |
| Next Scan | 2024-05-03T22:37:39+00:00 |
Last Scan
| Scanned | 2024-04-26T22:37:39+00:00 |
| URL | https://olx.pt/robots.txt |
| Domain IPs | 18.155.202.106, 18.155.202.25, 18.155.202.55, 18.155.202.65 |
| Response IP | 18.165.171.68 |
| Found | Yes |
| Hash | 2dc6b4ac3303da47280910975e59e3962925d03cd0c6f2637c729c0748c7affb |
| SimHash | e952c0724f33 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */ajax/ |
| Disallow | /adminpanel/ |
| Disallow | /api/ |
| Disallow | */facebook/ |
| Disallow | */rss/ |
| Disallow | */account/ |
| Disallow | */myaccount/ |
| Disallow | /adprint/ |
| Disallow | /anuncio/leaflet/ |
| Disallow | /anuncio/contact/ |
| Disallow | /payment/ |
| Disallow | /anunciar/confirm/ |
| Disallow | /anunciar/confirmpage/ |
| Disallow | /i2/anuncio/abuse/ |
| Disallow | /m/anuncio/abuse/ |
| Disallow | /i2/anuncio/contact/* |
| Disallow | /api/open/oauth/token/ |
| Disallow | */i2/* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.olx.pt/sitemap.xml |
Warnings
- `host` is not a known field.
Comments