prop.ae
robots.txt
Robots Exclusion Standard data for prop.ae
Resource Scan
Scan Details
| Site Domain | prop.ae |
| Base Domain | prop.ae |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2026-03-02T21:55:58+00:00 |
| Next Scan | 2026-05-31T21:55:58+00:00 |
Last Successful Scan
| Scanned | 2022-10-15T18:46:43+00:00 |
| URL | https://prop.ae/robots.txt |
| Redirect | https://www.prop.ae/robots.txt |
| Redirect Domain | www.prop.ae |
| Redirect Base | prop.ae |
| Response IP | 13.33.33.32, 13.33.33.89, 13.33.33.3, 13.33.33.52 |
| Found | Yes |
| Hash | dbb5d09653e5e4981d7ced83768f64cb0578f9bcbf551741eb743946fcabb7e1 |
| SimHash | 887a59e1cef1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /adserver/ |
| Disallow | /cp/ |
| Disallow | /search/ |
| Disallow | /ur/ |
| Disallow | /newsite/ |
| Disallow | /v3/ |
| Disallow | /zodsite/ |
| Disallow | /nfpage/ |
| Disallow | /body/common/listings_nb_places.php |
| Disallow | /enem.html |
| Disallow | /extra/ |
| Disallow | /property_listings/ |
| Disallow | /agc_site/ |
| Disallow | /indices/ |
| Disallow | /ads/ |
| Disallow | /international/ |
| Disallow | /uae/ |
| Disallow | /br_index/ |
| Disallow | /questionnaire/ |
| Disallow | /m_1/ |
| Disallow | /indices.html |
| Disallow | /*?dqs=* |
| Disallow | /newsletter_new/ |
| Disallow | /zforum/ |
facebookexternalhit/1.1
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
Warnings
- 2 invalid lines.