propertyfinder.ae
robots.txt
Robots Exclusion Standard data for propertyfinder.ae
Resource Scan
Scan Details
| Site Domain | propertyfinder.ae |
| Base Domain | propertyfinder.ae |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-08-22T03:02:19+00:00 |
| Next Scan | 2024-11-20T03:02:19+00:00 |
Last Successful Scan
| Scanned | 2023-10-28T01:13:22+00:00 |
| URL | https://propertyfinder.ae/robots.txt |
| Redirect | https://www.propertyfinder.ae/robots.txt |
| Redirect Domain | www.propertyfinder.ae |
| Redirect Base | propertyfinder.ae |
| Domain IPs | 23.215.7.11, 23.215.7.30, 2600:1413:1::173b:a889 |
| Redirect IPs | 23.59.168.144, 23.59.168.185, 2600:1413:b000:1b::17d7:70b, 2600:1413:b000:1b::17d7:71e |
| Response IP | 23.59.168.185 |
| Found | Yes |
| Hash | f7d3a1a0a4435e3ab24e95e20b7fa71d9f0b39e4eced1184803f96c25ec1c06c |
| SimHash | a8795bc0c6b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax/ |
| Disallow | /promo/ |
| Disallow | /manager/ |
| Disallow | /to/ |
| Disallow | /en/search |
| Disallow | /ar/search |
| Disallow | /fr/recherche |
| Disallow | /ar/recherche |
| Disallow | /search |
| Disallow | /en/search-v2 |
| Disallow | /ar/search-v2 |
| Disallow | /en/review |
| Disallow | /ar/review |
| Disallow | /en/area-insights/explore-prices/*?* |
| Disallow | */transactions/*? |
| Disallow | */tools/home-value-estimator |
| Disallow | */map-search |
| Disallow | */find-agent/? |
| Disallow | */find-broker/? |
| Disallow | /manager/* |
| Allow | /manager/login/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.propertyfinder.ae/sitemaps/index-sitemap.xml |
Comments