propertyfinder.bh
robots.txt
Robots Exclusion Standard data for propertyfinder.bh
Resource Scan
Scan Details
| Site Domain | propertyfinder.bh |
| Base Domain | propertyfinder.bh |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-23T13:40:35+00:00 |
| Next Scan | 2024-11-06T13:40:35+00:00 |
Last Successful Scan
| Scanned | 2024-10-08T13:28:12+00:00 |
| URL | https://propertyfinder.bh/robots.txt |
| Redirect | https://www.propertyfinder.bh/robots.txt |
| Redirect Domain | www.propertyfinder.bh |
| Redirect Base | propertyfinder.bh |
| Domain IPs | 13.33.88.119, 13.33.88.51, 13.33.88.83, 13.33.88.85 |
| Redirect IPs | 13.33.88.119, 13.33.88.51, 13.33.88.83, 13.33.88.85 |
| Response IP | 13.33.88.85 |
| Found | Yes |
| Hash | 316363050d6ca69877fc913159d9fa8d337c6440e8a3b6a107a9ef74a44038e3 |
| SimHash | b86958c0e6b7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax/ |
| Disallow | /promo/ |
| Disallow | /manager/ |
| Disallow | /to/ |
| Disallow | /en/search?* |
| Disallow | /ar/search?* |
| Disallow | /fr/recherche |
| Disallow | /ar/recherche |
| Disallow | /search?* |
| Disallow | /en/search-v2 |
| Disallow | /ar/search-v2 |
| Disallow | /en/review |
| Disallow | /ar/review |
| Disallow | /en/area-insights/* |
| Disallow | /ar/area-insights/* |
| Disallow | */transactions/*? |
| Disallow | */insightshub* |
| Disallow | */tools/home-value-estimator |
| Disallow | /sp_events/* |
| Disallow | */undefined$ |
| Disallow | */preview$ |
| Disallow | */preview?* |
| Disallow | */map-search |
| Disallow | */find-agent/? |
| Disallow | */find-broker/? |
| Disallow | /manager/* |
| Allow | /manager/login/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.propertyfinder.bh/sitemaps/index-sitemap.xml |
Comments