propertyfinder.bh
robots.txt
Robots Exclusion Standard data for propertyfinder.bh
Resource Scan
Scan Details
| Site Domain | propertyfinder.bh |
| Base Domain | propertyfinder.bh |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-07-03T12:55:52+00:00 |
| Next Scan | 2024-10-01T12:55:52+00:00 |
Last Successful Scan
| Scanned | 2023-03-12T07:54:40+00:00 |
| URL | https://propertyfinder.bh/robots.txt |
| Redirect | https://www.propertyfinder.bh/robots.txt |
| Redirect Domain | www.propertyfinder.bh |
| Redirect Base | propertyfinder.bh |
| Domain IPs | 23.215.7.11, 23.215.7.30, 2600:1413:b000:1b::17d7:70b, 2600:1413:b000:1b::17d7:71e |
| Redirect IPs | 13.33.33.104, 13.33.33.106, 13.33.33.59, 13.33.33.95, 2600:9000:21b4:1e00:9:5ed5:b400:93a1, 2600:9000:21b4:4c00:9:5ed5:b400:93a1, 2600:9000:21b4:7200:9:5ed5:b400:93a1, 2600:9000:21b4:8400:9:5ed5:b400:93a1, 2600:9000:21b4:a400:9:5ed5:b400:93a1, 2600:9000:21b4:aa00:9:5ed5:b400:93a1, 2600:9000:21b4:b600:9:5ed5:b400:93a1, 2600:9000:21b4:d800:9:5ed5:b400:93a1 |
| Response IP | 13.33.21.21 |
| Found | Yes |
| Hash | 0d93ae3521bd84a5edd153ffda75d7a7d4d4a2106f469ebcb8e880da02b9c9cc |
| SimHash | ad7959c4c6b7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ajax/ |
| Disallow | /promo/ |
| Disallow | /manager/ |
| Disallow | /to/ |
| Disallow | /en/search |
| Disallow | /ar/search |
| Disallow | /fr/recherche |
| Disallow | /ar/recherche |
| Disallow | /search |
| Disallow | /en/search-v2 |
| Disallow | /ar/search-v2 |
| Disallow | /en/review |
| Disallow | /ar/review |
| Disallow | /en/area-insights/* |
| Disallow | /ar/area-insights/* |
| Disallow | */map-search |
| Disallow | */find-agent/? |
| Disallow | */find-broker/? |
| Disallow | /manager/* |
| Allow | /manager/login/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.propertyfinder.bh/sitemaps/index-sitemap.xml |
Comments