dubizzle.com
robots.txt
Robots Exclusion Standard data for dubizzle.com
Resource Scan
Scan Details
| Site Domain | dubizzle.com |
| Base Domain | dubizzle.com |
| Scan Status | Ok |
| Last Scan | 2024-11-09T12:29:38+00:00 |
| Next Scan | 2024-11-16T12:29:38+00:00 |
Last Scan
| Scanned | 2024-11-09T12:29:38+00:00 |
| URL | https://dubizzle.com/robots.txt |
| Domain IPs | 45.60.240.176, 45.60.242.176 |
| Response IP | 45.60.240.176 |
| Found | Yes |
| Hash | 4c3bff1d8cdeaadef23f146b7948403532dcbd1c42efc84c692d29569fef137f |
| SimHash | a5725ad0cd33 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /report/ |
| Disallow | /ar/report/ |
| Disallow | /profile/facebook/connect/* |
| Disallow | /profile/* |
| Disallow | /accounts/login/* |
| Disallow | /ar/accounts/login/* |
| Disallow | /accounts/activate/* |
| Disallow | /m/accounts/login/* |
| Disallow | /m/accounts/edit-number/ |
| Disallow | /m/ar/accounts/login/* |
| Disallow | /m/ar/accounts/edit-number/ |
| Disallow | /m/ar/settings/?added__gte=* |
| Disallow | /1000931/* |
| Disallow | /sitemap-* |
| Disallow | /subscribe/ |
| Disallow | /estate/create |
| Disallow | /account/ |
| Disallow | /search/complexes |
| Disallow | /mysearches/ |
| Disallow | /email_alerts/ |
| Disallow | /mylistings/ |
| Disallow | /profile/ |
| Disallow | /chat/ |
| Disallow | /m/myfavorites/ |
| Disallow | /dashboard/ |
| Disallow | /shorter/ |
| Disallow | /api/ |
| Disallow | /m/api/ |
| Disallow | /kombi/ |
| Disallow | en/auth/ |
| Disallow | ar/auth/ |
| Disallow | auth/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://uae.dubizzle.com/sitemaps/sitemap.xml |
| sitemap | https://uae.dubizzle.com/en/property-for-sale/new-projects/uae-sitemap.xml |
Comments