dubizzle.com
robots.txt
Robots Exclusion Standard data for dubizzle.com
Resource Scan
Scan Details
Site Domain | dubizzle.com |
Base Domain | dubizzle.com |
Scan Status | Ok |
Last Scan | 2024-09-21T08:07:19+00:00 |
Next Scan | 2024-09-28T08:07:19+00:00 |
Last Scan
Scanned | 2024-09-21T08:07:19+00:00 |
URL | https://dubizzle.com/robots.txt |
Domain IPs | 45.60.240.176, 45.60.242.176 |
Response IP | 45.60.240.176 |
Found | Yes |
Hash | c43d8e9e705d621402582356578484ec8441909038a2e364d0bf6d00bfc9a742 |
SimHash | a5725ad0cd33 |
Groups
*
Rule | Path |
---|---|
Disallow | /report/ |
Disallow | /ar/report/ |
Disallow | /profile/facebook/connect/* |
Disallow | /profile/* |
Disallow | /accounts/login/* |
Disallow | /ar/accounts/login/* |
Disallow | /accounts/activate/* |
Disallow | /m/accounts/login/* |
Disallow | /m/accounts/edit-number/ |
Disallow | /m/ar/accounts/login/* |
Disallow | /m/ar/accounts/edit-number/ |
Disallow | /m/ar/settings/?added__gte=* |
Disallow | /1000931/* |
Disallow | /sitemap-* |
Disallow | /subscribe/ |
Disallow | /estate/create |
Disallow | /account/ |
Disallow | /search/complexes |
Disallow | /mysearches/ |
Disallow | /email_alerts/ |
Disallow | /mylistings/ |
Disallow | /profile/ |
Disallow | /chat/ |
Disallow | /m/myfavorites/ |
Disallow | /dashboard/ |
Disallow | /shorter/ |
Disallow | /api/ |
Disallow | /m/api/ |
Disallow | /kombi/ |
Other Records
Field | Value |
---|---|
sitemap | https://uae.dubizzle.com/sitemaps/sitemap.xml |
sitemap | https://uae.dubizzle.com/en/property-for-sale/new-projects/uae-sitemap.xml |
Comments