dubai-investments.ru
robots.txt
Robots Exclusion Standard data for dubai-investments.ru
Resource Scan
Scan Details
| Site Domain | dubai-investments.ru |
| Base Domain | dubai-investments.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-04-02T17:29:41+00:00 |
| Next Scan | 2024-06-01T17:29:41+00:00 |
Last Successful Scan
| Scanned | 2024-01-11T17:01:27+00:00 |
| URL | https://dubai-investments.ru/robots.txt |
| Domain IPs | 13.200.123.229, 13.234.100.116, 65.0.79.182 |
| Response IP | 52.197.0.54 |
| Found | Yes |
| Hash | 60de356e2f697122ca896ae5df14f4f81b38bb9ecf975cd645d8f8e936c3c995 |
| SimHash | 2919ac5ed786 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *? |
| Disallow | *utm*%3D |
| Disallow | *openstat%3D |
| Disallow | */?search= |
| Disallow | /admin/ |
| Disallow | /template/ |
| Disallow | /design/ |
| Allow | /dashboard/login |
| Allow | /dashboard/signup |
| Disallow | /dashboard/ |
| Allow | /api/discover/sites/ |
| Allow | /api/designers/ |
| Disallow | /api/ |
| Disallow | /experiments/ |
googlebot
| Rule | Path |
|---|---|
| Disallow | *? |
| Disallow | *utm*%3D |
| Disallow | *openstat%3D |
| Disallow | */?search= |
| Disallow | /admin/ |
| Disallow | /template/ |
| Disallow | /design/ |
| Allow | /dashboard/login |
| Allow | /dashboard/signup |
| Disallow | /dashboard/ |
| Allow | /api/discover/sites/ |
| Allow | /api/designers/ |
| Disallow | /api/ |
| Disallow | /experiments/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://dubai-investments.ru/sitemap.xml |