firstbit.ae
robots.txt
Robots Exclusion Standard data for firstbit.ae
Resource Scan
Scan Details
| Site Domain | firstbit.ae |
| Base Domain | firstbit.ae |
| Scan Status | Ok |
| Last Scan | 2026-03-12T14:54:13+00:00 |
| Next Scan | 2026-04-11T14:54:13+00:00 |
Last Scan
| Scanned | 2026-03-12T14:54:13+00:00 |
| URL | https://firstbit.ae/robots.txt |
| Domain IPs | 104.26.10.218, 104.26.11.218, 172.67.72.240, 2606:4700:20::681a:ada, 2606:4700:20::681a:bda, 2606:4700:20::ac43:48f0 |
| Response IP | 172.67.72.240 |
| Found | Yes |
| Hash | 38e246b264114f0acdfb40638140fcd609892b9642dce5bcc2d4b44b7a70dfa8 |
| SimHash | 3011c865e7c1 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /*?utm* |
| Disallow | /search/ |
| Disallow | /*?q= |
| Disallow | /bitrix/ |
| Disallow | */sage/ |
| Disallow | */sage-deleted/ |
| Disallow | /services/bitrix24-maintenance/ |
| Disallow | /services/deployment/bitrix24/ |
| Disallow | /services/deployment/bitrix24/cloud/ |
| Disallow | /about/our-customers/ |
| Disallow | /products/sage-deleted/sales-module/ |
| Disallow | /about/mission-and-goals/ |
| Disallow | /services/bitrix24-maintenance/ |
| Disallow | /products/sage-deleted/inventory-and-warehouse/ |
| Disallow | /products/erp-dubai/prof/ |
| Disallow | /services/deployment/bitrix24/self-hosted/ |
| Disallow | /services/deployment/bitrix24/ |
| Disallow | /products/erp-dubai/procurement/ |
| Disallow | /products/sage-deleted/purchasing/ |
| Disallow | /products/erp-dubai/budgeting/ |
| Disallow | /products/erp-dubai/production/ |
| Disallow | /products/sage-deleted/customerservice/ |
| Disallow | /services/it-support/promotions/ |
| Disallow | /services/implementation-of-software/business-automation/ |
| Disallow | /products/sage-deleted/bireporting/ |
| Disallow | /products/erp-dubai/treasury/ |
| Disallow | /services/bitrix24-maintenance/ |
| Disallow | /services/deployment/bitrix24/ |
| Disallow | /construction-erp/ |
| Allow | /bitrix/*.js |
| Allow | /bitrix/*.css |
| Allow | /bitrix/*.jpg |
| Allow | /bitrix/*.bmp |
| Allow | /bitrix/*.png |
| Allow | /bitrix/*.gif |
| Allow | /bitrix/*.webp |
| Allow | /bitrix/components/*/ |
| Allow | /bitrix/cache/*/ |
| Allow | /bitrix/js/*/ |
| Allow | /bitrix/templates/*/ |
| Allow | /bitrix/panel/*/ |
| Allow | /bitrix/components/*/*/ |
| Allow | /bitrix/cache/*/*/ |
| Allow | /bitrix/js/*/*/ |
| Allow | /bitrix/templates/*/*/ |
| Allow | /bitrix/panel/*/*/ |
| Allow | /bitrix/components/ |
| Allow | /bitrix/cache/ |
| Allow | /bitrix/js/ |
| Allow | /bitrix/templates/ |
| Allow | /bitrix/panel/ |
*
| Rule | Path |
|---|---|
| Disallow | /js/ |
| Disallow | /*?utm* |
| Disallow | /search/ |
| Disallow | /*? |
| Disallow | /bitrix/ |
| Disallow | */sage/ |
| Disallow | */sage-delited/ |
| Disallow | /construction-erp-sandbox/ |
| Disallow | /services/deployment/bitrix24/cloud/ |
| Disallow | /about/our-customers/ |
| Disallow | /products/sage-deleted/sales-module/ |
| Disallow | /about/mission-and-goals/ |
| Disallow | /services/bitrix24-maintenance/ |
| Disallow | /products/sage-deleted/inventory-and-warehouse/ |
| Disallow | /products/erp-dubai/prof/ |
| Disallow | /services/deployment/bitrix24/self-hosted/ |
| Disallow | /services/deployment/bitrix24/ |
| Disallow | /products/erp-dubai/procurement/ |
| Disallow | /products/sage-deleted/purchasing/ |
| Disallow | /products/erp-dubai/budgeting/ |
| Disallow | /products/erp-dubai/production/ |
| Disallow | /products/sage-deleted/customerservice/ |
| Disallow | /services/it-support/promotions/ |
| Disallow | /services/implementation-of-software/business-automation/ |
| Disallow | /products/sage-deleted/bireporting/ |
| Disallow | /products/erp-dubai/treasury/ |
| Disallow | /services/bitrix24-maintenance/ |
| Disallow | /services/deployment/bitrix24/ |
| Disallow | /404.php |
| Disallow | /construction-project-finance/ |
| Allow | /bitrix/*.js |
| Allow | /bitrix/*.css |
| Allow | /bitrix/*.jpg |
| Allow | /bitrix/*.bmp |
| Allow | /bitrix/*.png |
| Allow | /bitrix/*.gif |
| Allow | /bitrix/*.webp |
| Allow | /bitrix/components/*/ |
| Allow | /bitrix/cache/*/ |
| Allow | /bitrix/js/*/ |
| Allow | /bitrix/templates/*/ |
| Allow | /bitrix/panel/*/ |
| Allow | /bitrix/components/*/*/ |
| Allow | /bitrix/cache/*/*/ |
| Allow | /bitrix/js/*/*/ |
| Allow | /bitrix/templates/*/*/ |
| Allow | /bitrix/panel/*/*/ |
| Allow | /bitrix/components/ |
| Allow | /bitrix/cache/ |
| Allow | /bitrix/js/ |
| Allow | /bitrix/templates/ |
| Allow | /bitrix/panel/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://firstbit.ae/sitemap.xml |