azeera.com
robots.txt
Robots Exclusion Standard data for azeera.com
Resource Scan
Scan Details
| Site Domain | azeera.com |
| Base Domain | azeera.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-05-17T02:00:30+00:00 |
| Next Scan | 2025-07-16T02:00:30+00:00 |
Last Successful Scan
| Scanned | 2025-02-23T23:17:07+00:00 |
| URL | https://azeera.com/robots.txt |
| Redirect | https://www.azeera.com/robots.txt |
| Redirect Domain | www.azeera.com |
| Redirect Base | azeera.com |
| Domain IPs | 104.26.10.118, 104.26.11.118, 172.67.71.27, 2606:4700:20::681a:a76, 2606:4700:20::681a:b76, 2606:4700:20::ac43:471b |
| Redirect IPs | 104.26.10.118, 104.26.11.118, 172.67.71.27, 2606:4700:20::681a:a76, 2606:4700:20::681a:b76, 2606:4700:20::ac43:471b |
| Response IP | 104.26.11.118 |
| Found | Yes |
| Hash | bba301a19aa36432fc66475508a9b573ab88e481d42efea5810b466fe872ea6f |
| SimHash | e9008c342710 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /ajax/* |
| Disallow | /transactions/* |
| Disallow | /system/* |
| Disallow | /uploads/* |
| Disallow | /vendor/* |
| Disallow | /shipment/* |
| Disallow | /cache/* |
| Disallow | /cart/* |
| Disallow | /backend/* |
| Disallow | /az* |
| Disallow |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.azeera.com/sitemap/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.