whizz.ae
robots.txt
Robots Exclusion Standard data for whizz.ae
Resource Scan
Scan Details
| Site Domain | whizz.ae |
| Base Domain | whizz.ae |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-05T07:30:55+00:00 |
| Next Scan | 2024-12-04T07:30:55+00:00 |
Last Successful Scan
| Scanned | 2024-04-16T07:28:29+00:00 |
| URL | https://whizz.ae/robots.txt |
| Redirect | https://www.whizz.ae/robots.txt |
| Redirect Domain | www.whizz.ae |
| Redirect Base | whizz.ae |
| Domain IPs | 104.26.8.152, 104.26.9.152, 172.67.71.153, 2606:4700:20::681a:898, 2606:4700:20::681a:998, 2606:4700:20::ac43:4799 |
| Redirect IPs | 104.26.8.152, 104.26.9.152, 172.67.71.153, 2606:4700:20::681a:898, 2606:4700:20::681a:998, 2606:4700:20::ac43:4799 |
| Response IP | 104.26.9.152 |
| Found | Yes |
| Hash | 9dc1ccf418f77be9b860dfb60adeed3f4315de70e7a02d5d7937f0b683abc506 |
| SimHash | 014fddc064bb |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /reactjs |
| Disallow | /demo |
| Disallow | /beta |
| Disallow | /aramex |
| Disallow | /cron |
| Disallow | /crawlproducts |
| Disallow | /mwstracking |
| Disallow | /account/ |
| Disallow | /search/ |
| Disallow | /index.php/?route=product%2Fsearch%2F |
| Disallow | /index.php/?route=product%2Fproduct%2Freview%2F |
| Disallow | /productprice |
| Disallow | *productprice*. |
| Disallow | */bid%3A* |
| Disallow | /index.php/ |
| Allow | *.js* |
| Allow | *.css* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.whizz.ae/sitemap.xml |
Comments