wtcad.ae
robots.txt
Robots Exclusion Standard data for wtcad.ae
Resource Scan
Scan Details
| Site Domain | wtcad.ae |
| Base Domain | wtcad.ae |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-07-09T06:07:37+00:00 |
| Next Scan | 2024-10-07T06:07:37+00:00 |
Last Successful Scan
| Scanned | 2024-02-18T04:23:15+00:00 |
| URL | https://wtcad.ae/robots.txt |
| Redirect | https://www.wtcad.ae/robots.txt |
| Redirect Domain | www.wtcad.ae |
| Redirect Base | wtcad.ae |
| Domain IPs | 2600:1413:1::1720:1d5a, 2600:1413:1::1720:1d69, 96.17.96.12, 96.17.96.31 |
| Redirect IPs | 2600:1413:1::1720:1d5a, 2600:1413:1::1720:1d69, 96.17.96.12, 96.17.96.31 |
| Response IP | 23.59.168.121 |
| Found | Yes |
| Hash | 5f8bdc3bfcbf737864217893b026afe3f24229f1b89702efb82d1828595cdb2f |
| SimHash | 295c98a657b0 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /App_Plugins/ |
| Disallow | /arabic/ |
| Disallow | /ar-ae/ |
| Disallow | /css/ |
| Disallow | /en-us/ |
| Disallow | /Event-ar/ |
| Disallow | /DesktopModules/ |
| Disallow | /Handlers/ |
| Disallow | /html/ |
| Disallow | /umbraco/ |
| Disallow | /email_friend.aspx* |
| Disallow | /EventDetails.aspx* |
| Disallow | /newsdetails.aspx* |
| Disallow | /offerdetails.aspx* |
| Disallow | /contents.aspx* |
| Disallow | /Storedetails.aspx* |
| Disallow | /Stores.aspx* |
Other Records
| Field | Value |
|---|---|
| sitemap | http://{HTTP_HOST}/en/xml-sitemap/ |
| sitemap | http://{HTTP_HOST}/ar/xml-sitemap/ |