dkyj0714s814d.cloudfront.net
robots.txt
Robots Exclusion Standard data for dkyj0714s814d.cloudfront.net
Resource Scan
Scan Details
| Site Domain | dkyj0714s814d.cloudfront.net |
| Base Domain | dkyj0714s814d.cloudfront.net |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-06-17T05:24:16+00:00 |
| Next Scan | 2024-07-17T05:24:16+00:00 |
Last Successful Scan
| Scanned | 2024-05-19T05:23:08+00:00 |
| URL | https://dkyj0714s814d.cloudfront.net/robots.txt |
| Domain IPs | 18.155.68.21, 18.155.68.42, 18.155.68.46, 18.155.68.60, 2600:9000:23d2:1400:1f:772c:eb40:93a1, 2600:9000:23d2:1c00:1f:772c:eb40:93a1, 2600:9000:23d2:5c00:1f:772c:eb40:93a1, 2600:9000:23d2:6c00:1f:772c:eb40:93a1, 2600:9000:23d2:a000:1f:772c:eb40:93a1, 2600:9000:23d2:d600:1f:772c:eb40:93a1, 2600:9000:23d2:e00:1f:772c:eb40:93a1, 2600:9000:23d2:fe00:1f:772c:eb40:93a1 |
| Response IP | 18.155.68.42 |
| Found | Yes |
| Hash | 6fe02470931c804cf739dec880bab8f857055124972cbd49d7ee6ea3eb29f97c |
| SimHash | 35013b612714 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /discount-codes |
| Disallow | /discount-codes/discount-codes/visit |
| Disallow | /aspnet_client/ |
| Disallow | /bin/ |
| Disallow | /config/ |
| Disallow | /data/ |
| Disallow | /macroScripts/ |
| Disallow | /umbraco/ |
| Disallow | /umbraco_client/ |
| Disallow | /usercontrols/ |
| Disallow | /xslt/ |
| Disallow | /content/ |
| Disallow | /categories/ |
| Disallow | /article-content/ |
| Disallow | /gallery-content/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.newidea.com.au/sitemap-news |
| sitemap | https://www.newidea.com.au/sitemap |
| sitemap | https://www.newidea.com.au/discount-codes/sitemap |
Comments