cashrewards.com.au
robots.txt
Robots Exclusion Standard data for cashrewards.com.au
Resource Scan
Scan Details
| Site Domain | cashrewards.com.au |
| Base Domain | cashrewards.com.au |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-18T10:03:27+00:00 |
| Next Scan | 2024-05-25T10:03:27+00:00 |
Last Successful Scan
| Scanned | 2024-05-03T10:03:19+00:00 |
| URL | https://cashrewards.com.au/robots.txt |
| Redirect | https://www.cashrewards.com.au/robots.txt |
| Redirect Domain | www.cashrewards.com.au |
| Redirect Base | cashrewards.com.au |
| Domain IPs | 13.226.120.112, 13.226.120.28, 13.226.120.39, 13.226.120.99 |
| Redirect IPs | 108.157.254.100, 108.157.254.115, 108.157.254.123, 108.157.254.18, 2600:9000:2753:2600:2:4935:bc00:93a1, 2600:9000:2753:3a00:2:4935:bc00:93a1, 2600:9000:2753:5200:2:4935:bc00:93a1, 2600:9000:2753:5600:2:4935:bc00:93a1, 2600:9000:2753:7600:2:4935:bc00:93a1, 2600:9000:2753:8000:2:4935:bc00:93a1, 2600:9000:2753:e000:2:4935:bc00:93a1, 2600:9000:2753:ee00:2:4935:bc00:93a1 |
| Response IP | 108.157.254.100 |
| Found | Yes |
| Hash | c0e6d68153d3c89989236372b4bc53820f0b37b3128e6935b29a85a67bad6a18 |
| SimHash | bb3dfc00f930 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /rewards/ |
| Disallow | /get-paid/ |
| Disallow | /settings/ |
| Disallow | /members* |
| Disallow | /feedback.asp* |
| Disallow | /go/* |
| Disallow | /track/* |
| Disallow | /favourite |
| Disallow | /Error/* |
| Disallow | /memberinfo |
| Disallow | /siftorder |
| Disallow | /en/privacy |
| Disallow | /en/terms-and-conditions |
| Disallow | /cashrewards/specialterms/* |
| Disallow | /coupons/* |
| Disallow | /search* |
| Disallow | /search/* |
| Disallow | /en/search* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cashrewards.com.au/en/sitemap.xml |