cashrewards.com
robots.txt

Robots Exclusion Standard data for cashrewards.com

Resource Scan

Scan Details

Site Domain cashrewards.com
Base Domain cashrewards.com
Scan Status Ok
Last Scan2024-05-02T22:56:12+00:00
Next Scan 2024-06-01T22:56:12+00:00

Last Scan

Scanned2024-05-02T22:56:12+00:00
URL https://cashrewards.com/robots.txt
Redirect https://www.cashrewards.com.au/robots.txt
Redirect Domain www.cashrewards.com.au
Redirect Base cashrewards.com.au
Domain IPs 18.155.68.119, 18.155.68.128, 18.155.68.49, 18.155.68.6
Redirect IPs 108.157.254.100, 108.157.254.115, 108.157.254.123, 108.157.254.18, 2600:9000:2753:1a00:2:4935:bc00:93a1, 2600:9000:2753:1e00:2:4935:bc00:93a1, 2600:9000:2753:3400:2:4935:bc00:93a1, 2600:9000:2753:3800:2:4935:bc00:93a1, 2600:9000:2753:4c00:2:4935:bc00:93a1, 2600:9000:2753:4e00:2:4935:bc00:93a1, 2600:9000:2753:9a00:2:4935:bc00:93a1, 2600:9000:2753:e400:2:4935:bc00:93a1
Response IP 108.157.254.18
Found Yes
Hash c0e6d68153d3c89989236372b4bc53820f0b37b3128e6935b29a85a67bad6a18
SimHash bb3dfc00f930

Groups

*

Rule Path
Disallow /rewards/
Disallow /get-paid/
Disallow /settings/
Disallow /members*
Disallow /feedback.asp*
Disallow /go/*
Disallow /track/*
Disallow /favourite
Disallow /Error/*
Disallow /memberinfo
Disallow /siftorder
Disallow /en/privacy
Disallow /en/terms-and-conditions
Disallow /cashrewards/specialterms/*
Disallow /coupons/*
Disallow /search*
Disallow /search/*
Disallow /en/search*

Other Records

Field Value
sitemap https://www.cashrewards.com.au/en/sitemap.xml