caradvice.com.au
robots.txt

Robots Exclusion Standard data for caradvice.com.au

Resource Scan

Scan Details

Site Domain caradvice.com.au
Base Domain caradvice.com.au
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-05T17:23:02+00:00
Next Scan 2024-12-04T17:23:02+00:00

Last Successful Scan

Scanned2023-08-13T17:15:30+00:00
URL https://www.caradvice.com.au/robots.txt
Redirect https://www.drive.com.au/robots.txt
Redirect Domain www.drive.com.au
Redirect Base drive.com.au
Domain IPs 104.18.160.38, 104.18.161.38, 2606:4700::6812:a026, 2606:4700::6812:a126
Redirect IPs 104.19.150.51, 104.19.151.51, 2606:4700::6813:9633, 2606:4700::6813:9733
Response IP 104.19.151.51
Found Yes
Hash 4ab4ecf237ccb5fa90afc4a48596c5db00c7602d1ad696ef84a718cbe28ca45e
SimHash 68195c05ed52

Groups

*

Rule Path
Disallow /cdn-cgi/rum
Disallow /vehicles/
Disallow /affiliate/

Other Records

Field Value
sitemap https://www.drive.com.au/sitemap_index.xml