volkswagen.com.au
robots.txt
Robots Exclusion Standard data for volkswagen.com.au
Resource Scan
Scan Details
Site Domain | volkswagen.com.au |
Base Domain | volkswagen.com.au |
Scan Status | Ok |
Last Scan | 2025-02-20T03:14:42+00:00 |
Next Scan | 2025-03-22T03:14:42+00:00 |
Last Scan
Scanned | 2025-02-20T03:14:42+00:00 |
URL | https://volkswagen.com.au/robots.txt |
Redirect | https://www.volkswagen.com.au:443/robots.txt |
Redirect Domain | www.volkswagen.com.au |
Redirect Base | volkswagen.com.au |
Domain IPs | 2a01:4dc0:0:4f00::c272:200c, 75.2.59.4 |
Redirect IPs | 23.52.171.144, 23.52.171.161, 2600:1413:b000:13::b857:c193, 2600:1413:b000:13::b857:c19a |
Response IP | 23.52.171.144 |
Found | Yes |
Hash | e46955035babf3d60ccf1a2cf2f4765620b07061ba84dec047605c1ce04c10a5 |
SimHash | 0e22dab1afb3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /en.s7* |
Disallow | /*notification* |
Disallow | /*disclaimer.html |
Disallow | /*.integrator-includes.txt |
Disallow | /en/tools/powerlayer |
Disallow | /en/models/*.std.html |
Disallow | /en/models/*.opt.html |
Disallow | /*.suffix.html |
Disallow | /*?bbo=* |
Disallow | /*%26postcode%3D* |
Disallow | /*ga%3D* |
Disallow | /model-structure/*.html |
Disallow | /service-configs/*.html |
Disallow | /login-content.html |
Disallow | /disclaimer-overview-page.html |
Disallow | /unsupportedBrowserNotification.html |
Disallow | /__layer/* |
Disallow | *campaign%3D |
Disallow | /*.integrator-includes.txt |
Disallow | /*.integrator-includes.json |
Other Records
Field | Value |
---|---|
sitemap | https://www.volkswagen.com.au/en.sitemap.xml |
Comments