autoguru.com
robots.txt

Robots Exclusion Standard data for autoguru.com

Resource Scan

Scan Details

Site Domain autoguru.com
Base Domain autoguru.com
Scan Status Ok
Last Scan2025-09-04T19:15:17+00:00
Next Scan 2025-09-18T19:15:17+00:00

Last Scan

Scanned2025-09-04T19:15:17+00:00
URL https://www.autoguru.com/robots.txt
Redirect https://www.autoguru.com.au:443/robots.txt
Redirect Domain www.autoguru.com.au
Redirect Base autoguru.com.au
Domain IPs 13.55.222.212, 54.66.190.43, 54.79.68.166
Redirect IPs 13.33.45.127, 13.33.45.44, 13.33.45.45, 13.33.45.88
Response IP 13.33.45.127
Found Yes
Hash 9a8756831f46a4de129b27a0ce23e61e4ce93add477e88c27fb97cf80ea4a4e6
SimHash 2210fa688373

Groups

yandex

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

baiduspider

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

exabot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /1c3319e3-f0e9-493d-af5c-9e7ae3ea12cb/
Disallow /mechanic-quote/
Disallow /quote-2/
Disallow /rego-quote/
Disallow /car-parking/
Disallow /driving-lessons/
Disallow /towing/
Disallow /Booking

Other Records

Field Value
sitemap https://www.autoguru.com.au/sitemap_index.xml