goauto.ca
robots.txt

Robots Exclusion Standard data for goauto.ca

Resource Scan

Scan Details

Site Domain goauto.ca
Base Domain goauto.ca
Scan Status Ok
Last Scan2024-11-12T20:41:56+00:00
Next Scan 2024-12-12T20:41:56+00:00

Last Scan

Scanned2024-11-12T20:41:56+00:00
URL https://goauto.ca/robots.txt
Redirect https://www.goauto.ca/robots.txt
Redirect Domain www.goauto.ca
Redirect Base goauto.ca
Domain IPs 3.167.69.107, 3.167.69.16, 3.167.69.68, 3.167.69.97
Redirect IPs 13.33.28.4, 13.33.28.42, 13.33.28.46, 13.33.28.77, 2600:9000:21e1:2c00:11:454d:ac40:93a1, 2600:9000:21e1:5c00:11:454d:ac40:93a1, 2600:9000:21e1:a400:11:454d:ac40:93a1, 2600:9000:21e1:b200:11:454d:ac40:93a1, 2600:9000:21e1:c00:11:454d:ac40:93a1, 2600:9000:21e1:cc00:11:454d:ac40:93a1, 2600:9000:21e1:ec00:11:454d:ac40:93a1, 2600:9000:21e1:fe00:11:454d:ac40:93a1
Response IP 13.33.28.4
Found Yes
Hash 465949c73838809735552b50f67031611c5a568df3e4382b2309cb070396c06c
SimHash 43501d562537

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.goauto.ca/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.goauto.ca/
  • live - don't allow web crawlers to index cpresources/ or vendor/