certifiedtoyota.ca
robots.txt

Robots Exclusion Standard data for certifiedtoyota.ca

Resource Scan

Scan Details

Site Domain certifiedtoyota.ca
Base Domain certifiedtoyota.ca
Scan Status Ok
Last Scan2024-08-29T12:26:45+00:00
Next Scan 2024-09-28T12:26:45+00:00

Last Scan

Scanned2024-08-29T12:26:45+00:00
URL https://certifiedtoyota.ca/robots.txt
Domain IPs 13.227.254.13, 13.227.254.21, 13.227.254.38, 13.227.254.98, 2600:9000:200a:4c00:7:c18d:e040:93a1, 2600:9000:200a:b600:7:c18d:e040:93a1, 2600:9000:200a:b800:7:c18d:e040:93a1, 2600:9000:200a:c000:7:c18d:e040:93a1, 2600:9000:200a:c00:7:c18d:e040:93a1, 2600:9000:200a:dc00:7:c18d:e040:93a1, 2600:9000:200a:e600:7:c18d:e040:93a1, 2600:9000:200a:f800:7:c18d:e040:93a1
Response IP 13.227.254.38
Found Yes
Hash a1e645d090690268888aa67ee9d717b1659cf852a90a5445d44c89eaa18f7caf
SimHash e144a78062b2

Groups

*

Rule Path
Allow /en/
Allow /fr/

Other Records

Field Value
sitemap https://certifiedtoyota.ca/en/sitemap.xml
sitemap https://certifiedtoyota.ca/fr/sitemap.xml

Comments

  • Any search crawler can crawl our site
  • Allow only below mentioned paths
  • Crawl all sitemaps mentioned below