canadiandriver.com
robots.txt

Robots Exclusion Standard data for canadiandriver.com

Resource Scan

Scan Details

Site Domain canadiandriver.com
Base Domain canadiandriver.com
Scan Status Ok
Last Scan2024-09-27T09:51:32+00:00
Next Scan 2024-10-04T09:51:32+00:00

Last Scan

Scanned2024-09-27T09:51:32+00:00
URL http://canadiandriver.com/robots.txt
Redirect http://autos.ca/robots.txt
Redirect Domain autos.ca
Redirect Base autos.ca
Domain IPs 209.87.224.162
Redirect IPs 107.154.102.203, 107.154.111.203
Response IP 107.154.102.203
Found Yes
Hash 957a84e91ff640ccafff6b3d3d46593be8a9dac4e10251d37981b09ee2792db7
SimHash 105f9d5c04eb

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /authors/
Disallow /tags/
Disallow /galleries/*/images/*
Disallow /forum/*%3Bwap
Disallow /forum/*%3Bwap2
Disallow /forum/*%3Bimode
Disallow /forum/*action*
Disallow /search/
Disallow /?s=*
Disallow /articles/

Other Records

Field Value
sitemap http://www.autos.ca/stricklysitemap.xml
sitemap http://www.autos.ca/google-news-sitemap.xml
sitemap http://www.autos.ca/forum/sitemap.xml

Comments

  • Disallow: /1991/
  • Disallow: /1992/
  • Disallow: /1993/
  • Disallow: /1994/
  • Disallow: /1995/
  • Disallow: /1996/
  • Disallow: /1997/
  • Disallow: /1998/
  • Disallow: /1999/
  • Disallow: /2000/
  • Disallow: /2001/
  • Disallow: /2002/
  • Disallow: /2003/
  • Disallow: /2004/
  • Disallow: /2005/
  • Disallow: /2006/
  • Disallow: /2007/
  • Disallow: /2008/
  • Disallow: /2009/
  • Disallow: /2010/
  • Disallow: /2011/
  • Disallow: /2012/