canadiandriver.com
robots.txt
Robots Exclusion Standard data for canadiandriver.com
Resource Scan
Scan Details
Site Domain | canadiandriver.com |
Base Domain | canadiandriver.com |
Scan Status | Ok |
Last Scan | 2024-09-27T09:51:32+00:00 |
Next Scan | 2024-10-04T09:51:32+00:00 |
Last Scan
Scanned | 2024-09-27T09:51:32+00:00 |
URL | http://canadiandriver.com/robots.txt |
Redirect | http://autos.ca/robots.txt |
Redirect Domain | autos.ca |
Redirect Base | autos.ca |
Domain IPs | 209.87.224.162 |
Redirect IPs | 107.154.102.203, 107.154.111.203 |
Response IP | 107.154.102.203 |
Found | Yes |
Hash | 957a84e91ff640ccafff6b3d3d46593be8a9dac4e10251d37981b09ee2792db7 |
SimHash | 105f9d5c04eb |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /authors/ |
Disallow | /tags/ |
Disallow | /galleries/*/images/* |
Disallow | /forum/*%3Bwap |
Disallow | /forum/*%3Bwap2 |
Disallow | /forum/*%3Bimode |
Disallow | /forum/*action* |
Disallow | /search/ |
Disallow | /?s=* |
Disallow | /articles/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.autos.ca/stricklysitemap.xml |
sitemap | http://www.autos.ca/google-news-sitemap.xml |
sitemap | http://www.autos.ca/forum/sitemap.xml |
Comments