carcostcanada.com
robots.txt

Robots Exclusion Standard data for carcostcanada.com

Resource Scan

Scan Details

Site Domain carcostcanada.com
Base Domain carcostcanada.com
Scan Status Ok
Last Scan2025-04-03T18:28:59+00:00
Next Scan 2025-04-10T18:28:59+00:00

Last Scan

Scanned2025-04-03T18:28:59+00:00
URL https://carcostcanada.com/robots.txt
Domain IPs 104.21.71.69, 172.67.143.187, 2606:4700:3034::ac43:8fbb, 2606:4700:3037::6815:4745
Response IP 172.67.143.187
Found Yes
Hash 733b888e44c6018c65633b02a5b22aafc97b91e80cd63ecfa032f5b5f9ba7b25
SimHash b9da20d9c550

Groups

*

Rule Path
Disallow /Account/
Disallow /BuyNow/
Disallow /Dashboard/
Disallow /InvoicePriceReport/
Disallow /Manage/
Disallow /Payment/
Disallow /PivotalRecurringUpdate/
Disallow /Canada/ModelsJson
Disallow /Canada/DivisionsJson
Disallow /ExternalUser/
Disallow /bundles/
Disallow /home/sonnet
Disallow /home/wawanesa
Disallow /Home/Articles

Other Records

Field Value
sitemap https://carcostcanada.com/sitemap.xml

Comments

  • leave this extra line at the top so Google Webmasters doesn't complain about 'Syntax not understood' on 'User-agent' line
  • Disallow: /en/nupge/nupge.asp
  • Disallow: /Content/