covertford.com
robots.txt

Robots Exclusion Standard data for covertford.com

Resource Scan

Scan Details

Site Domain covertford.com
Base Domain covertford.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-29T07:28:55+00:00
Next Scan 2025-11-27T07:28:55+00:00

Last Successful Scan

Scanned2024-07-12T17:48:25+00:00
URL https://covertford.com/robots.txt
Redirect https://www.covertford.com/robots.txt
Redirect Domain www.covertford.com
Redirect Base covertford.com
Domain IPs 199.232.192.247, 199.232.196.247
Redirect IPs 199.232.192.247, 199.232.196.247
Response IP 151.101.196.247
Found Yes
Hash 24dc62097a063139e8356a130268a957cc71263b059f5d901fd85792d62cb31c
SimHash 6b1152505f54

Groups

bingbot

Rule Path
Disallow /api/*
Disallow /rss-newinventory.aspx
Disallow /rss-usedinventory.aspx
Disallow /vehicle-ajax.aspx
Disallow /home-ajax.aspx
Disallow /dealeron-js.aspx
Disallow /print-email-vehicledetails.aspx
Disallow /print-email-vehicledetailsvin.aspx
Disallow /rebates.aspx
Disallow /iframespecials.aspx
Allow /*.js?*
Allow /*.css?*
Disallow /*?*
Allow /quote.aspx?*
Allow /testdrive.aspx?*
Allow /findmycar.aspx?*
Disallow /thankyou.aspx
Disallow /ScriptResource.axd
Disallow /WebResource.axd
Disallow /*.axd$
Disallow /fdcampaign-do.aspx
Disallow /iframevideodisplay.aspx
Allow /*.jpg?*
Allow /*.png?*
Allow /*.gif?*
Allow /*.svg?*
Allow /*.ico?*
Allow /*.pdf?*

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /api/*
Disallow /rss-newinventory.aspx
Disallow /rss-usedinventory.aspx
Disallow /vehicle-ajax.aspx
Disallow /home-ajax.aspx
Disallow /dealeron-js.aspx
Disallow /print-email-vehicledetails.aspx
Disallow /print-email-vehicledetailsvin.aspx
Disallow /rebates.aspx
Disallow /iframespecials.aspx
Allow /*.js?*
Allow /*.css?*
Disallow /*?*
Allow /quote.aspx?*
Allow /testdrive.aspx?*
Allow /findmycar.aspx?*
Disallow /thankyou.aspx
Disallow /ScriptResource.axd
Disallow /WebResource.axd
Disallow /*.axd$
Disallow /fdcampaign-do.aspx
Disallow /iframevideodisplay.aspx
Allow /*.jpg?*
Allow /*.png?*
Allow /*.gif?*
Allow /*.svg?*
Allow /*.ico?*
Allow /*.pdf?*

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.covertford.com/sitemap.xml

Warnings

  • 3 invalid lines.