cwbnationalleasing.com
robots.txt

Robots Exclusion Standard data for cwbnationalleasing.com

Resource Scan

Scan Details

Site Domain cwbnationalleasing.com
Base Domain cwbnationalleasing.com
Scan Status Ok
Last Scan2024-05-18T13:14:13+00:00
Next Scan 2024-06-17T13:14:13+00:00

Last Scan

Scanned2024-05-18T13:14:13+00:00
URL https://cwbnationalleasing.com/robots.txt
Domain IPs 104.18.22.61, 104.18.23.61, 2606:4700::6812:163d, 2606:4700::6812:173d
Response IP 104.18.22.61
Found Yes
Hash 9f5c9f72cb320bdec945fb6b1801e16d2ff3d0aa5b54de73455c6904bd9a5ede
SimHash 310c0da379c6

Groups

*

Rule Path
Disallow /en/quickcredit
Disallow /fr/quickcredit
Disallow /en/blog/2014
Disallow /en/blog/2015
Disallow /en/blog/2016
Disallow /fr/blog/2014
Disallow /fr/blog/2015
Disallow /fr/blog/2016
Disallow /en/blog/P10
Disallow /en/blog/P20
Disallow /en/blog/P30
Disallow /en/blog/P40
Disallow /en/blog/P50
Disallow /en/blog/P50
Disallow /en/blog/P60
Disallow /en/blog/P70
Disallow /en/blog/P80
Disallow /en/blog/P90
Disallow /fr/blog/P10
Disallow /fr/blog/P20
Disallow /fr/blog/P30
Disallow /fr/blog/P40
Disallow /fr/blog/P50
Disallow /fr/blog/P50
Disallow /fr/blog/P60
Disallow /fr/blog/P70
Disallow /fr/blog/P80
Disallow /fr/blog/P90
Disallow /en/contest/phil-on-the-sill
Disallow /en/contest/phil-on-the-sill-entry
Disallow /en/thank-you/phil-on-the-sill-thanks
Disallow /en/terms/phil-on-the-sill-rules
Disallow /en/legal/customer-portal-user-agreement
Disallow /en/maintenance
Disallow /fr/maintenance

googlebot

Rule Path
Allow /css
Allow /js
Allow /images
Allow /img
Disallow /en/quickcredit
Disallow /fr/quickcredit
Disallow /en/blog/2014
Disallow /en/blog/2015
Disallow /en/blog/2016
Disallow /fr/blog/2014
Disallow /fr/blog/2015
Disallow /fr/blog/2016
Disallow /en/blog/P10
Disallow /en/blog/P20
Disallow /en/blog/P30
Disallow /en/blog/P40
Disallow /en/blog/P50
Disallow /en/blog/P50
Disallow /en/blog/P60
Disallow /en/blog/P70
Disallow /en/blog/P80
Disallow /en/blog/P90
Disallow /fr/blog/P10
Disallow /fr/blog/P20
Disallow /fr/blog/P30
Disallow /fr/blog/P40
Disallow /fr/blog/P50
Disallow /fr/blog/P50
Disallow /fr/blog/P60
Disallow /fr/blog/P70
Disallow /fr/blog/P80
Disallow /fr/blog/P90
Disallow /en/contest/phil-on-the-sill
Disallow /en/contest/phil-on-the-sill-entry
Disallow /en/thank-you/phil-on-the-sill-thanks
Disallow /en/terms/phil-on-the-sill-rules
Disallow /en/legal/customer-portal-user-agreement
Disallow /uploads/
Disallow /en/sales/peter-cyr
Disallow /en/maintenance
Disallow /fr/maintenance

twitterbot

Rule Path
Allow /uploads/images
Allow /images
Allow /img
Disallow /en/quickcredit
Disallow /fr/quickcredit
Disallow /en/blog/2014
Disallow /en/blog/2015
Disallow /en/blog/2016
Disallow /fr/blog/2014
Disallow /fr/blog/2015
Disallow /fr/blog/2016
Disallow /en/blog/P10
Disallow /en/blog/P20
Disallow /en/blog/P30
Disallow /en/blog/P40
Disallow /en/blog/P50
Disallow /en/blog/P50
Disallow /en/blog/P60
Disallow /en/blog/P70
Disallow /en/blog/P80
Disallow /en/blog/P90
Disallow /fr/blog/P10
Disallow /fr/blog/P20
Disallow /fr/blog/P30
Disallow /fr/blog/P40
Disallow /fr/blog/P50
Disallow /fr/blog/P50
Disallow /fr/blog/P60
Disallow /fr/blog/P70
Disallow /fr/blog/P80
Disallow /fr/blog/P90
Disallow /en/contest/phil-on-the-sill
Disallow /en/contest/phil-on-the-sill-entry
Disallow /en/thank-you/phil-on-the-sill-thanks
Disallow /en/terms/phil-on-the-sill-rules
Disallow /en/legal/customer-portal-user-agreement
Disallow /en/maintenance
Disallow /fr/maintenance

Other Records

Field Value
sitemap http://www.nationalleasing.com/sitemap.xml
sitemap http://www.cwbnationalleasing.com/sitemap.xml

Comments

  • www.robotstxt.org/
  • http://code.google.com/web/controlcrawlindex/
  • Disallow: /
  • Sitemap: http://www.cwbationalleasing.com/site/sitemap
  • Allow: /uploads/images
  • Disallow: /uploads/reps/
  • Disallow: /uploads/images/
  • Disallow: /uploads/timeline/