carandclassic.com
robots.txt

Robots Exclusion Standard data for carandclassic.com

Resource Scan

Scan Details

Site Domain carandclassic.com
Base Domain carandclassic.com
Scan Status Ok
Last Scan2024-11-08T04:37:27+00:00
Next Scan 2024-11-15T04:37:27+00:00

Last Scan

Scanned2024-11-08T04:37:27+00:00
URL https://carandclassic.com/robots.txt
Redirect https://www.carandclassic.com/robots.txt
Redirect Domain www.carandclassic.com
Redirect Base carandclassic.com
Domain IPs 104.22.34.253, 104.22.35.253, 172.67.37.92, 2606:4700:10::6816:22fd, 2606:4700:10::6816:23fd, 2606:4700:10::ac43:255c
Redirect IPs 104.22.34.253, 104.22.35.253, 172.67.37.92, 2606:4700:10::6816:22fd, 2606:4700:10::6816:23fd, 2606:4700:10::ac43:255c
Response IP 172.67.37.92
Found Yes
Hash 7ebd79884e8ad00d0e7737292d94097cb58e0683078c00de89d748e707a57936
SimHash 196e59457652

Groups

*

Rule Path
Disallow /saved-search/
Disallow /assets/js/tracking/user-flags.js*
Disallow /cdn-cgi/
Disallow /classic_cars.php?*
Disallow *country%3D
Disallow *max_price%3D
Disallow *min_price%3D
Disallow *region%3D
Disallow *sort_1%3D
Disallow *year_from%3D
Disallow *year_to%3D
Disallow *category%3D
Disallow *make%3D
Disallow *advert_type%3D
Disallow *keyword%3D
Disallow *model%3D
Disallow *year%3D
Disallow /account/password
Disallow /account/login?
Disallow /account/saved-searches
Disallow /account/notifications
Disallow /account/my-profile
Disallow /account/my-favourites
Disallow /account/my-adverts
Disallow /account/email/verify
Disallow /magazine/category/*
Disallow /magazine/tag/*
Disallow *%26search*
Disallow /type/6/?page=*
Disallow /maintenance?*
Disallow /contact-us?about=advertising
Disallow /email_form.php?*
Disallow /cat/?page=*
Disallow /it/ricerca*
Disallow /it/user*
Disallow /it/account*
Disallow /it/email_form.php*
Disallow /offerables-new/*
Disallow /it/offerables-new/*
Disallow /search-landings/*
Disallow /la/*
Disallow /it/annunci/la/*
Disallow /webviews/

trovitbot

Rule Path
Disallow /

carsnipbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

omniexplorer_bot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.carandclassic.com/sitemap.xml

Comments

  • /robots.txt file for https://www.carandclassic.com/
  • 30 August 2022
  • 29 July 2018
  • 29 July 2018
  • 23rd Oct 2006
  • 23 Nov 2016