carandclassic.co.uk
robots.txt

Robots Exclusion Standard data for carandclassic.co.uk

Resource Scan

Scan Details

Site Domain carandclassic.co.uk
Base Domain carandclassic.co.uk
Scan Status Ok
Last Scan2024-05-05T23:38:41+00:00
Next Scan 2024-05-12T23:38:41+00:00

Last Scan

Scanned2024-05-05T23:38:41+00:00
URL https://carandclassic.co.uk/robots.txt
Redirect https://www.carandclassic.com/robots.txt
Redirect Domain www.carandclassic.com
Redirect Base carandclassic.com
Domain IPs 104.21.54.56, 172.67.168.23, 2606:4700:3037::6815:3638, 2606:4700:3037::ac43:a817
Redirect IPs 104.22.34.253, 104.22.35.253, 172.67.37.92, 2606:4700:10::6816:22fd, 2606:4700:10::6816:23fd, 2606:4700:10::ac43:255c
Response IP 104.22.35.253
Found Yes
Hash a071c58875d7969291f8483ad47df67a4acbac04b0125df969a4201b18793e73
SimHash 196e5945f650

Groups

*

Rule Path
Disallow /saved-search/
Disallow /assets/js/tracking/user-flags.js*
Disallow /cdn-cgi/
Disallow /classic_cars.php?*
Disallow *country%3D
Disallow *max_price%3D
Disallow *min_price%3D
Disallow *region%3D
Disallow *sort_1%3D
Disallow *year_from%3D
Disallow *year_to%3D
Disallow *category%3D
Disallow *make%3D
Disallow *advert_type%3D
Disallow *keyword%3D
Disallow *model%3D
Disallow *year%3D
Disallow /account/password
Disallow /account/login?
Disallow /account/saved-searches
Disallow /account/notifications
Disallow /account/my-profile
Disallow /account/my-favourites
Disallow /account/my-adverts
Disallow /account/email/verify
Disallow /magazine/category/*
Disallow /magazine/tag/*
Disallow *%26search*
Disallow /type/6/?page=*
Disallow /maintenance?*
Disallow /contact-us?about=advertising
Disallow /email_form.php?*
Disallow /cat/?page=*
Disallow /it/ricerca*
Disallow /it/user*
Disallow /it/account*
Disallow /it/email_form.php*
Disallow /offerables-new/*
Disallow /it/offerables-new/*
Disallow /webviews/

trovitbot

Rule Path
Disallow /

carsnipbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

omniexplorer_bot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.carandclassic.com/sitemap.xml

Comments

  • /robots.txt file for https://www.carandclassic.com/
  • 30 August 2022
  • 29 July 2018
  • 29 July 2018
  • 23rd Oct 2006
  • 23 Nov 2016