cars2buy.co.uk
robots.txt

Robots Exclusion Standard data for cars2buy.co.uk

Resource Scan

Scan Details

Site Domain cars2buy.co.uk
Base Domain cars2buy.co.uk
Scan Status Ok
Last Scan2024-09-27T03:36:31+00:00
Next Scan 2024-10-04T03:36:31+00:00

Last Scan

Scanned2024-09-27T03:36:31+00:00
URL https://cars2buy.co.uk/robots.txt
Redirect https://www.cars2buy.co.uk/robots.txt
Redirect Domain www.cars2buy.co.uk
Redirect Base cars2buy.co.uk
Domain IPs 104.22.64.96, 104.22.65.96, 172.67.9.183, 2606:4700:10::6816:4060, 2606:4700:10::6816:4160, 2606:4700:10::ac43:9b7
Redirect IPs 104.22.64.96, 104.22.65.96, 172.67.9.183, 2606:4700:10::6816:4060, 2606:4700:10::6816:4160, 2606:4700:10::ac43:9b7
Response IP 104.22.65.96
Found Yes
Hash d882b56ea6fdfe4d2beabcb8bbb6e8cae0f426ffe1372b4d772009dc6f04906f
SimHash 234c50f0d11b

Groups

*

Rule Path
Disallow /clicks_cache_car_lease.php
Disallow /clicks_cache_van_lease.php
Disallow /vclicks_cache.php
Disallow /clicks_cache.php
Disallow /partners/
Disallow /personal-car-leasing/deal/
Disallow /business-car-leasing/deal/
Allow /

mediapartners-google

Rule Path
Disallow /personal-car-leasing/deal/
Disallow /business-car-leasing/deal/

seokicks-robot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5