carcomparison.co.uk
robots.txt

Robots Exclusion Standard data for carcomparison.co.uk

Resource Scan

Scan Details

Site Domain carcomparison.co.uk
Base Domain carcomparison.co.uk
Scan Status Ok
Last Scan2024-05-27T23:29:16+00:00
Next Scan 2024-06-03T23:29:16+00:00

Last Scan

Scanned2024-05-27T23:29:16+00:00
URL https://carcomparison.co.uk/robots.txt
Domain IPs 199.36.158.100
Response IP 199.36.158.100
Found Yes
Hash 439b453e493e1129b1e76c33fc462881b8a498922c02fb3711ac759a4178d232
SimHash 000419b0e791

Groups

*

Rule Path
Disallow /admin
Disallow /partner-portal

mediapartners-google*

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.thecarcomparison.co.uk/sitemap.xml