carbuyer.co.uk
robots.txt

Robots Exclusion Standard data for carbuyer.co.uk

Resource Scan

Scan Details

Site Domain carbuyer.co.uk
Base Domain carbuyer.co.uk
Scan Status Ok
Last Scan2025-03-15T18:05:11+00:00
Next Scan 2025-03-22T18:05:11+00:00

Last Scan

Scanned2025-03-15T18:05:11+00:00
URL https://carbuyer.co.uk/robots.txt
Domain IPs 3.165.75.12, 3.165.75.40, 3.165.75.56, 3.165.75.81
Response IP 3.165.75.40
Found Yes
Hash 128ed07f68e6977a470ab2d0cf18665ec4ea6928ac5ee5c64d50288a3d493a8f
SimHash 820e99c0c513

Groups

*

Rule Path
Disallow /search/

ahrefsbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.carbuyer.co.uk/sitemap.xml
sitemap https://www.carbuyer.co.uk/sitemap_news.xml

Comments

  • Robots.txt for https://www.carbuyer.co.uk/