products.carmagazine.co.uk
robots.txt

Robots Exclusion Standard data for products.carmagazine.co.uk

Resource Scan

Scan Details

Site Domain products.carmagazine.co.uk
Base Domain carmagazine.co.uk
Scan Status Ok
Last Scan2024-04-21T00:52:38+00:00
Next Scan 2024-05-21T00:52:38+00:00

Last Scan

Scanned2024-04-21T00:52:38+00:00
URL https://products.carmagazine.co.uk/robots.txt
Domain IPs 13.226.2.29, 13.226.2.42, 13.226.2.9, 13.226.2.94
Response IP 18.165.171.85
Found Yes
Hash 770880680bd46b056163bf5fd6e96f2dedf381c1028caf8773cf14ed121799b6
SimHash 3a1ed960a133

Groups

*

Rule Path
Disallow
Disallow /*itm_source%3Dbibblio
Disallow /*itm_source%3DBibblio

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://products.carmagazine.co.uk/sitemap_index.xml