cleartwo.co.uk
robots.txt

Robots Exclusion Standard data for cleartwo.co.uk

Resource Scan

Scan Details

Site Domain cleartwo.co.uk
Base Domain cleartwo.co.uk
Scan Status Ok
Last Scan2025-10-21T04:57:15+00:00
Next Scan 2025-11-20T04:57:15+00:00

Last Scan

Scanned2025-10-21T04:57:15+00:00
URL https://cleartwo.co.uk/robots.txt
Domain IPs 104.21.93.132, 172.67.210.46
Response IP 104.21.93.132
Found Yes
Hash b200d904224f465a77ea8137b0afa262d6099f595ca53a7c4aa072a9c102480d
SimHash eb05c88087a2

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

amazonbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://cleartwo.co.uk/sitemap_index.xml