harpermacleod.co.uk
robots.txt

Robots Exclusion Standard data for harpermacleod.co.uk

Resource Scan

Scan Details

Site Domain harpermacleod.co.uk
Base Domain harpermacleod.co.uk
Scan Status Ok
Last Scan2025-10-05T20:53:52+00:00
Next Scan 2025-11-04T20:53:52+00:00

Last Scan

Scanned2025-10-05T20:53:52+00:00
URL https://harpermacleod.co.uk/robots.txt
Redirect https://www.harpermacleod.co.uk/robots.txt
Redirect Domain www.harpermacleod.co.uk
Redirect Base harpermacleod.co.uk
Domain IPs 104.26.12.222, 104.26.13.222, 172.67.71.247, 2606:4700:20::681a:cde, 2606:4700:20::681a:dde, 2606:4700:20::ac43:47f7
Redirect IPs 104.26.12.222, 104.26.13.222, 172.67.71.247, 2606:4700:20::681a:cde, 2606:4700:20::681a:dde, 2606:4700:20::ac43:47f7
Response IP 104.26.13.222
Found Yes
Hash 614cde8f426e01c68dc3d111a87b461b70aeba5ec4de5ad146acdad8ffc49d28
SimHash 4b455cb5a3b2

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /*?location=
Disallow /*?expertise=
Disallow /*?position=
Disallow /*?article-creator=
Disallow /*?page=
Disallow /*?term=
Disallow /*?*location=
Disallow /*?*expertise=
Disallow /*?*position=
Disallow /*?*article-creator=
Disallow /*?*page=
Disallow /*?*term=
Disallow /*?page_id=
Disallow /*?category=
Disallow /*?__hstc=
Disallow /*?LinkSource=PassleApp
Disallow /tag/
Disallow /*?utm

gptbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.harpermacleod.co.uk/sitemap_index.xml