arthurlloyd.co.uk
robots.txt

Robots Exclusion Standard data for arthurlloyd.co.uk

Resource Scan

Scan Details

Site Domain arthurlloyd.co.uk
Base Domain arthurlloyd.co.uk
Scan Status Ok
Last Scan2025-05-20T18:31:22+00:00
Next Scan 2025-05-27T18:31:22+00:00

Last Scan

Scanned2025-05-20T18:31:22+00:00
URL http://arthurlloyd.co.uk/robots.txt
Domain IPs 217.160.0.184
Response IP 217.160.0.184
Found Yes
Hash 1bcb61f3767c8e0dc868718d1fd0e78266fd369335589bb996766fd873108773
SimHash 8004494c2153

Groups

*

Rule Path
Disallow /Templates/
Disallow /404.html

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

Comments

  • robots.txt for http://www.arthurlloyd.co.uk/