tech-write.co.uk
robots.txt

Robots Exclusion Standard data for tech-write.co.uk

Resource Scan

Scan Details

Site Domain tech-write.co.uk
Base Domain tech-write.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-28T10:34:18+00:00
Next Scan 2025-07-27T10:34:18+00:00

Last Successful Scan

Scanned2025-03-07T09:56:48+00:00
URL https://tech-write.co.uk/robots.txt
Domain IPs 2001:8d8:100f:f000::256, 217.160.0.43
Response IP 217.160.0.43
Found Yes
Hash 1d0245bec659c753ef90a0d7304b4928edd824b005e2a0dd1d86590833c3cc4d
SimHash 2e304808a196

Groups

*

Rule Path
Disallow /trackback/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /xmlrpc.php

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

Comments

  • Disallow: /wp-content/
  • Disallow: /wp-