Log In Sign Up

sane.org.uk
robots.txt

Robots Exclusion Standard data for sane.org.uk

Resource Scan

Scan Details

Site Domain sane.org.uk
Base Domain sane.org.uk
Scan Status Ok
Last Scan2024-10-31T06:32:37+00:00
Next Scan 2024-11-30T06:32:37+00:00

Last Scan

Scanned2024-10-31T06:32:37+00:00
URL https://sane.org.uk/robots.txt
Redirect http://www.sane.org.uk/robots.txt
Redirect Domain www.sane.org.uk
Redirect Base sane.org.uk
Domain IPs 141.193.213.10, 141.193.213.11
Redirect IPs 141.193.213.10, 141.193.213.11
Response IP 141.193.213.10
Found Yes
Hash 42fc0e7e31c4d9682374a449ede178e77d8f5440775dce466b2a3bdbc50e8cef
SimHash 392c4a4480b3

Groups

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.sane.org.uk/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
Back to top

Warnings

  • 20 invalid lines.
Back to top