mywesleyanmethodists.org.uk
robots.txt

Robots Exclusion Standard data for mywesleyanmethodists.org.uk

Resource Scan

Scan Details

Site Domain mywesleyanmethodists.org.uk
Base Domain mywesleyanmethodists.org.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-28T15:44:10+00:00
Next Scan 2025-12-27T15:44:10+00:00

Last Successful Scan

Scanned2025-08-06T10:54:58+00:00
URL https://mywesleyanmethodists.org.uk/robots.txt
Domain IPs 104.21.88.23, 172.67.150.72, 2606:4700:3032::6815:5817, 2606:4700:3035::ac43:9648
Response IP 104.21.88.23
Found Yes
Hash a8ed9f86da1b4f521f478ca340e6fcdef79074b16dd74d1c0fb2bd8d22b5cea8
SimHash 501449488137

Groups

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /