graycare.net
robots.txt

Robots Exclusion Standard data for graycare.net

Resource Scan

Scan Details

Site Domain graycare.net
Base Domain graycare.net
Scan Status Ok
Last Scan2024-09-29T07:46:34+00:00
Next Scan 2024-10-06T07:46:34+00:00

Last Scan

Scanned2024-09-29T07:46:34+00:00
URL https://graycare.net/robots.txt
Redirect https://www.graycare.net/robots.txt
Redirect Domain www.graycare.net
Redirect Base graycare.net
Domain IPs 75.2.70.75, 99.83.190.102
Redirect IPs 52.197.0.54, 52.199.221.217, 54.178.223.218
Response IP 13.237.233.226
Found Yes
Hash 421b184303a6a1423319ab83ce796e560d0f0602fd75877f6cc9cfd74bb97052
SimHash 780449408492

Groups

*

Rule Path
Disallow

amazonbot

Rule Path
Disallow

applebot

Rule Path
Disallow

twitterbot

Rule Path
Disallow

facebookbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

youbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.graycare.net/sitemap.xml
sitemap https://www.graycare.net/sitemap.xml