alike.io
robots.txt

Robots Exclusion Standard data for alike.io

Resource Scan

Scan Details

Site Domain alike.io
Base Domain alike.io
Scan Status Ok
Last Scan2024-10-03T02:48:26+00:00
Next Scan 2024-10-17T02:48:26+00:00

Last Scan

Scanned2024-10-03T02:48:26+00:00
URL https://alike.io/robots.txt
Domain IPs 13.33.30.107, 13.33.30.40, 13.33.30.50, 13.33.30.64
Response IP 13.33.30.64
Found Yes
Hash e30a53404ca1ba84faba7db34c9297789e493b11a07258f3839abe0511ac4795
SimHash b018c902f0a0

Groups

*

Rule Path
Disallow

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

image2dataset

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /