suria.my
robots.txt

Robots Exclusion Standard data for suria.my

Resource Scan

Scan Details

Site Domain suria.my
Base Domain suria.my
Scan Status Ok
Last Scan2024-11-14T06:06:59+00:00
Next Scan 2024-11-21T06:06:59+00:00

Last Scan

Scanned2024-11-14T06:06:59+00:00
URL https://suria.my/robots.txt
Domain IPs 13.35.210.114, 13.35.210.15, 13.35.210.36, 13.35.210.73
Response IP 13.35.210.114
Found Yes
Hash 3e5ec24f19ce238c97016e8b3af26939df28859570b9433cbd6903abbf59e2c2
SimHash 6d847224c513

Groups

*

Rule Path
Disallow /bin/
Disallow /temp/
Disallow /themes/

ahrefsbot/6.1

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

cutbot;+1.5

Rule Path
Disallow /

cutbot/1.5

Rule Path
Disallow /

cutbot/+1.5

Rule Path
Disallow /

slurp

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

toutiaospider

Rule Path
Disallow /

toutiaospider/1.0

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider/2.0

Rule Path
Disallow /

baiduspider-render

Rule Path
Disallow /

baiduspider-render/2.0

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot/3~bl

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandeximages/3.0

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

paperlibot/2.1

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider/4.0

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

cliqzbot/2.0

Rule Path
Disallow /

voluumdsp-content-bot/2.0

Rule Path
Disallow /

dotbot/1.1

Rule Path
Disallow /

ahrefsbot/5.2

Rule Path
Disallow /

ahrefsbot/6.1

Rule Path
Disallow /

freshbot/4.0

Rule Path
Disallow /