guangming.com.my
robots.txt

Robots Exclusion Standard data for guangming.com.my

Resource Scan

Scan Details

Site Domain guangming.com.my
Base Domain guangming.com.my
Scan Status Ok
Last Scan2024-06-24T19:50:39+00:00
Next Scan 2024-07-01T19:50:39+00:00

Last Scan

Scanned2024-06-24T19:50:39+00:00
URL https://guangming.com.my/robots.txt
Domain IPs 104.26.8.95, 104.26.9.95, 172.67.73.182, 2606:4700:20::681a:85f, 2606:4700:20::681a:95f, 2606:4700:20::ac43:49b6
Response IP 104.26.8.95
Found Yes
Hash a0434ac701d2bfa219856524d74980868164d2cd4b8c3280bf151e56f3e49f82
SimHash ea877204cf83

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /myredirect.php?title=*
Disallow /topic/facebook-instant-articles*
Allow /wp-admin/admin-ajax.php

mediapartners-google*

Rule Path
Allow /

popin_agent

Rule Path
Allow /

petalbot

Rule Path
Allow /

mozilla/5.0

Rule Path
Allow /

ahrefsbot/6.1

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

cutbot;+1.5

Rule Path
Disallow /

cutbot/1.5

Rule Path
Disallow /

cutbot/+1.5

Rule Path
Disallow /

slurp

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

toutiaospider

Rule Path
Disallow /

toutiaospider/1.0

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider/2.0

Rule Path
Disallow /

baiduspider-render

Rule Path
Disallow /

baiduspider-render/2.0

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot/3~bl

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexbot/3.0

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandeximages/3.0

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

paperlibot/2.1

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider/4.0

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

cliqzbot/2.0

Rule Path
Disallow /

voluumdsp-content-bot/2.0

Rule Path
Disallow /

dotbot/1.1

Rule Path
Disallow /

ahrefsbot/5.2

Rule Path
Disallow /

ahrefsbot/6.1

Rule Path
Disallow /

freshbot/4.0

Rule Path
Disallow /

grapeshot

Rule Path
Disallow