Log In Sign Up

mudah.my
robots.txt

Robots Exclusion Standard data for mudah.my

Resource Scan

Scan Details

Site Domain mudah.my
Base Domain mudah.my
Scan Status Ok
Last Scan3/10/2025, 10:52:18 AM
Next Scan 3/17/2025, 10:52:18 AM

Last Scan

Scanned3/10/2025, 10:52:18 AM
URL https://mudah.my/robots.txt
Redirect https://www.mudah.my/robots.txt
Redirect Domain www.mudah.my
Redirect Base mudah.my
Domain IPs 104.17.79.116, 104.17.80.116
Redirect IPs 104.17.79.116, 104.17.80.116
Response IP 104.17.79.116
Found Yes
Hash 1ee052065d6c7f1bf38bb0c3cb4d02b616f704751789b56faefef85a98e7f337
SimHash 030cd6014d85

Groups

googlebot

Rule Path
Disallow /*l%3D1
Disallow /*th%3D0
Disallow /redir
Disallow /support
Disallow /rules/*
Disallow /about.htm
Disallow /search_tips.htm
Disallow /security
Disallow /pg
Disallow /sendmail
Disallow /abuse
Disallow /bannerads.htm
Disallow /5908/
Disallow /109240778/
Allow /li
Allow /list
Allow /*.htm

expo9

Rule Path
Disallow /*l%3D1
Disallow /*th%3D0
Disallow /redir
Disallow /support
Disallow /rules/*
Disallow /about.htm
Disallow /search_tips.htm
Disallow /security
Disallow /pg
Disallow /sendmail
Disallow /abuse
Disallow /bannerads.htm
Allow /li
Allow /list
Allow /*.htm

mediapartners-google

Rule Path
Disallow /*l%3D1
Disallow /*th%3D0
Disallow /redir
Disallow /support
Disallow /rules/*
Disallow /about.htm
Disallow /search_tips.htm
Disallow /security
Disallow /pg
Disallow /sendmail
Disallow /abuse
Disallow /bannerads.htm
Allow /li
Allow /list
Allow /*.htm

googlebot-image

Rule Path
Disallow /*l%3D1
Disallow /*th%3D0
Disallow /redir
Disallow /support
Disallow /rules/*
Disallow /about.htm
Disallow /search_tips.htm
Disallow /security
Disallow /pg
Disallow /sendmail
Disallow /abuse
Disallow /bannerads.htm
Allow /li
Allow /list
Allow /*.htm

adsbot-google

Rule Path
Disallow /*l%3D1
Disallow /*th%3D0
Disallow /redir
Disallow /support
Disallow /rules/*
Disallow /about.htm
Disallow /search_tips.htm
Disallow /security
Disallow /pg
Disallow /sendmail
Disallow /abuse
Disallow /bannerads.htm
Allow /li
Allow /list
Allow /*.htm

slurp

Rule Path
Disallow /*l%3D1
Disallow /*th%3D0
Disallow /redir
Disallow /support
Disallow /rules/*
Disallow /about.htm
Disallow /search_tips.htm
Disallow /security
Disallow /pg
Disallow /sendmail
Disallow /abuse
Disallow /bannerads.htm
Allow /li
Allow /list
Allow /*.htm

msnbot

Rule Path
Disallow /*l%3D1
Disallow /*th%3D0
Disallow /redir
Disallow /support
Disallow /rules/*
Disallow /about.htm
Disallow /search_tips.htm
Disallow /security
Disallow /pg
Disallow /sendmail
Disallow /abuse
Disallow /bannerads.htm
Allow /li
Allow /list
Allow /*.htm

grapeshot

Rule Path
Disallow /*l%3D1
Disallow /*th%3D0
Disallow /redir
Disallow /support
Disallow /rules/*
Disallow /about.htm
Disallow /search_tips.htm
Disallow /security
Disallow /pg
Disallow /sendmail
Disallow /abuse
Disallow /bannerads.htm
Allow /li
Allow /list
Allow /*.htm

petalbot

Rule Path
Disallow /*l%3D1
Disallow /*th%3D0
Disallow /redir
Disallow /support
Disallow /rules/*
Disallow /about.htm
Disallow /search_tips.htm
Disallow /security
Disallow /pg
Disallow /sendmail
Disallow /abuse
Disallow /bannerads.htm

ahrefssiteaudit

Rule Path
Disallow /*l%3D1
Disallow /*th%3D0
Disallow /redir
Disallow /support
Disallow /rules/*
Disallow /about.htm
Disallow /search_tips.htm
Disallow /security
Disallow /pg
Disallow /sendmail
Disallow /abuse
Disallow /bannerads.htm

bingbot

Rule Path
Disallow /*l%3D1
Disallow /*th%3D0
Disallow /redir
Disallow /support
Disallow /rules/*
Disallow /about.htm
Disallow /search_tips.htm
Disallow /security
Disallow /pg
Disallow /sendmail
Disallow /abuse
Disallow /bannerads.htm

yandex

Rule Path
Disallow /*l%3D1
Disallow /*th%3D0
Disallow /redir
Disallow /support
Disallow /rules/*
Disallow /about.htm
Disallow /search_tips.htm
Disallow /security
Disallow /pg
Disallow /sendmail
Disallow /abuse
Disallow /bannerads.htm

ia_archiver

Rule Path
Disallow

speobot

Rule Path
Disallow /
Allow /.well-known/
Back to top

Other Records

Field Value
sitemap https://www.mudah.my/sitemap.xml
sitemap https://www.mudah.my/sitemap.xml
sitemap https://www.mudah.my/sitemap.xml
sitemap https://www.mudah.my/sitemap.xml
sitemap https://www.mudah.my/sitemap.xml
sitemap https://www.mudah.my/sitemap.xml
sitemap https://www.mudah.my/sitemap.xml
sitemap https://www.mudah.my/sitemap.xml
Back to top

Comments

  • It is expressly forbidden to use spiders or other
  • automated methods to access mudah.my. Only if mudah.my
  • has given special permit such access is allowed.
  • Google
  • all
  • Disallow: /aw
  • Disallow: /st
  • Google Doubleclick gpt network ID
  • Visit-time: 2000-2359 # 04:00-08:00 in Malaysia Time (non-peak time)
  • all
  • Disallow: /aw
  • Disallow: /st
  • all
  • Disallow: /aw
  • Disallow: /st
  • all
  • Disallow: /aw
  • Disallow: /st
  • Visit-time: 2000-2359 # 04:00-08:00 in Malaysia Time (non-peak time)
  • all
  • Disallow: /aw
  • Disallow: /st
  • Yahoo
  • all
  • Disallow: /aw
  • Disallow: /st
  • Visit-time: 2000-2359 # 04:00-08:00 in Malaysia Time (non-peak time)
  • all
  • Disallow: /aw
  • Disallow: /st
  • Visit-time: 2000-2359 # 04:00-08:00 in Malaysia Time (non-peak time)
  • all
  • Disallow: /aw
  • Disallow: /st
  • Visit-time: 2000-2359 # 04:00-08:00 in Malaysia Time (non-peak time)
  • all
  • Disallow: /aw
  • Disallow: /st
  • all
  • Disallow: /aw
  • Disallow: /st
  • all
  • Disallow: /aw
  • Disallow: /st
  • all
  • Disallow: /aw
  • Disallow: /st
Back to top