Log In Sign Up

www2.mudah.my
robots.txt

Robots Exclusion Standard data for www2.mudah.my

Resource Scan

Scan Details

Site Domain www2.mudah.my
Base Domain mudah.my
Scan Status Ok
Last Scan2024-11-15T18:03:20+00:00
Next Scan 2024-11-22T18:03:20+00:00

Last Scan

Scanned2024-11-15T18:03:20+00:00
URL https://www2.mudah.my/robots.txt
Domain IPs 104.17.79.116, 104.17.80.116
Response IP 104.17.79.116
Found Yes
Hash 05855035b029501c1ac4e628cfbb9a0badea46276180d0ede60273c7e7752671
SimHash 635d511547d5

Groups

googlebot

Rule Path
Disallow /
Allow /ai/form/0

scooter

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow
Disallow /support

schibstedsokbot

Rule Path
Disallow /

expo9

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /
Allow /ai/form/0

adsbot-google

Rule Path
Disallow /
Allow /ai/form/0

grapeshot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /
Allow /ai/form/0

ahrefssiteaudit

Rule Path
Disallow /
Allow /ai/form/0

bingbot

Rule Path
Disallow /
Allow /ai/form/0

yandex

Rule Path
Disallow /
Allow /ai/form/0

speobot

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top

Comments

  • It is expressly forbidden to use spiders or other
  • automated methods to access mudah.my. Only if mudah.my
  • has given special permit such access is allowed.
Back to top