myprivatetutor.my
robots.txt

Robots Exclusion Standard data for myprivatetutor.my

Resource Scan

Scan Details

Site Domain myprivatetutor.my
Base Domain myprivatetutor.my
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-30T06:21:13+00:00
Next Scan 2025-12-29T06:21:13+00:00

Last Successful Scan

Scanned2024-11-12T04:02:43+00:00
URL https://www.myprivatetutor.my/robots.txt
Domain IPs 104.26.0.82, 104.26.1.82, 172.67.71.55, 2606:4700:20::681a:152, 2606:4700:20::681a:52, 2606:4700:20::ac43:4737
Response IP 104.26.1.82
Found Yes
Hash fe04ab9725e57eec1a81c5fd28c1214a5a93c1d7c6e55e7b6d215b5fe93a39ac
SimHash 6a7cdc40e21b

Groups

*

Rule Path
Disallow *?pg=*
Disallow /blog/search?q=*

yandexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

ahrefbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

bomborabot

Rule Path
Disallow /

Other Records

Field Value
sitemap /sitemap.xml

Comments

  • Disallow: /terms
  • Disallow: /privacy
  • Disallow: /blognew
  • tkt: 160101-06245