leukemia-net.org
robots.txt

Robots Exclusion Standard data for leukemia-net.org

Resource Scan

Scan Details

Site Domain leukemia-net.org
Base Domain leukemia-net.org
Scan Status Ok
Last Scan2025-11-19T07:29:49+00:00
Next Scan 2025-12-19T07:29:49+00:00

Last Scan

Scanned2025-11-19T07:29:49+00:00
URL https://leukemia-net.org/robots.txt
Redirect https://www.leukemia-net.org/robots.txt
Redirect Domain www.leukemia-net.org
Redirect Base leukemia-net.org
Domain IPs 46.4.70.46
Redirect IPs 46.4.70.46
Response IP 46.4.70.46
Found Yes
Hash d42e4706f1fdf0f5bf1156542e31d5f99427a3452d2dcccef88325affcf92002
SimHash db6d1032fd10

Groups

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mj12bot/v1.4.5

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

nutch

Rule Path
Disallow /

slurp

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

mtrobot

Rule Path
Disallow /

yandex

Rule Path
Allow /*_rus.html
Disallow /*_ger.html
Disallow /*_eng.html
Disallow /*_tur.html

*

Rule Path
Allow */Management
Disallow */manage
Disallow /*manage?lang=ger$
Disallow /*manage?lang=eng$
Disallow /*manage$
Disallow /*manage_main$
Disallow /*A_
Disallow /*boardId
Disallow /*browse_db
Disallow /*f_zoomImage
Disallow /*index_access
Disallow /*index_ger.html?boardId
Disallow /*index_print_
Disallow /*index_print_eng.html$
Disallow /*index_print_ger.html$
Disallow /*localfs_
Disallow /*login_form
Disallow /*manage$
Disallow /*manage?lang=eng$
Disallow /*manage?lang=ger$
Disallow /*manage_main$
Disallow /*members_only
Disallow /*ns.html
Disallow /*preview_
Disallow /*html?preview=preview
Disallow /*search_
Disallow /*sitemap_
Disallow /*sitemap_eng.html$
Disallow /*sitemap_ger.html$
Disallow /*stats

Warnings

  • 14 invalid lines.