24htv.eu
robots.txt

Robots Exclusion Standard data for 24htv.eu

Resource Scan

Scan Details

Site Domain 24htv.eu
Base Domain 24htv.eu
Scan Status Ok
Last Scan2025-09-05T23:55:58+00:00
Next Scan 2025-09-12T23:55:58+00:00

Last Scan

Scanned2025-09-05T23:55:58+00:00
URL http://24htv.eu/robots.txt
Domain IPs 188.138.25.75
Response IP 188.138.25.75
Found Yes
Hash 395352c8297cb993df15b74121be26d3c6a94dc5f2f7f571da094d31fb42c43e
SimHash 301411218b95

Groups

ms search 4.0 robot

Rule Path
Disallow /

mozilla/4.0 (compatible; msie 4.01; windows nt; ms search 4.0 robot) microsoft

Rule Path
Disallow /

ahrefsbot
ahrefsbot/4.0
ahrefsbot/5.0 (+http://ahrefs.com/robot/)
mj12bot
mj12bot/v1.4.3
mj12bot/v1.4.4 (http://www.majestic12.co.uk/bot.php?+)
fetcher7.mail.ru
fetcher8.mail.ru
fetcher7-7.p.mail.ru
fetcher1-3.p.mail.ru
fetcher1-4.p.mail.ru
fetcher1-5.p.mail.ru
fetcher1-6.p.mail.ru
fetcher1-7.p.mail.ru
fetcher2-1.p.mail.ru
fetcher2-2.p.mail.ru
fetcher2-3.p.mail.ru
fetcher2-4.p.mail.ru
fetcher2-5.p.mail.ru
fetcher2-6.p.mail.ru
fetcher2-7.p.mail.ru
fetcher3-1.p.mail.ru
fetcher3-2.p.mail.ru
fetcher3-3.p.mail.ru
fetcher3-4.p.mail.ru
fetcher3-5.p.mail.ru
fetcher3-6.p.mail.ru
fetcher3-7.p.mail.ru
fetcher4-3.p.mail.ru
fetcher4-4.p.mail.ru
fetcher4-7.p.mail.ru
fetcher7-1.p.mail.ru
fetcher7-2.p.mail.ru
fetcher7-3.p.mail.ru
fetcher7-4.p.mail.ru
fetcher7-5.p.mail.ru
fetcher7-6.p.mail.ru
fetcher8-1.p.mail.ru
fetcher8-2.p.mail.ru
fetcher8-3.p.mail.ru
fetcher8-4.p.mail.ru
fetcher8-5.p.mail.ru
fetcher8-6.p.mail.ru
fetcher2.mail.ru
fetcher8-7.p.mail.ru
fetcher1-1.p.mail.ru
fetcher1-2.p.mail.ru
fetcher5.mail.ru
fetcher5-1.p.mail.ru
fetcher5-2.p.mail.ru
fetcher5-3.p.mail.ru
fetcher5-4.p.mail.ru
fetcher5-5.p.mail.ru
fetcher5-6.p.mail.ru
fetcher5-7.p.mail.ru

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /App_GlobalResources/
Disallow /bin/
Disallow /Components/
Disallow /controls/
Disallow /DesktopModules/
Disallow /HttpModules/
Disallow /images/
Disallow /Install/
Disallow /js/
Disallow /Providers/
Disallow /Terms/Default.aspx
Disallow /Terms.aspx
Disallow /Privacy/Default.aspx
Disallow /Privacy.aspx
Disallow /errorpage.htm
Disallow /terms/default.aspx
Disallow /terms.aspx
Disallow /privacy/default.aspx
Disallow /privacy.aspx

msnbot

Rule Path
Disallow /admin/
Disallow /App_GlobalResources/
Disallow /bin/
Disallow /Components/
Disallow /controls/
Disallow /DesktopModules/
Disallow /HttpModules/
Disallow /images/
Disallow /Install/
Disallow /js/
Disallow /Providers/
Disallow /Terms/Default.aspx
Disallow /Terms.aspx
Disallow /Privacy/Default.aspx
Disallow /Privacy.aspx
Disallow /errorpage.htm
Disallow /terms/default.aspx
Disallow /terms.aspx
Disallow /privacy/default.aspx
Disallow /privacy.aspx

slurp

Rule Path
Disallow /admin/
Disallow /App_GlobalResources/
Disallow /bin/
Disallow /Components/
Disallow /controls/
Disallow /DesktopModules/
Disallow /HttpModules/
Disallow /images/
Disallow /Install/
Disallow /js/
Disallow /Providers/

googlebot

Rule Path
Disallow /*/ctl/
Disallow /admin/
Disallow /App_GlobalResources/
Disallow /bin/
Disallow /Components/
Disallow /controls/
Disallow /HttpModules/
Disallow /images/
Disallow /Install/
Disallow /js/
Disallow /Providers/
Disallow /Terms/Default.aspx
Disallow /Terms.aspx
Disallow /Privacy/Default.aspx
Disallow /Privacy.aspx
Disallow /errorpage.htm
Disallow /terms/default.aspx
Disallow /terms.aspx
Disallow /privacy/default.aspx
Disallow /privacy.aspx

technoratibot

Rule Path
Disallow /*/ctl/
Disallow /admin/
Disallow /App_GlobalResources/
Disallow /bin/
Disallow /Components/
Disallow /controls/
Disallow /DesktopModules/
Disallow /HttpModules/
Disallow /images/
Disallow /Install/
Disallow /js/
Disallow /Providers/
Disallow /Terms/Default.aspx
Disallow /Terms.aspx
Disallow /Privacy/Default.aspx
Disallow /Privacy.aspx
Disallow /errorpage.htm
Disallow /terms/default.aspx
Disallow /terms.aspx
Disallow /privacy/default.aspx
Disallow /privacy.aspx