mlm-planet.net.ua
robots.txt

Robots Exclusion Standard data for mlm-planet.net.ua

Resource Scan

Scan Details

Site Domain mlm-planet.net.ua
Base Domain mlm-planet.net.ua
Scan Status Ok
Last Scan2024-11-13T22:06:12+00:00
Next Scan 2024-11-20T22:06:12+00:00

Last Scan

Scanned2024-11-13T22:06:12+00:00
URL https://mlm-planet.net.ua/robots.txt
Domain IPs 185.68.16.183, 2a00:7a60:0:10b7::1
Response IP 185.68.16.183
Found Yes
Hash 8b2a662aa7c7259d4c1eba9e316af9f752bfebe56573f62633a88ad324f25ede
SimHash 6314c0a064b1

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /secret/
Disallow /files/
Disallow /backup/
Disallow /cache/
Disallow /getfile/
Disallow /system/
Disallow /search/
Disallow /users/
Disallow /users/register.html
Disallow /download.php?
Disallow *peptide.mlm-planet.net.ua/infomed/informaciya_o_peptidah_v_sostave_sredstv_vivax_dent.html
Disallow *peptide.mlm-planet.net.ua/infomed/informaciya_o_peptidah_v_sostave_sredstv_vivax.html
Disallow *vk.mlm-planet.net.ua/articles/vivax/iz_sekretnyh_materalov.html
Disallow /captcha.php?
Disallow *?action=addbasket*
Disallow *?action=delbasket*
Disallow *undefined*
Disallow *mysqli*
Disallow */files/*

webalta

Rule Path
Disallow /

slurp

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefsbot/2.0

Rule Path
Disallow /

ahrefsbot/3.1

Rule Path
Disallow /

ezooms.bot@gmail.com

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

ezooms/1.0

Rule Path
Disallow /

ezooms/1.0; ezooms.bot@gmail.com

Rule Path
Disallow /

exabot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

solomonobot

Rule Path
Disallow /

sindicebot

Rule Path
Disallow /

snappreviewbot

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

gslfbot

Rule Path
Disallow /

swebot/1.0

Rule Path
Disallow /