Log In Sign Up

megamag.bg
robots.txt

Robots Exclusion Standard data for megamag.bg

Resource Scan

Scan Details

Site Domain megamag.bg
Base Domain megamag.bg
Scan Status Ok
Last Scan2024-11-03T16:10:49+00:00
Next Scan 2024-12-03T16:10:49+00:00

Last Scan

Scanned2024-11-03T16:10:49+00:00
URL https://megamag.bg/robots.txt
Domain IPs 45.158.29.192
Response IP 45.158.29.192
Found Yes
Hash 9cf568ff5b629fd6e8fa4068924e713b874f4313905e087d821d25a207685688
SimHash 721cd303c8a3

Groups

*

Rule Path
Allow /

unknown

Rule Path
Disallow /

sogou

Rule Path
Disallow /

yandex

Rule Path
Disallow /

synthesio

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

obot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

showyoubot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

idmarch

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

seznambot/3.0

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

curious george

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://megamag.bg/sitemap.xml
Back to top

Warnings

  • 2 invalid lines.
  • `host` is not a known field.
Back to top