Try to eat soy in its most natural state like edamame. That's where the benefits are. Over processed soy like in veggie burgers or fake turkey slices, etc should be eaten in moderation.
Men won't turn into women if they eat soy.
But boys apparently develop breasts if they drink too much cow's milk since it is so high in estrogen. The estrogen in soy is phytoestrogens which don't have the same effect on us as mammalian estrogen.
Concentrate your diet on fruits, veggies, nuts, whole grains, and legumes and you'll be all set.