It will probably just take time after you stop eating them again or reduce them A LOT.
Acidophilus may help with discomforts until then.
I've had dairy sensitvities for years. I find that skim milk doesn't bother me much. However since my daughter is also mildly sensitive to lactose and dairy we buy soy milk now. Silk Enhanced(now Plus or something) in plain flavor to me taste the best.