Everyone's body is different, in general dairy poo is just bad for you. I eat eggs and Greek yogurt as only exceptions and I limit them. Milk has good stuff in it no doubt, has a lot of bad too though. Milk does a body good and got milk ads were made by dairy industries not any health institution.
Skim milk is good, Almond milk is even better and there are even better subtites out there. I like NutMilk with pea Protein.
Maybe it's just me but I feel dairy is like smoking now days everyone knows it's not good for you. Moderation is key, but substitutes are better.