It's probably the dairy and the extra carbs. Get off the dairy and if you need liquid protein go for egg, beef protein (eg musclemeds carnivor) or plant (e.g. puregreen)
At least, cut out the cow dairy and switch to goat - less hormones
Many things could be contributing - stress, inflammation, diet etc. It's not always about oil - I have super dry skin but get some acne because my pores are extremely tight and get clogged
Use a BHA exfoliator or salicylic wash, make sure it's acidic enough to actually work though. I recommend Paula's Choice 2% liquid and ProActive clarifying night cream.