Sometimes, milk allergy is considered as lactose intolerance. Milk allergy, on the other hand, is the condition wherein the person is allergic to milk proteins like casein and whey protein. However, in both the cases, patients are advised to avoid food products that are made of milk or any milk products.