Food intolerance is a digestive system response rather than an immune system response. It occurs when something in a food irritates a person’s digestive system or when a person is unable to properly digest or breakdown, the food. Intolerance to lactose, which is found in milk and other dairy products, is the most common food intolerance.