Recipes Creation Using Food Images Through Inverse Cooking

Main Article Content

Shaik Imam Saheb, Ubaidullah Khan, Mohd Shahrukh, Mohd Imaduddin, Amatul Kareem Sariya


People like taking pictures of food because they like food. Behind every meal is a complicated recipe that tells its story. Unfortunately, we can't see how it was made just by looking at a picture of it. So, in this paper, we show an inverse cooking system that can make recipes from pictures of food. Our system guesses ingredients as sets by using a new architecture to model their dependencies without forcing any order. It then makes cooking instructions by looking at both the image and its guesses for ingredients at the same time [8]. We test the whole system on the massive Recipe1M dataset and show that: (1) we improve performance compared to earlier baseline methods for nutritional information prediction; (2) we can get high-quality recipes by using both images and ingredients; and (3) according to human judgement, our system can make more interesting recipes than retrieval-based methods. We share code and models with the public.

Article Details