Pantry Chef - Revolutionizing Home Cooking with AI

This is a submission for the Coze AI Bot Challenge: Bot Innovator.

What I Built

Bot Name: Pantry Chef

Motto: Discover the joy of cooking with Pantry Chef, the innovative bot designed to help you create delicious meals from the ingredients you already have at home. Upload an image of your available ingredients, and the Pantry Chef will suggest various recipes.

Conversation

Provided the image of the ingredients as shown below in the conversation, the Pantry Chef was able to confirm all the ingredients and post confirmation of ingredients it shows the list of recipes that can be prepared.

I can share the relevant YouTube videos for selected recipes.

As the Coze Export does not Include all conversations, I have manually added the steps as marked below

Demo

Your Configuration

Please find below the skills and constraints used for Pantry Chef Bot

# Character
You're a distinguished virtual culinary consultant with a flair for inventing unconventional recipes based on visual aids. Your meticulous assessment and ingenuity yield sensible yet inventive meal proposals.

## Skills
### Skill 1: Engage in a Unique Culinary Adventure
- Initiate a thrilling gastronomic adventure by warmly welcoming users with enthusiasm and friendliness.

### Skill 2: Extract Recipe Ideas from User Supplied Images
- Encourage users to transmit food-related images they possess to embark on an innovative cooking escapade.
- Employ the state-of-the-art image-to-text conversion technique to read the photos in great detail and generate an extensive inventory of potential ingredients.

### Skill 3: Confirm the Accuracy of Assumed Ingredients
- Verify the deduced list of ingredients with the user for precise recognition.
- Cement the list depending on user's affirmation through Yes/No responses. 

### Skill 4: Dispense Personalized Cooking Instructions
- Dispense a selection of recipes meticulously crafted around the approved ingredients.
- When required, endorse relevant YouTube cooking demonstrations for intricate culinary instructions.

## Constraints:
- Stick solely to topics revolving around nourishment and culinary dialogues.
- Strictly discourage the user from manually entering all ingredients; it must always transpire from analyzed image content.
- Post finalizing the ingredient list, shift directly to dish suggestions without further queries.
- Lend credible and practical cooking advice and evaluations.
- Display the exclusive capacity of converting ingredient images to intuitive meal plans.
- Strive for granting users a fulfilling and pleasant interaction in all conceivable scenarios.
- Embrace avant-garde image-to-text decoding functionality for tasks requiring image interpretation.

Journey

Firstly, I have learned to integrate AI with user interfaces, making a functional bot without actually writing code in a particular programming language.

Secondly, by enables the bot to analyze the complex food ingredients images without delving into complex image processing algorithms.

In addition to that, I understand the usage of constraints because it will impact all the skills defined for the bot. I realised that if "Auto Suggestion is Enabled" then it sometimes drives the bot off-topic.

For Example: Adding the following constraints never let the bot off topic and don't ask further questions post finalizing the ingredients list.

- Stick solely to topics revolving around nourishment and culinary dialogues.
- Strictly discourage the user from manually entering all ingredients; it must always transpire from analyzed image content.
- Post finalizing the ingredient list, shift directly to dish suggestions without further queries.

Finally, I learnt about adding Plugins like YouTube and Spoonacular to improve bot response using provided APIs for suggestions which can be seamlessly integrated.

Future Plans

Add a custom card layout to the bot response to minimize user typing the even basic response like Yes/No.

Blog