Build Jarvus AI

Build a fun AI app that can see, greet, hear, remember your conversations, and wait to send async messages.

What you’ll learn
Make Jarvus see and greet you
Give Jarvus the ability to hear you with volume detection
Give Jarvus memory
Give Jarvus the ability to wait before sending reminders

Requirements
Beginner coding experience required. Must have the following installed and set up: rails, postgresql, redis, and an openai api key.

Description
Build a Rails app that integrates with OpenAI. This App is meant to teach In episode 1, we will be using the browser to access the webcam and detect whether or not a user is in sight of the camera. Using this information we will decide whether or not to greet the user. In episode 1a, we will be working on a simple cosmetic improvement to the app to give the app a simple fun interface. In episode 2, we will access the microphone to implement volume detection to transcribe any sufficiently loud audio near the microphone and have back and forth conversations with our Jarvus app. In episode 3, We will then give Jarvus memory to allow continued conversations. Memory will allow Jarvus to keep track of what was said within the context of a single conversation. In episode 4, we will implement a background job queue to allow Jarvus to detect reminders and message users asynchronously. This App is meant to be a simple but powerful starter kit to learning how to build a very basic Jarvus that works on local machines. In the new world of LLMs our app is just the beginning of what is possible when integrating with tools like openAI’s chatgpt. This project should take less than a day to build given a junior level of programming experience and a handful of tools installed and set up. This course shows how easy it is to build apps that work with LLMs and encourages the new generation of app building that moves us to an exciting future.

Who this course is for
All programmers. Learning to build a fun AI app.