Eval Engineering for AI Developers

This repo contains all the example code needed for the Eval Engineering for AI Developers course taught by Galileo.

Watch past lessons

You can catch recordings of all the past lessons on the Galileo YouTube Channel.

Sign up for the lessons

You can sign up for the remaining lessons for the first cohort from these links:

Prerequisites

To use these sample apps, you will need:

• Python 3.10 or greater installed
• A Galileo account. The free account is fine.
• An OpenAI API key.

Set up the code

To set up each example, you will need to:

• Clone this repo
• Create a new virtual environment
• Install the packages defined in the requirements.txt or pyproject.toml file in each repo
• Copy the provided .env.example files to .env
• Fill in the relevant details in the .env file

Contents of this repo

This repo contains Python code for the course, broken down by lesson and section in the lesson.

Lesson	Sample	Link
1	Basic chatbot	Code
1	Chatbot with evals	Code
1	Fixed chatbot	Code
2	Runzi	Code
3	Runzi	Datasets, prompts, and scripts
4	Runzi	Datasets, prompts, and scripts