Welcome to the LLM for Healthcare Course repository! This repository contains all the Jupyter notebooks used in the course, designed to be run seamlessly on Google Colab.
- Introduction
- Course Structure
- Course Syllabus
- Getting Started
- Notebooks
- Contributing
- License
This repository is part of the LLM for Healthcare Course, which aims to provide a comprehensive understanding of how large language models (LLMs) can be applied in the healthcare domain. The course covers various topics, including data preprocessing, model training, evaluation, and deployment.
The course is divided into several modules, each focusing on a specific aspect of LLMs in healthcare for medical students.
The following is the course syllabus. Please note that the titles and content are subject to minor changes:
| Date | Projected Lecture Topic |
|---|---|
| 8/29/24 | Introduction to Natural Language Processing (NLP) |
| 9/5/24 | Environment setup, Regular Expressions (regex) and Convolutional Neural Networks (CNN); Quiz 1 |
| 9/12/24 | Medicine/Bio NLP Datasets; potential project ideas; Quiz 2 |
| 9/19/24 | Hands-on session: application of NLP methods on open-access datasets; assignment 1 is due. |
| 9/26/24 | Recurrent Neural Networks (RNN); Advanced RNNs: LSTMs, GRUs; Quiz 3 |
| 10/3/24 | Word Embeddings, Text Classification; Quiz 4 |
| 10/10/24 | Language Modeling, Translations, Seq2seq and Attention |
| 10/17/24 | Hands-on session: text classification methods; assignment 2 is due. |
| 10/24/24 | Transformer Architecture and Training, Transformer Models: BERT, GPT, Transfer Learning, Fine Tuning, Model size reduction: pruning, quantization, knowledge distillation; Quiz 5 |
| 10/31/24 | Generative models, Quiz 6 |
| 11/7/24 | LLM Benchmarks and Tests, Chain of Thoughts, Reasoning, Hallucination, LLMs’ Challenges |
| 11/14/24 | Hands-on session: LLMs and Generative models (ex: hugging face, …); assignment 3 is due. |
| 11/21/24 | Data-efficient methods: few-shot learning, zero-shot learning Multimodal architectures (combining text with other modalities like images, and audio); Prompt Engineering, LLM Agents; Quiz 7 |
| 11/28/24 | |
| 12/5/24 | Applications in Biology and Medicine Ethics, fairness, trustful, privacy, Sustainability; Quiz 8 |
| 12/12/24 | LLMs API and open discussion; Final project is due. |
To get started with the notebooks, follow these steps:
Clone the repository:
git clone https://github.com/yourusername/LLM-for-Healthcare-Course.git cd LLM-for-Healthcare-CourseOpen the notebooks in Google Colab:
Each notebook includes a link to open it directly in Google Colab. Simply click the link, and you'll be able to run the notebook in your browser.
Here is a list of the available notebooks:
Contributions are welcome! If you have any suggestions or improvements, please open an issue or submit a pull request.
This project is licensed under the MIT License - see the LICENSE file for details.