GenAI-with-LLMs

This repository contains my lab work in “Generative AI with Large Language Models” course offered by DeepLearning.AI and Amazon Web Services on coursera.

• Coursera
• DeepLearning.AI

Lab Resources

Below are the links to the specific lab notebooks. Each notebook is available in two versions: the Initial Version (before running all cells) and the Executed Version (after running all cells).

1. Lab 1: Summarize Dialogue
   Perform dialog summarization using Generative AI. Experiment with in context learning such as zero shot, one shot and few shot inferences and tune associated configuration parameters at inference to influence results.

• Lab 1 Notebook(Initial Version)
• Lab 1 Notebook(Executed Version)

2. Lab 2: Fine-Tune Generative AI Model
   Perform instruction fine tuning on an existing LLM from Hugging Face, Flan-T5 model. Explore both full fine tuning as well as PEFT (Parameter Efficient Fine Tuning) methods such as LoRA (Low Rank Adaptation) and evaluation using ROUGE metrics.

• Lab 2 Notebook(Initial Version)
• Lab 2 Notebook(Executed Version)

3. Lab 3: Fine-Tune Model to Detoxify Summaries
   Further fine tune a Flan-T5 model using reinforcement learning with a reward model such as Meta AI's hate speech reward model to generate less toxic summaries. Use Proximal Policy Optimization (PPO) to fine-tune and detoxify the model.

• Lab 3 Notebook(Initial Version)
• Lab 3 Notebook(Executed Version)

Papers

1. Attention Is All You Need

2. BloombergGPT: A Large Language Model for Finance