LarryGPT – State of LLM Fine-tuning in August 2024

I went through the journey of fine-tuning two small LLMs: Llama 3.1-8B-Instruct and GPT-3.5-Turbo on a fun dataset of GPT-4o generated conversations in the style of Larry David. All the code for this project and evaluation results are openly accessible.