AI, Synthetic Intelligence - October 25, 2023

Meet the AI Engineer who Fine-tuned Mistral 7B on Personal Journals [Harper Carroll Expert Tutorial]

https://i.ytimg.com/vi/ztPoCymwIp0/maxresdefault.jpg In this Expert Tutorial, Harper S Carroll (Head of AI/ML) from Brev Dev teaches us how to fine-tune Mistral AI 7B parameter on our personal data. This tutorial goes through many fine-tuning intricacies such as Dataset Preparation, Model Validation and so on. 🚀 Timestamp 🚀 00:00 Intro 00:46 Dataset Preparation for Mistral Fine-Tuning 02:52 GPU Setup 03:40 FineTune Mistral 7B 06:52 Tokenization - Deep Dive 11:15 LoRA - Deep Dive 13:01 Weights & Biases Setup 13:14 Finetuning Mistral 7B on custom data 14:46 OverFitting 17:36 Fine-Tuned Model Validation 17:50 Fine-Tuned Mistral Demo 🔗 Links from the Expert 🔗 Notebook: https://github.com/brevdev/notebooks/... Notebook to fine-tune on a HF dataset: https://github.com/brevdev/notebooks/... How QLoRA works: https://brev.dev/blog/how-qlora-works Join the BrevDev Discord: https://discord.com/invite/NVDyv7TUgJ Find Harper on X: https://x.com/HarperSCarroll How to Fine-Tune Mistral 7B on Your Own Data https://youtu.be/kmkcNVvEz-k ❤️ If you want to support the channel ❤️ Support here: Patreon - https://www.patreon.com/1littlecoder/ Ko-Fi - https://ko-fi.com/1littlecoder 🧭 Follow me on 🧭 Twitter - https://twitter.com/1littlecoder Linkedin - https://www.linkedin.com/in/amrrs/ Meet the AI Engineer who Fine-tuned Mistral 7B on Personal Journals [Harper Carroll Expert Tutorial]

------------------------------------- 0:18:46 2023-10-25T06:00:16Z ztPoCymwIp0