YARN-MISTRAL - Longest Context Window of Any LLM
In this video, we look at the newest variant of the Mistral-7B called YaRN-Mistral that has the longest context window of any LLM available today. It supports Context Window update 128K.
Let's Connect:
☕ Buy me a Coffee: https://ko-fi.com/promptengineering
|🔴 Support my work on Patreon: Patreon.com/PromptEngineering
🦾 Discord: https://discord.com/invite/t4eYQRUcXB
📧 Business Contact: engineerprompt@gmail.com
💼Consulting: https://calendly.com/engineerprompt/consulting-call
LINKS:
YaRN-Mistral: https://huggingface.co/NousResearch/Yarn-Mistral-7b-128k
NousResearch: https://huggingface.co/NousResearch
Timestamps:
[00:00] Intro
[00:40] New Mistral
[03:40] Run on Colab
[06:55] Run on LM Studio
[07:45] Local Tests
2023-11-03T12:46:37Z1280
https://www.youtube.com/embed/MQD1n4FqZmU