YARN-MISTRAL - Longest Context Window of Any LLM
https://i.ytimg.com/vi/MQD1n4FqZmU/maxresdefault.jpg
In this video, we look at the newest variant of the Mistral-7B called YaRN-Mistral that has the longest context window of any LLM available today. It supports Context Window update 128K.
Let's Connect:
☕ Buy me a Coffee: https://ko-fi.com/promptengineering
|🔴 Support my work on Patreon: Patreon.com/PromptEngineering
🦾 Discord: https://discord.com/invite/t4eYQRUcXB
📧 Business Contact: engineerprompt@gmail.com
💼Consulting: https://calendly.com/engineerprompt/consulting-call
LINKS:
YaRN-Mistral: https://huggingface.co/NousResearch/Yarn-Mistral-7b-128k
NousResearch: https://huggingface.co/NousResearch
Timestamps:
[00:00] Intro
[00:40] New Mistral
[03:40] Run on Colab
[06:55] Run on LM Studio
[07:45] Local Tests
YARN-MISTRAL - Longest Context Window of Any LLM
-------------------------------------
0:10:7
2023-11-03T12:46:37Z
MQD1n4FqZmU