Digital Habitats site is for the private development of communities. Signup to this site to get an account and password for access to customized content.
Run MemGPT 🧠 with Local LLMs | Without OpenAI

Run MemGPT 🧠 with Local LLMs | Without OpenAI

In this video, I will show you how to run MemGPT with Local LLMs by serving them through an API server (Textgen WebUI). I will walk you through a step by step process. Commands: Running WebUI API: python --api --api-blocking-port 5050 \ --model airoboros-l2-70b-3.1.2.Q4_K_M.gguf\ --loader llama.cpp --n-gpu-layers 1 --n_ctx 4096 \ --threads 8 --threads-batch 8 --n_batch 512 Let's Connect: ☕ Buy me a Coffee: |🔴 Support my work on Patreon: 🦾 Discord: 💼Consulting: Links: MemGPT website: MemGPT Repo: MemGPT Video: Timestamps: [00:00] Intro [01:10] Installing Textgen WebUI [05:35] Setup MemGPT [08:30] Oobabooga TextGen WebUI API [11:43] Run MemGPT with Local LLMs 2023-10-27T10:30:10Z1280


Leave a comment

#WebChat .container iframe{ width: 100%; height: 100vh; }