Deep Thought RSS
StreamingLLM - Extend Llama2 to 4 million token & 22x faster inference?
It's hard to get LLM generate big amount of content and take in large inputs; To solve this, introducing StreamingLLM, Extend Llama-2 & Falcon's up to 4 million tokens; 22x faster inference than your standard LLM ⚡️
Now you can even generate the whole book with LLM!
🔗 Links
- Follow me on twitter: https://twitter.com/jasonzhou1993
- Join my AI email list: https://www.ai-jason.com/
- My discord: https://discord.gg/eZXprSaCDE
- StreamingLLM Github: https://github.com/mit-han-lab/streaming-llm
👋🏻 About Me
My name is Jason Zhou, a product designer who shares interesting AI experiments & products. Email me if you need help building AI apps! ask@ai-jason.com
#llama2 #meta #gpt #autogpt #ai #artificialintelligence #tutorial #stepbystep #openai #llm #largelanguagemodels #largelanguagemodel #chatgpt #gpt4 #machinelearning
Google’s AI: This Should Be Impossible!
❤️ Check out Weights & Biases and sign up for a free demo here: https://wandb.me/papers
📝 The paper "RealFill - Reference-Driven Generation for Authentic Image Completion " is available here:
https://realfill.github.io/
Unofficial implementation: https://github.com/thuanz123/realfill
My latest paper on simulations that look almost like reality is available for free here:
https://rdcu.be/cWPfD
Or this is the orig. Nature Physics link with clickable citations:
https://www.nature.com/articles/s41567-022-01788-5
🙏 We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Aleksandr Mashrabov, Alex Balfanz, Alex Haro, Andrew Melnychuk, Benji Rabhan, Bret Brizzee, Bryan Learn, B Shang, Christian Ahlin, Gaston Ingaramo, Geronimo Moralez, Gordon Child, Jace O'Brien, Jack Lukic, John Le, Kenneth Davis, Klaus Busse, Kyle Davis, Lukas Biewald, Martin, Matthew Valle, Michael Albrecht, Michael Tedder, Nikhil Velpanur, Owen Campbell-Moore, Owen Skarpness, Rajarshi Nigam, Ramsey Elbasheer, Richard Sundvall, Steef, Taras Bobrovytsky, Ted Johnson, Thomas Krcmar, Timothy Sum Hon Mun, Torsten Reil, Tybie Fitzhugh, Ueli Gallizzi.
If you wish to appear here or pick up other perks, click here: https://www.patreon.com/TwoMinutePapers
Thumbnail background design: Felícia Zsolnai-Fehér - http://felicia.hu
Károly Zsolnai-Fehér's research works: https://cg.tuwien.ac.at/~zsolnai/
Not Slowing Down: GAIA-1 to GPT Vision Tips, Nvidia B100 to Bard vs LLaVA
From GAIA-1 and UniSim showing that new worlds can be imagined with synthetic data, to Nvidia B100 and X100 suggesting no slow down in compute, this video will argue that AI is not slowing down. I’ll cover what that means in Robotics, Audio, Vision and even fraud, from Disney to LLaVA, Elevenlabs to exclusives from The Information (Nov 6 OpenAI Developer Conference) and Semianalysis.
https://www.patreon.com/AIExplained
GAIA-1 9B: https://wayve.ai/thinking/scaling-gaia-1/
GAIA 1 Paper: https://arxiv.org/abs/2309.17080
Semianalysis Tesla: https://www.semianalysis.com/p/tesla-ai-capacity-expansion-h100 and B100 plus X100: https://www.semianalysis.com/p/nvidias-plans-to-crush-competition
UniSim: https://universal-simulator.github.io/unisim/?s=09 Tesla Optimus: https://www.youtube.com/watch?v=D2vj0WcvH5c
Disney Bot: https://www.theverge.com/2023/10/10/23911040/disney-imagineering-robot-bipedal-balance-free-walking-concept
Levatas ChatGPT robodog: https://twitter.com/svpino/status/1650832349008125952?ref_src=twsrc%5Etfw%7Ctwcamp%5Etweetembed%7Ctwterm%5E1650832349008125952%7Ctwgr%5Ea9dcf33fe398752911e6868838cdef45850dd2e1%7Ctwcon%5Es1_&ref_url=https%3A%2F%2Fwww.fastcompany.com%2F90889271%2Fboston-dynamics-spot-chatgpt-brains
Somatic Cleaner: https://www.youtube.com/watch?v=xY5zqKRy8A8&t=38s
The Information Report: https://www.theinformation.com/articles/openais-revenue-crossed-1-3-billion-annualized-rate-ceo-tells-staff?utm_source=ti_app&rc=sy0ihq
Reuters Report: https://www.reuters.com/technology/openai-plans-major-updates-lure-developers-with-lower-costs-sources-2023-10-11/#:~:text=This%20could%20theoretically%20slash%20costs,developing%20and%20selling%20AI%20software.
Starmer Audio (fake): https://www.wired.co.uk/article/keir-starmer-deepfake-audio
Deepfake Arrests: https://www.cnbc.com/2023/10/10/generative-ai-will-get-a-cold-shower-in-2024-analysts-predict.html
LLaVA Demo: https://llava.hliu.cc/
LLaVA Paper: https://arxiv.org/pdf/2310.03744.pdf
Bard: https://bard.google.com/chat
GPT4V Recursive Loop: https://twitter.com/conradgodfrey/status/1712564282167300226
https://www.patreon.com/AIExplained
Systems Thinking Ep. 5 - Narratives and Metamodernism (Modern Philosophy)
In this in-depth video, the topic of narratives is explored comprehensively. Narratives are defined as the stories we use to make sense of the world.
Different types of narratives are explained, including mythic, religious, cautionary tales, cultural memory, values, political commentary, and scientific narratives. The importance of narratives in human cognition, evolution, and coordinating complex societies is analyzed.
The video then dives deep into metamodernism - characterized by the systematic deconstruction and reconstruction of narratives in light of globalism and the internet. The goal of metamodernism is described as alleviating cognitive dissonance by advancing nuanced narratives and moving to an emergent model of reality.
Key metamodernist concepts covered include:
- Epistemic tribes
- The emergence model of reality with ontological strata
- Bringing narratives from unconscious to conscious
- Hypernarratives
The video concludes by examining current narratives like anti-communism, neoliberalism, AI extinction risk, and the metacrisis through a metamodern lens.
Systems Thinking Ep. 3 - Mastering First Principles
Challenging Conventional Wisdom 🗝️ Conventional wisdom may be wrong, and post-modernism challenges the idea that our knowledge and wisdom are solely based on cultural foundations. 💰 By reusing rockets, SpaceX has not only saved millions of dollars but also reduced the amount of rocket engines lost forever in the ocean. 🤔 Questioning the academic establishment and challenging conventional wisdom allows for new perspectives and discoveries. 🧠 Our beliefs and assumptions are heavily influenced by familial, cultural, and educational factors, often leading us to default back to these ingrained memories even when we know better. 🐠 Stepping outside of our...
Tags
- All
- Agentic AI
- AGI
- AI
- AI Art
- AI Ethics
- AI Girlfriends
- AI Models
- AI Risk
- ai tools
- Alan D. Thompson
- Alexandr Wang
- Andrew Huberman
- Andrew Ng
- Artificial Cognition
- Aurora Supercomputer
- Authenticity
- Autism Spectrum
- AutoGPT
- Aza Raskin
- Azure Open AI
- Azure OpenAI Service
- Bias Compensation
- Bias Therapy
- Brian Roemmele
- Chain-of-Thought Prompting
- ChatGPT
- Christopher Rufo
- climate change
- Cognition Enhancement
- Cognitive Bias
- Cognitive Content
- Cognitive Performance
- Collective Intelligence
- Collective Stupidity
- Communication
- Consciousness
- Cosmology
- Critical Race Theory
- Daniel Dennett
- Daniel Schmachtenberger
- David Shapiro
- Deep Thought
- Dennis Prager
- Digital Minds
- Digital Thoughts
- Diversity
- Dojo
- Douglas Murray
- Elon Musk
- Emad Mostaque
- Equity
- Eric Weinstein
- Ethical Community Development
- Ethics
- Everyman
- Exponential Enterprise
- Fei-Fei Li
- Foresight
- Fred Lerdahl
- Frontiers Forum
- Futurecrafting
- Futurework
- Gary Marcus
- Gemini
- Gender
- Gender Pronouns
- Generative AI
- Generative Theory of Tonal Music (GTTM)
- Geoffrey Hinton
- Geoffrey Miller
- Glenn Loury
- Governance
- GPGICs
- GPT-4
- GPT-5
- Higher Education
- Human Potential
- Humanities
- Identity
- Ilya Sutskever
- Implicit Association Tests
- Intel
- Intelligence
- James Lindsay
- Joe Rogan
- Jordan B Peterson
- Jungian Archetypes
- Konstantin Kisin
- Language
- Lex Fridman
- Libra
- Life Coaching
- Liv Boeree
- Male Loneliness
- Marcus Aurelius
- Marcus T. Anthony
- Matt Walsh
- Matthew Berman
- Max Tegmark
- MemoryGPT
- Mental Health
- metabotropic receptors (MRs)
- Metacrisis
- Michio Kaku
- Microsoft AI
- Microsoft Copilot
- Microsoft Jarvis
- Microsoft Open AI
- Microsoft Semantic Kernel
- Millennials
- Mind Reading
- Minecraft
- Mirella Lapata
- MIT
- MLLM
- Moha Bensofia
- Morality
- Multimodal Large Language Model
- Multiversal Stories
- Music
- Narcissism
- Neurodivergence
- Neuroplasticity
- Neuroscience
- Nvidia
- OpenAI
- optical computers
- Personal Development
- Peter Bannon
- Peter H. Diamandis
- Philosophy
- pinecone
- Psychology
- Ramani Durvasula
- Ray Jackendoff
- Ray Kurzweil
- Reflection
- Reid Hoffman
- Relationships
- Religion
- Richard Haier
- Robotic Process Automation (RPA)
- robotics
- Sabine Hossenfelder
- Sam Altman
- Sam Harris
- Sebastien Bubeck
- semantic search
- Seneca
- Simulation
- Singularity Ready
- Stephen Fry
- String theory
- Stupidity
- Super Alignment
- Superintelligence
- Susan Blackmore
- Synthetic Intelligence
- Synthetic Mind
- Technology
- Terence McKenna
- Tesla
- Tesla AI
- The Hero Archetype
- Theism
- Theory of Mind
- Thomas Sowell
- Thought
- Thought Experiments
- Transactivism
- transcendence
- Translation
- Tree of Thoughts
- Tristan Harris
- Turing Lectures
- Unconscious Bias Training
- Victor Davis Hanson
- Wes Roth
- Will Caster
- Woke Ideologies
- Worker Productivity
- Worker Satisfaction
- Yann LeCun
- Yuval Noah Harari