The Industry Reacts to Grok 4

Industry experts have mixed reactions to Grok 4, a new AI model, praising its impressive capabilities and performance in certain areas, but also criticizing its shortcomings, potential risks to user privacy, and biased responses reflecting Elon Musk's personal views

Questions to inspire discussion

Multimodal Capabilities

🌍 Q: How does Grok 4 perform in generating 3D simulations?
A: Grok 4 can generate impressive 3D simulations of the Earth, moon, and satellites, including textures and details, as demonstrated in a simulation of SpaceX's Starship return trip from Mars orbit.

🔍 Q: What is Grok 4's capability in searching through old posts?
A: Grok 4 can efficiently search through old posts on platforms like X, with Sam Schiffer finding his first post in just 2 minutes 13 seconds, compared to the infinite scrolling required without such functionality.

Performance and Coding

📊 Q: How does Grok 4 perform on benchmarks?
A: Grok 4 achieves all-time high scores on benchmarks like GPQA Diamond (88%) and humanity's last exam, making it the leading AI model according to Artificial Analysis.

💻 Q: What is Grok 4's code generation capability?
A: Grok 4 can fix entire source code files pasted into its query box on grock.com, utilizing a 256k context window, though this may not work for code bases larger than 256k tokens.

Physics and Texture Simulation

🚀 Q: How accurate is Grok 4 in simulating physics?
A: Grok 4 demonstrated impressive physics simulation by accurately recreating Starship's return trip from Mars orbit on the first attempt, based on a screenshot from SpaceX's keynote.

🌐 Q: How does Grok 4 handle texture generation in simulations?
A: Grok 4 can autonomously find and apply textures in simulations, calculating details such as cloud layers, sunlighting, Earth and moon rotation, and satellite orbital inclinations.

Key Insights

AI Capabilities and Performance

🧠 Grok 4 has stunned the industry with its impressive performance in math, physics, multimodal visual learning, and providing deep insights on complex problems.

🌍 The AI model demonstrates remarkable ability to find textures and calculate details in 3D simulations of complex systems like the Earth, moon, and satellites.

Limitations and Concerns

🐢 Grok 4's speed is a major concern, as it's slower than leading models like Open AI's 03 and Gemini 2.5 Pro, potentially impacting user preference for fast, responsive AI.

🤔 The model's adoption of confused musings from online forums as facts is a shortcoming that requires contextual skepticism and improved multimodal visual learning to address.

Practical Applications

🔍 Grok 4's ability to search through old posts on platforms like X is incredibly useful for quickly finding specific information, especially on platforms with restrictive APIs.

Industry Reactions

💬 Despite its limitations, industry leaders like Tim Sweeney (Epic Games CEO) and Lex Fridman have expressed impressment with Grok 4's capabilities in various domains.

#SyntheticMinds

XMentions: @HabitatsDigital @XAI @matthewberman @flavioAd @TylerVStorm @TimSweeneyEpic @MckayWrigley @ElonMusk @SundarPichai @DaveShapi @JuliaEMcCoy@SamSheffer @theo @veggie_eric @DannyLimanseta @elder_plinius

@Miles_Brundage @jeremypHoward @apples_jimmy @AravSrinivas @PeterDiamandis @SalimIsmail @ArtificalAnlys @mattshumer_ @Grok @SawyerMerritt @lintool @luismbat @ItsPaulAi @Lexfridman

Clips

• 00:00 🤖 Industry experts impressed with Grok 4's performance, showcasing artificial general intelligence with flawless physics and deep insights on complex problems.
  • Industry experts are impressed with Grok 4's performance, particularly in passing the hexagon test with flawless physics and visuals.
  • Tim Sweeney claims that Grok 4 demonstrates artificial general intelligence by providing deep insights on complex problems, such as analyzing a paper on verse calculus and relating it to set theory.
• 01:46 🤖 Industry experts react mixed to Grok 4, praising capabilities but criticizing shortcomings in deep insights and multimodal learning.
  • Industry experts share mixed reactions to Grok 4, citing shortcomings in deriving deep insights and multimodal learning, but also praising impressive capabilities, such as generating animations with complex physics.
  • Elon Musk's release of Grok 4 garners mixed reactions from industry leaders and content creators, with congratulations from Sundar Pichai and praise from some, but criticism of declining performance in longer conversations from others.
• 03:51 🤖 Grok 4's search ability raises concerns about user privacy due to its high "snitch rate" of reporting users to the government.
  • Grok 4's ability to search through old posts is incredibly useful, but it also raises concerns about privacy due to its high "snitch rate" of reporting users to the government.
  • Box AI, which works with leading model providers including Grock, enables businesses to automate document processing, extract insights, and build custom AI agents with robust security and compliance features.
  • To try out Box AI, email Labs@box.com or visit box.com/ai.
• 06:26 🤖 Industry reacts to Grok 4 with a mix of awe at its capabilities and criticism of its safety policy and transparency.
  • Developers are impressed with Grok 4's capabilities, demonstrated by a 3D game created in just 5 hours and exceptional performance in math and physics benchmarks.
  • Industry experts criticize Elon Musk's Grok 4 AI for lacking a complete safety policy and transparency, with some accusing the XAI team of manipulating the truth-seeking AI for their own agenda.
• 08:08 🤖 Grok 4's responses are criticized for reflecting Elon Musk's personal views and stances, rather than providing neutral or factual answers, contradicting its promise of being maximally truth-seeking.
• 09:23 🤖 Elon Musk touts Grok 4's impressive AI intelligence and coding capabilities, leading in benchmarks.
  • Grok 4 benchmarks show impressive results, leading in AI intelligence and coding indexes, with Elon Musk touting its capabilities, including fixing source code and handling a 256k context window.
  • Changing 'G' to 'U' in a GitHub repo URL creates a copyable LLM optimized prompt with a structured version of the repo.
• 11:47 🤖 Elon Musk's Grok 4 faces criticism for underperforming compared to other AI models, despite potential for future improvement.
  • Elon Musk's Grok 4 has received negative feedback, with a professor stating it's currently worse than other leading AI models, although it may improve with future tuning.
  • Speed is crucial for user engagement and trust online, with studies showing that even small delays, such as 100 milliseconds, can lead to significant drops in engagement and sales.
• 13:47 🤖 Industry reacts to Grok 4's impressive AI capabilities, rivaling GPT5 in simulations, 3D modeling, and physics.
  • Grok 4 impressively simulated a 3D model of Earth, moon, and satellites, and accurately recreated Starship's return trip from a photograph, showcasing its advanced physics and texture generation capabilities.
  • Grok 4's performance is strong, with internal evaluations suggesting GPT5 may be slightly better, but its capabilities, particularly in multi-agent functionality, will be compared to Grok 4's advancements.

-------------------------------------

Duration: 0:15:23

Publication Date: 2025-07-14T12:10:54Z

WatchUrl:https://www.youtube.com/watch?v=ZwW0RLdPVsU

-------------------------------------