Synthetic Minds RSS

Microsoft's Kosmos-1 can take image and audio prompts, paving the way for the next stage beyond ChatGPT's text prompts Microsoft has unveiled Kosmos-1, which it describes as a multimodal large language model (MLLM) that can not only respond to language prompts but also visual cues, which can be used for an array of tasks, including image captioning, visual question answering, and more.  OpenAI's ChatGPT has helped popularize the concept of LLMs, such as the GPT (Generative Pre-trained Transformer) model, and the possibility of transforming a text prompt or input into an output.  While people are impressed by these chat capabilities,...

How Well Can DeepMind's AI Learn Physics? Our framework---which we term "Graph Network-based Simulators" (GNS)---represents the state of a physical system with particles, expressed as nodes in a graph, and computes dynamics via learned message-passing.     Learning to Simulate Complex Physics with Graph Networks Here we present a machine learning framework and model implementation that can learn to simulate a wide variety of challenging physical domains, involving fluids, rigid solids, and deformable materials interacting with one another. Our results show that our model can generalize from single-timestep predictions with thousands of particles during training, to different initial conditions, thousands...

Orbit, an interactive robot, helps teach children on the autism spectrum to develop social appropriateness and emotion via storytelling, physical interaction, and visual communication. The hand-sized robot smiles and encourages users to press a button on its back, reacting with a beaming smile if pressed gently, and with a sad face if the interaction is too hard. “Hey there. Allow me to introduce you to your new companion, Orbit, a robot you can play with and listen to. Not only can Orbit hear you, they can feel you too.” “Oh no, it looks like you pressed too hard, Orbit is...

Bias in AI systems is proving to be a major stumbling block in efforts to more broadly integrate the technology into our society. A new initiative that will reward researchers for finding any prejudices in AI systems could help solve the problem. The effort is modeled on the bug bounties that software companies pay to cybersecurity experts who alert them of any potential security flaws in their products. The idea isn’t a new one; “bias bounties” were first proposed by AI researcher and entrepreneur JB Rubinovitz back in 2018, and various organizations have already run such challenges. But the new effort seeks to create...

Fundamental problems elude many strains of deep learning, says LeCun, including the mystery of how to measure information.   "I think AI systems need to be able to reason," says Yann LeCun, Meta's chief AI scientist. Today's popular AI approaches such as Transformers, many of which build upon his own pioneering work in the field, will not be sufficient. "You have to take a step back and say, Okay, we built this ladder, but we want to go to the moon, and there's no way this ladder is going to get us there," says LeCun.   Yann LeCun, chief AI scientist of...