To Interact With the Real World, AI Will Gain Physical Intelligence


Recent AI models are surprisingly humanlike in their ability to generate text, audio, and video when prompted. However, so far these algorithms have largely remained relegated to the digital world, rather than the physical, three-dimensional world we live in. In fact, whenever we attempt to apply these models to the real world even the most sophisticated struggle to perform adequately—just think, for instance, of how challenging it has been to develop safe and reliable self-driving cars. While artificially intelligent, not only do these models simply have no grasp of physics but they also often hallucinate, which leads them to make inexplicable mistakes.

This is the year, however, when AI will finally make the leap from the digital world to the real world we inhabit. Expanding AI beyond its digital boundary demands reworking how machines think, fusing the digital intelligence of AI with the mechanical prowess of robotics. This is what I call “physical intelligence”, a new form of intelligent machine that can understand dynamic environments, cope with unpredictability, and make decisions in real time. Unlike the models used by standard AI, physical intelligence is rooted in physics; in understanding the fundamental principles of the real world, such as cause-and-effect.

Such features allow physical intelligence models to interact and adapt to different environments. In my research group at MIT, we are developing models of physical intelligence which we call liquid networks. In one experiment, for instance, we trained two drones—one operated by a standard AI model and another by a liquid network—to locate objects in a forest during the summer, using data captured by human pilots. While both drones performed equally well when tasked to do exactly what they had been trained to do, when they were asked to locate objects in different circumstances—during the winter or in an urban setting—only the liquid network drone successfully completed its task. This experiment showed us that, unlike traditional AI systems that stop evolving after their initial training phase, liquid networks continue to learn and adapt from experience, just like humans do.

Physical intelligence is also able to interpret and physically execute complex commands derived from text or images, bridging the gap between digital instructions and real-world execution. For example, in my lab, we’ve developed a physically intelligent system that, in less than a minute, can iteratively design and then 3D-print small robots based on prompts like “robot that can walk forward” or “robot that can grip objects”.

Other labs are also making significant breakthroughs. For example, robotics startup Covariant, founded by UC-Berkeley researcher Pieter Abbeel, is developing chatbots—akin to ChatGTP—that can control robotic arms when prompted. They have already secured over $222 million to develop and deploy sorting robots in warehouses globally. A team at Carnegie Mellon University has also recently demonstrated that a robot with just one camera and imprecise actuation can perform dynamic and complex parkour movements—including jumping onto obstacles twice its height and across gaps twice its length—using a single neural network trained via reinforcement learning.

If 2023 was the year of text-to-image and 2024 was text-to-video, then 2025 will mark the era of physical intelligence, with a new generation of devices—not only robots, but also anything from power grids to smart homes—that can interpret what we’re telling them and execute tasks in the real world.



Source link

Share

Latest Updates

Frequently Asked Questions

Related Articles

Starship successfully completes 11th flight test

WASHINGTON — SpaceX successfully completed the final flight of version 2 of Starship...

Great Scott! Casio’s Back to the Future watch is here and it looks awesome

If you’ve ever dreamed of owning a piece of Back to the Future...

Self-improving language models are becoming reality with MIT's updated SEAL technique

Researchers at the Massachusetts Institute of Technology (MIT) are gaining renewed attention for...

Researchers find that retraining only small parts of AI models can cut costs and prevent forgetting

Enterprises often find that when they fine-tune models, one effective approach to making...
sabung ayam online sabung ayam online judi bola sabung ayam online judi bola Judi Bola Sabung Ayam Online Live Casino Online Sabung Ayam Online Sabung Ayam Online Sabung Ayam Online Sabung Ayam Online Sabung Ayam Online Sabung Ayam Online sabung ayam online judi bola mahjong ways sabung ayam online judi bola mahjong ways mahjong ways sabung ayam online sv388 Sv388 judi bola judi bola judi bola judi bola JUARA303 Mahjong ways Judi Bola Judi Bola Sabung Ayam Online Live casino mahjong ways 2 sabung ayam online sabung ayam online mahjong ways mahjong ways mahjong ways live casino online sabung ayam online judi bola SV388 SBOBET88 judi bola judi bola judi bola judi bola judi bola https://himakom.fisip.ulm.ac.id/ SABUNG AYAM ONLINE MIX PARLAY SLOT GACOR JUDI BOLA SV388 LIVE CASINO LIVE CASINO ONLINE Judi Bola Online SABUNG AYAM ONLINE JUDI BOLA ONLINE LIVE CASINO ONLINE JUDI BOLA ONLINE LIVE CASINO ONLINE LIVE CASINO ONLINE sabung ayam online Portal SV388 SBOBET88 SABUNG AYAM ONLINE JUDI BOLA ONLINE CASINO ONLINE MAHJONG WAYS 2 sabung ayam online judi bola SABUNG AYAM ONLINE JUDI BOLA ONLINE Sabung Ayam Online JUDI BOLA Sabung Ayam Online JUDI BOLA SV388, WS168 & GA28 SBOBET88 SV388, WS168 & GA28 SBOBET88 SBOBET88 CASINO ONLINE SLOT GACOR Sabung Ayam Online judi bola judi bola judi bola judi bola --indomax77 judi bola online --indomax77 mix parlay --indomax77 situs mix parlay --indomax77 situs parlay --indomax77 sbobet --indomax77 sbobet88 --indomax77 situs bola --indomax77 situs judi bola --indomax77 agen bola --indomax77 agen judi bola --indomax77 agen mix parlay --indomax77 agen parlay --indomax77