The breakthrough AI needs | Mint


Large language models have a keen appetite for electricity. The energy used to train OpenAI’s GPT-4 model could have powered 50 American homes for a century. And as models get bigger, costs rise rapidly. By one estimate, today’s biggest models cost $100m to train; the next generation could cost $1bn, and the following one $10bn. On top of this, asking a model to answer a query comes at a computational cost—anything from $2,400 to $223,000 to summarise the financial reports of the world’s 58,000 public companies. In time such “inference” costs, when added up, can exceed the cost of training. If so, it is hard to see how generative AI could ever become economically viable.

This is frightening for investors, many of whom have bet big on AI. They have flocked to Nvidia, which designs the chips most commonly used for ai models. Its market capitalisation has risen by $2.5trn over the past two years. Venture capitalists and others have ploughed nearly $95bn into ai startups since the start of 2023. Openai, the maker of ChatGPT, is reportedly seeking a valuation of $150bn, which would make it one of the biggest private tech firms in the world.

There is no need to panic. Plenty of other technologies have faced limits and gone on to prosper thanks to human ingenuity. The difficulty of getting people into space led to innovations that are now used on Earth, too. The oil-price shock in the 1970s encouraged energy efficiency and, in some countries, alternative means of generation, including nuclear. Three decades later, fracking made it possible to reach oil and gas reserves that had previously been uneconomical to extract. As a consequence, America now produces more oil than any other country.

Already, developments in AI are showing how constraints can stimulate creativity. As our Technology Quarterly this week sets out, companies are developing chips especially for the operations needed to run large language models. This specialisation means that they can run more efficiently than more general-purpose processors, such as Nvidia’s. Alphabet, Amazon, Apple, Meta and Microsoft are all designing their own AI chips. More money has flowed into funding AI-chip startups in the first half of this year than in the past three combined.

Developers are also making changes to AI software. Bigger models that rely on the brute force of computational power are giving way to smaller and more specialised systems. OpenAI’s newest model, o1, is designed to be better at reasoning, but not generating text. Other makers are employing less onerous calculations, so as to make more efficient use of chips. Through clever approaches, such as using a mixture of models, each suited to a different type of problem, researchers have drastically cut down on processing time. All this will change how the industry operates.

Investors and governments have become used to the idea that, among tech companies, the incumbent has a natural advantage. For AI, that assumption can no longer be taken for granted. Today Nvidia sells four-fifths of the world’s ai chips. But other more specialised rivals could well eat into its share. Already Google’s ai processors are the third-most-used in data centres around the world.

Openai may have launched the pioneering large language model. But as resource constraints have struck, other big modelmakers such as Anthropic, Google and Meta are catching up. Although a gap between them and the second-tier models, such as France’s Mistral, still exists, it may close. If the trend towards smaller and more specialised models continues, then the ai universe could contain a constellation of models, instead of just a few superstars.

This means that investors are in for a rocky ride. Their bets on today’s leaders look less certain. Nvidia could lose ground to other chipmakers; OpenAI could be supplanted. The big tech firms are hoovering up talent, and many of them make the devices through which, they hope, consumers will reach their ai assistants. But competition among them is fierce. Few firms yet have a strategy for turning a profit from generative ai. Even if the industry does end up belonging to one winner, it is not clear who that will be.

Governments, too, will need to change their thinking. Their fondness for industrial policy focuses on handouts. But progress in ai is as much about having the right talent and a flourishing ecosystem as it is about amassing capital and computing power. Countries in Europe and the Middle East may find that the hard graft of cultivating ingenuity matters as much as buying in computer chips. America, by contrast, is blessed with chips, talent and enterprise. It has many of the world’s best universities and, in San Francisco and Silicon Valley, an enviable and long-established cluster of talent.

Chipped away

Yet America’s attempt to restrain China is backfiring. Hoping to prevent a strategic rival from gaining the lead in a crucial technology, it has sought to restrict China’s access to cutting-edge chips. By doing so it has unintentionally stimulated the growth of a research system in China that excels at working round constraints.

When ingenuity counts for more than brute force, a better way to ensure America’s lead would be to attract and keep top researchers from elsewhere, for example through easier visa rules. The ai era is still in its infancy, and much remains uncertain. But the breakthroughs ai needs will come from giving ideas and talent the space to flourish at home, not trying to shut down rivals abroad.

© 2024, The Economist Newspaper Limited. All rights reserved. From The Economist, published under licence. The original content can be found on www.economist.com



Source link

Share

Latest Updates

Frequently Asked Questions

Related Articles

IndiaAI Mission: India’s AI race heats up as entrepreneurs, researchers, and startups vie for IndiaAI Mission funding

Stanford graduate Ayush Gupta who quit his job at Apple to start his...

Jeep Drivers Bombarded With Ads for Extended Warranty on Their Center Console Displays

The smartphone-ification of cars continues to unleash new horrors of tech-inflected capitalism.Just ask...

For Trump and Fox News, New Policies Are Simply ‘Common Sense’

President Trump’s rapid-fire policy actions are reshaping the federal government, and to Fox...

Best Marvel Movies: all the MCU films ranked

Watching the entire run of 35 Marvel Cinematic Universe movies, from Iron Man...
SULTAN88
SULTANSLOT
RAJA328
JOIN88
GFC88
HOKIBET
RUSIASLOT88
TAHU69
BONANZA99
PRAGMABET
MEGA55
LUXURY777
LUXURY333
BORJU89
QQGAMING
KEDAI168
MEGA777
NAGASLOT777
TAKSU787
KKSLOT777
MAS77TOTO
bandar55
BOS303
HOKI99
NUSA365
YUHUSLOT
KTP168
GALAXY138
NEXIA138
PETIR33
BOOM138
MEGA888
CABE888
FOSIL777
turbospin138
KAPAKBET
SUPERJP
sultankoin99
dragon88
raffi888
kenzobet
aladin666
rgo365
ubm4d
GERCEP88
VIVA99
CR777
VOXY88
delman567
intan69
CABE888
RNR303
LOGO303
PEMBURUGACOR
mpo383
cermin4d
bm88
ANGKA79
WOWHOKI
ROKET303
MPOXL
GURITA168
SUPRASLOT
SGCWIN
DESA88
ARWANA388
DAUNEMAS
ALADDIN666
BIOWIN69
SKY77
DOTA88
NAGA138
API5000
y200m
PLAYBOOK88
LUXURY12
A200M
MPO700
KENANGAN4D
cakrabola
PANDAGENDUT
MARVEL77
UG300
HOKI178
MONTE77
JASABOLA
UNTAR4D
LIDO88
MAFIABOLA77
GASPOL189
mpo999
untung138
TW88
JAGUAR33
MPOBOS
SHIO88
VIVO4D
MPOXL
JARISAKTI
BBO303
AONCASH
ANGKER4D
LEVIS4D
JAGO88
REPUBLIK365
BOSDEAL88
BOLA168
akunjp
WARTEGBET
EZEBET
88PULSA
KITAB4D
BOSDEAL88
STUDIOBET
MESINKOIN
BIMA88
PPNUSA
ABGBET88
TOP77
BAYAR77
YES77
BBTN4D
BBCA4D
VSLOTS88
MPO800
PAHALA4D
KPI4D
JURAGAN77
QQ188
BOLAPELANGI
C200M
QQ998
GWKTOGEL
MEGABANDAR
COLOWIN
VIP579
SEVEN4D
MPO188
DEWATA88
SURAT4D
SINAR123
LAMBO77
GUDANG4D
AWAN4D
PLANETLIGA
GT88
ROYALSPIN88
MAMAJITU
MITO99
PEDIA4D
WIBU69JP
333HOKI
SIDARMA88
NAGAEMAS99
HOLA88
CAKAR76
KINGTOTO
RATUGAMING
SSI168
PILAR168
ACTOTO
EYANGTOGEL
KAISAR328
SLOT628
KAISAR88
DOTA88
MAXWIN369
ALIBABA99
MM168
SQUAD777
NAGABET88
JAYABOLA
SEMPATIGAME
PANDAJAGO
PIKAT4D
SINGA77
YUYU33
MASTERPLAY99
VICTORY39
NASA4D
PERMATA55
SAKAUSLOT
CK303
MPOTOWER
CIPUTRABET
WINJUDI
DEWI5000
IYA777
MAHIRTOTO
GOSLOT88
TIPTOP4D
RAJA787
JBO680
JOKER188
EPICPLAY88
TRIVABET
KAISAR189
JOKER81
JPSPIN88
MAYORA4D
DJARUMPLAY
OVO88
BAKTI78
WINGSLOT77
ICAFE4D
PDTOTO
JETPLAY88
PORN VIDEO
https://link.space/@Hikaribet
https://bio.site/Hikaribet
https://heylink.me/Hikaribet39
CMBET88
CMBET88
didascaliasdelteatrocaminito.com
glenellynrent.com
gypsumboardequipment.com
realseller.org
https://harrysphone.com/upin
gyergyoalfalu.ro/tokek
vipokno.by/gokil
winjospg.com
winjos801.com/
www.logansquarerent.com
internationalfintech.com/bamsz
condowizard.ca
jawatoto889.com
hikaribet3.live
hikaribet1.com
heylink.me/hikaribet
www.nomadsumc.org
condowizard.ca/aromatoto
euro2024gol.com
www.imaracorp.com
daftarsekaibos.com
stuffyoucanuse.org/juragan
Toto Macau 4d
Aromatoto
Lippototo
Mbahtoto
Winjos
152.42.229.23
bandarlotre126.com
heylink.me/sekaipro
www.get-coachoutletsonline.com
wholesalejerseyslord.com
Lippototo
Zientoto
Lippototo
Situs Togel Resmi
Fajartoto
Situs Togel
Toto Macau
Winjos
Winlotre
Aromatoto
design-develop-test.com
winlotre.online
winlotre.xyz
winlotre.us
winlotrebandung.com
winlotrepalu.com
winlotresurabaya.shop
winlotrejakarta.com
winlotresemarang.shop
winlotrebali.shop
winlotreaceh.shop
winlotremakmur.com
Dadu Online
Taruhantoto
a Bandarlotre
bursaliga
lakitoto
aromatoto
Rebahin
untungslot.pages.dev
slotpoupler.pages.dev
rtpliveslot88a.pages.dev
tipsgameslot.pages.dev
pilihslot88.pages.dev
fortuertiger.pages.dev
linkp4d.pages.dev
linkslot88a.pages.dev
slotpgs8.pages.dev
markasjudi.pages.dev
saldo69.pages.dev
slotbenua.pages.dev
saingtoto.pages.dev
markastoto77.pages.dev
jowototo88.pages.dev
sungli78.pages.dev
volatilitas78.pages.dev
bonusbuy12.pages.dev
slotoffiline.pages.dev
dihindari77.pages.dev
rtpdislot1.pages.dev
agtslot77.pages.dev
congtoto15.pages.dev
hongkongtoto7.pages.dev
sinarmas177.pages.dev
hours771.pages.dev
sarana771.pages.dev
kananslot7.pages.dev
balitoto17.pages.dev
jowototo17.pages.dev
aromatotoding.com
unyagh.org
fairparkcounseling.com/gap/
impress-newtex.com/ajax/
SULTAN88
SULTANSLOT
RAJA328
JOIN88+
HOKIBET
GFC88
RusiaSlot88
Tahu69
BONANZA99
Pragmabet
mega55
luxury777
luxury333
borju89
qqgaming
KEDAI168
mega777
nagaslot777
TAKSU787
kkslot777
MAS77TOTO
BANDAR55+
BOS303
Login-HOKI99/
NUSA365
YUHUSLOT
ktp168
GALAXY138