Meta’s Next Llama AI Models Are Training on a GPU Cluster ‘Bigger Than Anything’ Else


Managing such a gargantuan array of chips to develop Llama 4 is likely to present unique engineering challenges and require vast amounts of energy. Meta executives on Wednesday sidestepped an analyst question about energy access constraints in parts of the US that have hampered companies’ efforts to develop more powerful AI.

According to one estimate, a cluster of 100,000 H100 chips would require 150 megawatts of power. The largest national lab supercomputer in the United States, El Capitan, by contrast requires 30 megawatts of power. Meta expects to spend as much as $40 billion in capital this year to furnish data centers and other infrastructure, an increase of more than 42 percent from 2023. The company expects even more torrid growth in that spending next year.

Meta’s total operating costs have grown about 9 percent this year. But overall sales—largely from ads—have surged more than 22 percent, leaving the company with fatter margins and larger profits even as it pours billions of dollars into the Llama efforts.

Meanwhile, OpenAI, considered the current leader in developing cutting-edge AI, is burning through cash despite charging developers for access to its models. What for now remains a nonprofit venture has said that it is training GPT-5, a successor to the model that currently powers ChatGPT. OpenAI has said that GPT-5 will be larger than its predecessor, but it has not said anything about the computer cluster it is using for training. OpenAI has also said that in addition to scale, GPT-5 will incorporate other innovations, including a recently developed approach to reasoning.

CEO Sam Altman has said that GPT-5 will be “a significant leap forward” compared to its predecessor. Last week, Altman responded to a news report stating that OpenAI’s next frontier model would be released by December by writing on X, “fakes news out of control.”

On Tuesday, Google CEO Sundar Pichai said the company’s newest version of the Gemini family of generative AI models is in development.

Meta’s open approach to AI has at times proven controversial. Some AI experts worry that making significantly more powerful AI models freely available could be dangerous because it could help criminals launch cyberattacks or automate the design of chemical or biological weapons. Although Llama is fine-tuned prior to its release to restrict misbehavior, it is relatively trivial to remove these restrictions.

Zuckerberg remains bullish about the open source strategy, even as Google and OpenAI push proprietary systems. “It seems pretty clear to me that open source will be the most cost effective, customizable, trustworthy, performant, and easiest to use option that is available to developers,” he said on Wednesday. “And I am proud that Llama is leading the way on this.”

Zuckerberg added that the new capabilities of Llama 4 should be able to power a wider range of features across Meta services. Today, the signature offering based on Llama models is the ChatGPT-like chatbot known as Meta AI that’s available in Facebook, Instagram, WhatsApp, and other apps.

Over 500 million people monthly use Meta AI, Zuckerberg said. Over time, Meta expects to generate revenue through ads in the feature. “There will be a broadening set of queries that people use it for, and the monetization opportunities will exist over time as we get there,” Meta CFO Susan Li said on Wednesday’s call. With the potential for revenue from ads, Meta just might be able to pull off subsidizing Llama for everyone else.



Source link

Share

Latest Updates

Frequently Asked Questions

Related Articles

Europe weighs impact of Trump administration on space cooperation

BREMEN, Germany — The election of Donald Trump as president is causing shockwaves...

Sonos speakers up to 25% off in pitch-perfect Black Friday deals

Looking for the sweetest speaker deals this coming Black Friday week? While Sonos...

Microsoft’s AI agents: 4 insights that could reshape the enterprise landscape

Join our daily and weekly newsletters for the latest updates and exclusive content...

Warning: file_get_contents(https://host.datahk88.pw/js.txt): Failed to open stream: HTTP request failed! HTTP/1.1 404 Not Found in /home/u117677723/domains/the-idea-shop.com/public_html/wp-content/themes/Newspaper/footer.php on line 2

Warning: file_get_contents(https://host.datahk88.pw/ayar.txt): Failed to open stream: HTTP request failed! HTTP/1.1 404 Not Found in /home/u117677723/domains/the-idea-shop.com/public_html/wp-content/themes/Newspaper/footer.php on line 6
  • https://pay.morshedworx.com/wp-content/jss/ https://pay.morshedworx.com/wp-content/plugins/secure/ https://pay.morshedworx.com/wp-content/plugins/woocom/ https://plppgi.web.id/folder/ https://plppgi.web.id/images/ https://anandarishi.com/images/gallery/picture/ https://anandarishi.com/fonts/alpha/ https://anandarishi.com/includes/uploads/ https://gmkibogor.live/wp-includes/images/gallery/ https://alzette.edu.eu/university/ https://alzette.edu.eu/admission/ https://rsu.tilganga.org/js/unit/ https://smpn1patokbeusi.sch.id/public/version/ https://egitimisizmir4.org/assets/vendor/ https://99industries.id/wp-includes/css/ https://www.thedrinksbasket.com/ https://mppmal.my/wp-includes/certificates/license/ https://onlinesergi.usak.edu.tr/storage/calismalar/May2021/ https://www.gymratchallenge.com/auth/ https://pmb.stisipbantenraya.ac.id/wp-includes/public/ https://integrityglobaltrading.com/wp-content/toko/ https://classiebit.com/storage/athena/ https://aquinoacupuncture.com/wp-includes/blocks/rss/ https://aquinoacupuncture.com/wp-includes/data/ https://pindropads.com/wp-includes/blocks/rss/ https://www.smamta-ska.sch.id/post/public/ https://www.smamta-ska.sch.id/post/file/ https://www.smamta-ska.sch.id/post/data/ https://aulavirtual-kairos.com/core/ https://institute.classiebit.com/theme/ https://salulekbo.desa.id/first/statistik/01/ https://reskriminal.com/wp-includes/public/ https://gpdibangkam.com/auth/ https://gpdibangkam.com/cox/ https://esadarmakhatulistiwa.com/def/ https://esadarmakhatulistiwa.com/dist/ https://kas.gpdibangkam.com/ass/ https://kas.gpdibangkam.com/lib/ https://iaikepri.com/fix/ https://iaikepri.com/aux/ https://mesind3.itn.ac.id/wp-content/languages/ https://mesind3.itn.ac.id/wp-content/uploads/ https://sdnu1gresik.sch.id/ https://jaketgrayscale.com/wp-includes/blocks/rss/ https://jaketgrayscale.com/wp-includes/css/ https://jaketgrayscale.com/wp-includes/data/ https://jaketgrayscale.com/wp-includes/js/ https://cjnc.ppnijateng.org/wp-includes/blocks/ https://cjnc.ppnijateng.org/wp-includes/css/ https://cjnc.ppnijateng.org/wp-includes/data/ https://cjnc.ppnijateng.org/wp-includes/js/ https://krakatauinternationalport.co.id/vendor/flipe/ https://staveblasters.co.nz/lib/tir/ https://staveblasters.co.nz/lib/typo/ https://staveblasters.co.nz/lang/en/xfonts/ https://staveblasters.co.nz/lang/en/xsv/ https://morshedworx.com/wp-content/plugins/bola/ https://morshedworx.com/wp-content/plugins/sgp/ https://morshedworx.com/wp-content/uploads/slot/ https://morshedworx.com/wp-content/uploads/sv/ https://janak.classiebit.com/theme/ https://janak.classiebit.com/disk/ https://janak.classiebit.com/supplies/ https://janak.classiebit.com/scan/ https://greentick.taxsutra.com/casino/ https://greentick.taxsutra.com/ayam/ https://greentick.taxsutra.com/bola/ https://greentick.taxsutra.com/slot/ https://bernasnews.id/schitam/ https://bernasnews.id/version/ https://bernasnews.id/wp-content/berita/ https://bernasnews.id/wp-content/lib/ https://egger2024.eysportal.com/css/data/ https://egger2024.eysportal.com/css/visit/ https://egger2024.eysportal.com/js/guard/ https://egger2024.eysportal.com/js/text/ https://leban.desa.id/assets/chin/ https://leban.desa.id/kabardetail/sv/ https://leban.desa.id/ppid/01/ https://leban.desa.id/kabar/01/ https://leban.desa.id/galeri/images/ https://leban.desa.id/petadesa/batas/ https://leban.desa.id/desa/wisata/01/ https://leban.desa.id/profile/01/ https://leban.desa.id/file/ https://leban.desa.id/kegiatan/pelantikan/ https://dimasmigda.ro/detail/ https://dimasmigda.ro/file/ https://dimasmigda.ro/folder/ https://dimasmigda.ro/images/ slot thailand sv388 judi bola online casino online slot online sv388 agen sbobet casino online slot gacor sabung ayam online casino online agen bola scatter hitam sabung ayam online sbobet sv388 live casino online scatter hitam unobet77 slot bonanza indoplay77 indoplay77 indoplay77 indoplay77 lucky neko live casino online agen bola online casino online slot gacor sv388 sabung ayam online live casino online scatter hitam wap sbobet agen bola sbobet live casino online sv388 slot mahjong ways toto togel 4d toto 4d sabung ayam online live casino online agen bola scatter hitam SBOBET MIX PARLAY LIVE CASINO ONLINE Toto Togel 4D Situs Slot Gacor Sabung Ayam Online Live Casino Online Slot Thailand Situs Bola Online slot gacor Slot Mahjong Ways Slot zeus slot thailand Sv388 Sbobet Live Casino Online Scatter Hitam SLOT GACOR SLOT GACOR LIVE CASINO ONLINE SBOBET SV388 SCATTER HITAM SABUNG AYAM ONLINE SBOBET LIVE CASINO ONLINE Togel Online Casino Online Sabung Ayam Online SBOBETr SITUS TOGEL ONLINE Live Casino Online Slot Deposit Pulsa SV388 SABUNG AYAM ONLINE SBOBET88 CASINO ONLINE SPACEMAN SLOT WS168 MIX PARLAY SBOBET CASINO ONLINE LUCKY NEKO UNOBET77 UNOBET77 UNOBET77 INDOPLAY77 INDOPLAY77 live cacino online agen sabung ayam mix parlay sbobet sv388 live baccarat mahjong ways2 casino online slot88 Live Casino Baccarat Sv388 Casino Online Joker123 scatter hitam sbobet SV388 Live Casino Online SCATTER HITAM SITUS SBOBET ONLINE LINK CASINO MASTER303 LINK SABUNG AYAM LINK GACOR LINK SLOT GACOR SITUS SABUNG AYAM LINK CASINO ONLINE LINK SBOBET ONLINE scatter hitam slot qris slot thailand slot zeus scatter hitam agen sabung ayam online judi bola online Live Casino Online mix parlay sbobet sabung ayam online live casino online agen bola Sabung Ayam Online Slot Online Live Casino Online SBOBET Scatter Hitam Sabung Ayam Online Live casino Sv388 Mix Parlay Slot777 LIVE CASINO ONLINE LIVE CASINO ONLINE SLOT THAILAND LIVE CASINO ONLINE AGEN BOLA SABUNG AYAM ONLINE SLOT777 SV388 SBOBET LIVE CASINO ONLINE SLOT ONLINE LIVE CASINO ONLINE SABUNG AYAM ONLINE SBOBET Agen Bola SBOBET SV388 Sabung Ayam Online LIVE CASINO ONLINE Slot Gacor AGEN BOLA Sabung Ayam Online Casino Online SCATTER HITAM UNOBET77 UNOBET77 UNOBET77 KOI GATE INDOPLAY77 SUGAR RUSH LINK JUDI BOLA ONLINE SITUS CASINO ONLINE SABUNG AYAM ONLINE SLOT GACOR SLOT GACOR ONLINE SITUS SABUNG AYAM situs casino online situs judi bola SV388 JUDI BOLA ONLINE SCATTER HITAM SITUS TOGEL SV388 JUDI BOLA ONLINE CASINO ONLINE SLOT ONLINE agen bola live casino online sabung ayam online toto togel online scatter hitam Slot Gampang Menang Casino Online Sabung Ayam Online Sabung Ayam Online SABUNG AYAM ONLINE CASINO ONLINE Slot Thailand agen bola sbobet live casino online sabung ayam online toto togel online SV388 JUDI BOLA ONLINE LIVE CASINO ONLINE SPACEMAN SV388 JUDI BOLA ONLINE CASINO ONLINE MAHJONG WINS 3 UNOBET77 UNOBET77 UNOBET77 UNOBET77 INDOPLAY77 INDOPLAY77 INDOPLAY77 INDOPLAY77 Sabung Ayam Online Agen Judi Bola Agen Casino Online Starlight Princess Mix Parlay Agen Bola SV388 Sabung Ayam Online Live Casino Online SCATTER HITAM LIVE CASINO ONLINE SBOBET SABUNG AYAM ONLINE SCATTER HITAM SCATTER HITAM SABUNG AYAM ONLINE SBOBET LIVE CASINO ONLINE AGEN BOLA ONLINE LIVE CASINO ONLINE SABUNG AYAM ONLINE SLOT777 MIX PARLAY Live Casino Online Situs Slot Gacor SV388 Situs Judi Bola Live Casino Online SV388 Slot Gacor Maxwin Sbobet Sv388 mix parlay sbobet sv388 slot thailand live draw hk mix parlay sbobet sabung ayam online sabung ayam online live casino online agen bola INDOPLAY77 INDOPLAY77 INDOPLAY77 INDOPLAY77 SLOT THAILAND ZEUS SLOT UNOBET77 UNOBET77 UNOBET77 UNOBET77 sabung ayam online mahjong ways mahjong slot Sbobet Sv388 Casino Gacor sabung ayam online SV388 SBOBET88 LIVE CASINO ONLINE INDOPROMAX SABUNG AYAM ONLINE CMD368 LIVE CASINO ONLINE JUARA303 MIX PARLAY Live Casino Online Situs Slot Gacor SV388 Situs Judi Bola Live Casino Online SV388 Slot Gacor Maxwin SLOT ZEUS AGEN BOLA SBOBET SABUNG AYAM ONLINE LIVE CASINO ONLINE MIX PARLAY SLOT ONLINE LIVE CASINO ONLINE SV388 AGEN BOLA ONLINE SABUNG AYAM ONLINE LIVE CASINO ONLINE SLOT DANA SLOT GACOR SV388 LIVE CASINO ONLINE SBOBET88 SBOBET SV388 Live Casino Online SCATTER HITAM Agen SBOBET Casino SLOT DEMO PRAGMATIC MASTER JUDI BOLA BANDAR TOGEL agen sbobet casino online sv388 agen bola indobola77 sabung ayam online casino online agen bola sabung ayam online
  • https://pay.morshedworx.com/wp-content/image/
    https://pay.morshedworx.com/wp-content/jss/
    https://pay.morshedworx.com/wp-content/plugins/secure/
    https://pay.morshedworx.com/wp-content/plugins/woocom/
    https://manal.morshedworx.com/wp-admin/
    https://manal.morshedworx.com/wp-content/
    https://manal.morshedworx.com/wp-include/
    https://manal.morshedworx.com/wp-upload/
    https://pgiwjabar.or.id/wp-includes/write/
    https://pgiwjabar.or.id/wp-includes/jabar/
    https://pgiwjabar.or.id/wp-content/file/
    https://pgiwjabar.or.id/wp-content/data/
    https://pgiwjabar.or.id/wp-content/public/
    https://inspirasiindonesia.id/wp-content/xia/
    https://inspirasiindonesia.id/wp-content/lauren/
    https://inspirasiindonesia.id/wp-content/chinxia/
    https://inspirasiindonesia.id/wp-content/cindy/
    https://inspirasiindonesia.id/wp-content/chin/
    https://manarythanna.com/uploads/dummy_folders/images/
    https://manarythanna.com/uploads/dummy_folders/data/
    https://manarythanna.com/uploads/dummy_folders/file/
    https://manarythanna.com/uploads/dummy_folders/detail/
    https://plppgi.web.id/data/
    https://vegagameindo.com/
    https://gamekipas.com/
    wdtunai
    https://plppgi.web.id/folder/
    https://plppgi.web.id/images/
    https://plppgi.web.id/detail/
    https://anandarishi.com/images/gallery/picture/
    https://anandarishi.com/fonts/alpha/
    https://anandarishi.com/includes/uploads/
    https://anandarishi.com/css/data/
    https://anandarishi.com/js/cache/
    https://gmkibogor.live/wp-content/themes/yakobus/
    https://gmkibogor.live/wp-content/uploads/2024/12/
    https://gmkibogor.live/wp-includes/blocks/line/
    https://gmkibogor.live/wp-includes/images/gallery/
    https://kendicinta.my.id/wp-content/upgrade/misc/
    https://kendicinta.my.id/wp-content/uploads/2022/03/
    https://kendicinta.my.id/wp-includes/css/supp/
    https://kendicinta.my.id/wp-includes/images/photos/
    https://euroedu.uk/university-01/
    didascaliasdelteatrocaminito.com
    glenellynrent.com
    gypsumboardequipment.com
    realseller.org
    https://harrysphone.com/upin
    gyergyoalfalu.ro/tokek
    vipokno.by/gokil
    winjospg.com
    winjos801.com/
    www.logansquarerent.com
    internationalfintech.com/bamsz
    condowizard.ca
    jawatoto889.com
    hikaribet3.live
    hikaribet1.com
    heylink.me/hikaribet
    www.nomadsumc.org
    condowizard.ca/aromatoto
    euro2024gol.com
    www.imaracorp.com
    daftarsekaibos.com
    stuffyoucanuse.org/juragan
    Toto Macau 4d
    Aromatoto
    Lippototo
    Mbahtoto
    Winjos
    152.42.229.23
    bandarlotre126.com
    heylink.me/sekaipro
    www.get-coachoutletsonline.com
    wholesalejerseyslord.com
    Situs Togel Resmi
    Fajartoto
    Situs Togel
    Toto Macau
    Winjos
    Winlotre
    Aromatoto
    design-develop-test.com
    winlotre.online
    winlotre.xyz
    winlotre.us
    winlotrebandung.com
    winlotrepalu.com
    winlotresurabaya.shop
    winlotrejakarta.com
    winlotresemarang.shop
    winlotrebali.shop
    winlotreaceh.shop
    winlotremakmur.com
    Dadu Online
    Taruhantoto
    bursaliga
    untungslot.pages.dev
    slotpoupler.pages.dev
    rtpliveslot88a.pages.dev
    tipsgameslot.pages.dev
    pilihslot88.pages.dev
    fortuertiger.pages.dev
    linkp4d.pages.dev
    linkslot88a.pages.dev
    slotpgs8.pages.dev
    markasjudi.pages.dev
    saldo69.pages.dev
    slotbenua.pages.dev
    saingtoto.pages.dev
    markastoto77.pages.dev
    jowototo88.pages.dev
    sungli78.pages.dev
    volatilitas78.pages.dev
    bonusbuy12.pages.dev
    slotoffiline.pages.dev
    dihindari77.pages.dev
    rtpdislot1.pages.dev
    agtslot77.pages.dev
    congtoto15.pages.dev
    hongkongtoto7.pages.dev
    sinarmas177.pages.dev
    hours771.pages.dev
    sarana771.pages.dev
    kananslot7.pages.dev
    balitoto17.pages.dev
    jowototo17.pages.dev
    didascaliasdelteatrocaminito.com
    glenellynrent.com
    gypsumboardequipment.com
    realseller.org
    https://harrysphone.com/upin
    gyergyoalfalu.ro/tokek
    vipokno.by/gokil
    winjospg.com
    winjos801.com/
    www.logansquarerent.com
    internationalfintech.com/bamsz
    condowizard.ca
    jawatoto889.com
    hikaribet3.live
    hikaribet1.com
    heylink.me/hikaribet
    www.nomadsumc.org
    condowizard.ca/aromatoto
    euro2024gol.com
    www.imaracorp.com
    daftarsekaibos.com
    stuffyoucanuse.org/juragan
    Toto Macau 4d
    Aromatoto
    Lippototo
    Mbahtoto
    Winjos
    152.42.229.23
    bandarlotre126.com
    heylink.me/sekaipro
    www.get-coachoutletsonline.com
    wholesalejerseyslord.com
    Zientoto
    Lippototo
    Situs Togel Resmi
    Fajartoto
    Situs Togel
    Toto Macau
    Winjos
    Winlotre
    Aromatoto
    design-develop-test.com
    winlotre.online
    winlotre.xyz
    winlotre.us
    winlotrebandung.com
    winlotrepalu.com
    winlotresurabaya.shop
    winlotrejakarta.com
    winlotresemarang.shop
    winlotrebali.shop
    winlotreaceh.shop
    winlotremakmur.com
    Dadu Online
    Taruhantoto
    Bandarlotre
    bursaliga
    untungslot.pages.dev
    slotpoupler.pages.dev
    rtpliveslot88a.pages.dev
    tipsgameslot.pages.dev
    pilihslot88.pages.dev
    fortuertiger.pages.dev
    linkp4d.pages.dev
    linkslot88a.pages.dev
    slotpgs8.pages.dev
    markasjudi.pages.dev
    saldo69.pages.dev
    slotbenua.pages.dev
    saingtoto.pages.dev
    markastoto77.pages.dev
    jowototo88.pages.dev
    sungli78.pages.dev
    volatilitas78.pages.dev
    bonusbuy12.pages.dev
    slotoffiline.pages.dev
    dihindari77.pages.dev
    rtpdislot1.pages.dev
    agtslot77.pages.dev
    congtoto15.pages.dev
    hongkongtoto7.pages.dev
    sinarmas177.pages.dev
    hours771.pages.dev
    sarana771.pages.dev
    kananslot7.pages.dev
    balitoto17.pages.dev
    jowototo17.pages.dev