Meta launches Llama 3.3, shrinking powerful 405B open model


Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More


Meta’s VP of generative AI, Ahmad Al-Dahle took to rival social network X today to announce the release of Llama 3.3, the latest open-source multilingual large language model (LLM) from the parent company of Facebook, Instagram, WhatsApp and Quest VR.

As he wrote: “Llama 3.3 improves core performance at a significantly lower cost, making it even more accessible to the entire open-source community.”

With 70 billion parameters — or settings governing the model’s behavior — Llama 3.3 delivers results on par with Meta’s 405B parameter model from the Llama 3.1 from the summer, but at a fraction of the cost and computational overhead — e.g., the GPU capacity needed to run the model in an inference.

It’s designed to offer top-tier performance and accessibility yet in a smaller package than prior foundation models.

Meta’s Llama 3.3 is offered under the Llama 3.3 Community License Agreement, which grants a non-exclusive, royalty-free license for use, reproduction, distribution, and modification of the model and its outputs. Developers integrating Llama 3.3 into products or services must include appropriate attribution, such as “Built with Llama,” and adhere to an Acceptable Use Policy that prohibits activities like generating harmful content, violating laws, or enabling cyberattacks. While the license is generally free, organizations with over 700 million monthly active users must obtain a commercial license directly from Meta.

A statement from the AI at Meta team underscores this vision: “Llama 3.3 delivers leading performance and quality across text-based use cases at a fraction of the inference cost.”

How much savings are we talkin’ about, really? Some back-of-the-envelope math:

Llama 3.1-405B requires between 243 GB and 1944 GB of GPU memory, according to the Substratus blog (for the open source cross cloud substrate). Meanwhile, the older Llama 2-70B requires between 42-168 GB of GPU memory, according to the same blog, though same have claimed as low as 4 GB, or as Exo Labs has shown, a few Mac computers with M4 chips and no discrete GPUs.

Therefore, if the GPU savings for lower-parameter models holds up in this case, those looking to deploy Meta’s most powerful open source Llama models can expect to save up to nearly 1940 GB worth of GPU memory, or potentially, 24 times reduced GPU load for a standard 80 GB Nvidia H100 GPU.

At an estimated $25,000 per H100 GPU, that’s up to $600,000 in up-front GPU cost savings, potentially — not to mention the continuous power costs.

A highly performant model in a small form factor

According to Meta AI on X, the Llama 3.3 model handedly outperforms the identically sized Llama 3.1-70B as well as Amazon’s new Nova Pro model in several benchmarks such as multilingual dialogue, reasoning, and other advanced natural language processing (NLP) tasks (Nova outperforms it in HumanEval coding tasks).

Llama 3.3 has been pretrained on 15 trillion tokens from “publicly available” data and fine-tuned on over 25 million synthetically generated examples, according to the information Meta provided in the “model card” posted on its website.

Leveraging 39.3 million GPU hours on H100-80GB hardware, the model’s development underscores Meta’s commitment to energy efficiency and sustainability.

Llama 3.3 leads in multilingual reasoning tasks with a 91.1% accuracy rate on MGSM, demonstrating its effectiveness in supporting languages such as German, French, Italian, Hindi, Portuguese, Spanish, and Thai, in addition to English.

Cost-effective and environmentally conscious

Llama 3.3 is specifically optimized for cost-effective inference, with token generation costs as low as $0.01 per million tokens.

This makes the model highly competitive against industry counterparts like GPT-4 and Claude 3.5, with greater affordability for developers seeking to deploy sophisticated AI solutions.

Meta has also emphasized the environmental responsibility of this release. Despite its intensive training process, the company leveraged renewable energy to offset greenhouse gas emissions, resulting in net-zero emissions for the training phase. Location-based emissions totaled 11,390 tons of CO2-equivalent, but Meta’s renewable energy initiatives ensured sustainability.

Advanced features and deployment options

The model introduces several enhancements, including a longer context window of 128k tokens (comparable to GPT-4o, about 400 pages of book text), making it suitable for long-form content generation and other advanced use cases.

Its architecture incorporates Grouped Query Attention (GQA), improving scalability and performance during inference.

Designed to align with user preferences for safety and helpfulness, Llama 3.3 uses reinforcement learning with human feedback (RLHF) and supervised fine-tuning (SFT). This alignment ensures robust refusals to inappropriate prompts and an assistant-like behavior optimized for real-world applications.

Llama 3.3 is already available for download through Meta, Hugging Face, GitHub, and other platforms, with integration options for researchers and developers. Meta is also offering resources like Llama Guard 3 and Prompt Guard to help users deploy the model safely and responsibly.



Source link

Share

Latest Updates

Frequently Asked Questions

Related Articles

Large language overkill: How SLMs can beat their bigger, resource-intensive cousins

Join our daily and weekly newsletters for the latest updates and exclusive content...

everything we’re excited to play in 2025

The last twelve months have been packed with massive titles to compete for...

Astronomers Were Watching a Black Hole When It Suddenly Exploded With Gamma Rays

Woah.Blast RadiusIn 2018, astronomers took the first-ever picture of a black hole, a...

Warning: file_get_contents(https://host.datahk88.pw/js.txt): Failed to open stream: HTTP request failed! HTTP/1.1 404 Not Found in /home/u117677723/domains/the-idea-shop.com/public_html/wp-content/themes/Newspaper/footer.php on line 2

Warning: file_get_contents(https://host.datahk88.pw/ayar.txt): Failed to open stream: HTTP request failed! HTTP/1.1 404 Not Found in /home/u117677723/domains/the-idea-shop.com/public_html/wp-content/themes/Newspaper/footer.php on line 6
  • slot gacor 777 Mix Parlay SITUS SABUNG AYAM ONLINE AGEN BOLA LIVE CASINO SLOT GACOR GAMPANG MENANG BANDAR JUDI BASKET AGEN SABUNG AYAM ONLINE CASINO ONLINE SLOT DEPOSIT QRIS 5000 AGEN SABUNG AYAM ONLINE AGEN BOLA ONLINE MEGA ROULETTE CASINO SLOT RESMI TERPERCAYA https://baumarkt-fasselt.de/news/jackpot-lucky-piggy-indoagen188.html https://baumarkt-fasselt.de/news/main-mahjong-ways-di-indoagen188-siap-siap-jadi-sultan.html https://baumarkt-fasselt.de/news/rahasia-terbaru-jam-gachor-main-di-mahjong-ways2.html https://baumarkt-fasselt.de/news/update-pg-soft-gacor-hari-ini.html https://doruktip.com/vendor/psr/test/ https://perpus.donisamultimandiri.com/data/ https://perpus.donisamultimandiri.com/vendor/ https://simbakda.sulselprov.go.id/assets/img/ https://simbakda.sulselprov.go.id/assets/data/ https://simbakda.sulselprov.go.id/public/file/ https://simbakda.sulselprov.go.id/public/images/ https://simbakda.sulselprov.go.id/data/keluaran/ https://simakda.sanggau.go.id/simakda_skpd_sanggau/blog/ https://simakda.sanggau.go.id/simakda_skpd_sanggau/info/sv/ https://simakda.sanggau.go.id/simakda_skpd_sanggau/public/new/ https://simakda.sanggau.go.id/simakda_skpd_sanggau/image/up/ https://simakda.sanggau.go.id/simakda_skpd_sanggau/assets/data/ SITUS CASINO ONLINE SV388 SITUS JUDI BOLA Scatter Hitam Pola Starlight Princess terbaru Trik jitu Gates of Olympus Cara main Mahjong Ways 2 Pola baru Sweet Bonanza Pola trending Starlight Princess slot mahjong ways live casino online zeus slot gacor live casino online slot online slot online slot online slot online slot online slot online slot online slot online slot online slot online slot online slot online slot online memiliki tabungan puluhan juta modal 50k pengguna ewallet qris aplikasi mendapatkan uang sampingan peringatan pola rtp ala warkop hasil menggiurkan rumus memaksimalkan pecahan simbol game gatot kaca Teknik bermain game sweet bonanza pola jackpot paus algoritma memancing scatter hitam mahjong menang game slot mahjong ways hingga jackpot paus pelajaan berharga maxwin mesin slot ghacor gatot kaca dijuluki raja slot mahjong pakai pola efektif resep richard lee panen x500 gates of olympus obat manis sweet bonanza trik wd badai phk solusi mahjong wins daftar demo slot mahjong ways jackpot epic pola jitu scatter mahjong melody sharon trik rtp gates of olympus bocoran perkalian gede gates of olympus beruntun rahasia free spins perkalian maksimal shifu gachor pola mahjong wins 3 surabaya tips maksimalkan olympus1000 menang bermain 15 tips menang mahjong wins 3 shifu gachor live casino online live casino online kakek zeus slot thailand live casino online live casino online scatter hitam kakek petir https://poltekkpsidoarjo.ac.id/assets/data/ https://poltekkpsidoarjo.ac.id/assets/file/ https://poltekkpsidoarjo.ac.id/assets/folder/ https://poltekkpsidoarjo.ac.id/assets/img/ https://poltekkpsidoarjo.ac.id/assets/public/ https://www.unpi-cianjur.ac.id/assets/-/bola/ https://www.unpi-cianjur.ac.id/assets/-/caso/ https://www.unpi-cianjur.ac.id/assets/-/aduan/ https://www.unpi-cianjur.ac.id/site/pmb/update/ https://www.unpi-cianjur.ac.id/plugins/slot88/ https://siakad.unpi-cianjur.ac.id/site/upgrade/css/ https://siakad.unpi-cianjur.ac.id/dana/ https://siakad.unpi-cianjur.ac.id/assets/ https://siakad.unpi-cianjur.ac.id/assets/slider/tgl/ SV388 mix parlay sbobet casino online slot online gacor sabung ayam online sbobet88 casino online scatter hitam SABUNG AYAM ONLINE AGEN BOLA ONLINE BACCARAT ONLINE LIVE CASINO SITUS SLOT ONLINE SABUNG AYAM ONLINE AGEN BOLA LIVE CASINO ONLINE SCATTER HITAM SLOT ONLINE GACOR LIVE CASINO ONLINE AGEN BOLA ONLINE SABUNG AYAM ONLINE SLOT GACOR HARI INI LIVE CASINO ONLINE MIX PARLAY SABUNG AYAM ONLINE joker123 joker123 joker123 joker123 joker123 joker123 joker123 joker123 Slot88 Slot Online Slot Gacor Zeus x1000 Scatter Hitam Mahjong Ways Slot Thailand Terpercaya casino online sabung ayam online sabung ayam online casino online scatter hitam slot Thailand Link Slot Thailand LIVE DRAW HK agen sabung ayam agen sabung ayam Agen Judi Bola live casino online sabung ayam online bola tangkas live casino online sabung ayam online agen bola sbobet AGEN BOLA LIVE CASINO ONLINE WCF888 SABUNG AYAM SLOT RESMI MAXWIN SCATTER HITAM SABUNG AYAM ONLINE WCF888 LIVE CASINO ONLINE AGEN BOLA ONLINE slot gacor scatter hitam slot terpercaya thailand togel online togel online slot thailand scatter hitam slot gacor SBOBET MIX PARLAY LIVE CASINO ONLINE WCF888 SABUNG AYAM ONLINE SLOT777 SABUNG AYAM ONLINE LIVE CASINO ONLINE WAP SBOBET SLOT GACOR DANA AGEN BOLA ONLINE LIVE CASINO ONLINE SABUNG AYAM ONLINE SCATTER HITAM scatter hitam situs live baccarat slot thailand sv388 slot QRIS slot online resmi Slot Demo slot dana slot thailand Slot Mahjong Ways slot QRIS slot online resmi Slot Demo slot dana slot thailand Scatter hitam sabung ayam online agen judi bola sbobet Live Casino Sabung Ayam Online Roulette Mega Wheels Sv388 live casino online togel online Live Casino Online Slot Thailand Sv388 Live Casino Online Slot777 WS168 Situs Judi Baccarat Scatter Hitam Sv388 Agen Judi Bola sv388 Live Casino Online Togel Online AGEN BOLA LIVE CASINO ONLINE SV388 SABUNG AYAM ONLINE SCATTER HITAM agen bola sbobet sv388 sabung ayam online Live Baccarat Terpercaya Slot88 Sabung Ayam Bali Judi Roulette Online Bandar Slot Bonanza Sabung Ayam Online Live Casino Resmi Agen Sabung Ayam Judi Slot Online sv388 sbobet88 casino online sv388 mix parlay sbobet casino online scatter hitam sabung ayam online Agen Judi Bola casino online sabung ayam online casino online https://p2tsp.apsidoarjo.ac.id/ https://poltek.apsidoarjo.ac.id/ https://poltekkpsidoarjo.apsidoarjo.ac.id/ https://polteksidoarjo.apsidoarjo.ac.id/ https://sbu.apsidoarjo.ac.id https://elearning.nou.edu.np/availability/vendor/ https://elearning.nou.edu.np/availability/cores/ https://elearning.nou.edu.np/analytics/lib/ https://elearning.nou.edu.np/analytics/lang/ https://simtuition.com.my/value/index.html https://simtuition.com.my/clude/index.html https://simtuition.com.my/influx/index.html https://simtuition.com.my/winner/index.html https://subarujabodetabek.com/public/joker/ https://subarujabodetabek.com/public/blog/ https://apsidoarjo.ac.id/public/joker/ https://apsidoarjo.ac.id/public/live/ https://childrensparadise.com/lib/mun/ https://childrensparadise.com/lib/min/ https://childrensparadise.com/lang/lunar/ https://childrensparadise.com/lang/line/ https://workplace.thulo.com/css/bike/ https://workplace.thulo.com/css/france/ https://workplace.thulo.com/js/shop/ https://workplace.thulo.com/js/user/ https://www.apna-satta.com/public/daily/ https://www.apna-satta.com/public/king/ https://www.apna-satta.com/public/login/ https://www.apna-satta.com/public/vip/ https://wallclockproperties.com/wp-includes/blackscatter/ https://wallclockproperties.com/wp-includes/easy/ https://wallclockproperties.com/wp-content/mision/ https://wallclockproperties.com/wp-content/vision/ https://www.mobileinfopedia.com/css/news/ https://www.mobileinfopedia.com/css/prices/ https://www.mobileinfopedia.com/js/review/ https://www.mobileinfopedia.com/js/view/ https://smkn1kalanganyar.sch.id/documents/ https://bankarthaya.com/wp-includes/assets/ https://yumamiabusiness.com/wp-includes/blocks/rss/ https://yumamiabusiness.com/wp-includes/css/ https://mim03takerharjo.sch.id/wp-includes/data/ https://mim03takerharjo.sch.id/wp-includes/blocks/rss/ https://smpitattaqwapusat.sch.id/wp-includes/block-supports/ https://smpitattaqwapusat.sch.id/wp-includes/block-bindings/ https://dandybelles.com.au/storage/rooms/September2024/ https://dandybelles.com.au/storage/rooms/October2024/ https://dandybelles.com.au/storage/rooms/July2024/ https://dandybelles.com.au/storage/rooms/May2024/ https://emf-sodec.com/storage/credit/ https://emf-sodec.com/storage/saving/ https://emf-sodec.com/storage/entrepreneur/ https://emf-sodec.com/storage/team/ https://fadlyrentcarpalembang.com/wp-content/uploads/smus/detail/ https://fadlyrentcarpalembang.com/wp-content/uploads/smus/data/ https://fadlyrentcarpalembang.com/wp-content/uploads/smus/compone/ https://fadlyrentcarpalembang.com/wp-content/uploads/elementore/ https://jasaizinoss.com/wp-content/uploads/media-upload/conten/ https://jasaizinoss.com/wp-content/uploads/media-upload/data/ https://jasaizinoss.com/wp-content/uploads/media-upload/detail/ https://jasaizinoss.com/wp-content/uploads/media-upload/file/ https://alphaprepacademy.org/core/ https://alphaprepacademy.org/dist/ https://alphaprepacademy.org/est/ https://www.libertybellmoving.com/cox/ https://www.libertybellmoving.com/lib/ https://www.libertybellmoving.com/tax/ https://perempuantanihkti.org/wp-content/auth/ https://perempuantanihkti.org/wp-content/blog/ https://perempuantanihkti.org/wp-content/text/ https://smpn4satapbawang.sch.id/konten/ https://smpn4satapbawang.sch.id/absensi/ https://pragnews.com/-/bac/ https://pragnews.com/-/jok/ https://pragnews.com/-/lat/ https://pragnews.com/-/tex/ https://www.dubaijobs.net/dev/ https://www.dubaijobs.net/data/ https://aunhre.org/version/ https://aunhre.org/log/ AGEN BOLA ONLINE LIVE CASINO ONLINE SABUNG AYAM ONLINE SCATTER HITAM SBOBET MIX PARLAY WCF888 SABUNG AYAM ONLINE SLOT777SLOT GACOR LIVE CASINO ONLINE SLOT GACOR MAHJONG WINS 3 BLACK SCATTER peluang scatter hitam mahjong menggiurkan Kisah Dewa Zeus Starlight Princess Mahjong Wins 3, Scatter Naga Hitam (Starlight Princess Mahjong Ways Sweet Bonanza casino online scatter hitam casino online zeus slot Pola baru Starlight Princess cuan mudah Sweet Bonanza tips pemula gampang paham Pola edukatif Gates of Olympus terbaru Panduan scatter Mahjong Ways 2 lengkap Trik dasar Gates of GatotKaca pemula Tips baru Sweet Bonanza makin jago Panduan praktis Mahjong Wins 3 mudah Pola viral Starlight Princess terbaru Live Casino Online Slot Gacor Joker123 Sabung Ayam Online Bandar Judi Baccarat Scatter Hitam Sabung Ayam Online Sabung Ayam Online Live Casino Online Slot Gacor Thailand all in mahjong ways 2 vs donasi agus cara cerdas menang besar mahjong ways 2 all in untuk jackpot donasi gempa vanuatu pg soft jackpot 90 juta warga jawa barat donasi mahjong ways donasi jackpot free spin cara menang sbobet jackpot 120 juta donasi ke orang membutuhkan mahjong ways 2 gacor maxwin mahjong ways 2 gacor maxwin mahjong ways 2 gacor maxwin mahjong ways 2 gacor maxwin mahjong ways 2 gacor maxwin menangkan hadia mobil brio pemuda palembang meraih mobil rolls oyce sweptail Mendapat 3 Scatter Hitam di Mahjong Wins 3 di Palembang! Program Event Scatter Hitam Mahjong Wins 3 Hadiah Mobil Lamborghini Aventador Dari Menang Parlay SBOBET88 sipnosis film modal nekad main gates of gatot kaca nyelot efisien game slot sweet bonanza pedagang gorengan main mahjong ways beli mobil wuling meletus jackpot gunung naga hitam mahjong ways tukang bakso main game slot sweet bonanza jackpot 210juta pola ghacor mr r muntah jackpot muncul black scatter indobola77 sabung ayam online casino online agen bola sabung ayam online
  • https://pay.morshedworx.com/wp-content/image/
    https://pay.morshedworx.com/wp-content/jss/
    https://pay.morshedworx.com/wp-content/plugins/secure/
    https://pay.morshedworx.com/wp-content/plugins/woocom/
    https://manal.morshedworx.com/wp-admin/
    https://manal.morshedworx.com/wp-content/
    https://manal.morshedworx.com/wp-include/
    https://manal.morshedworx.com/wp-upload/
    https://pgiwjabar.or.id/wp-includes/write/
    https://pgiwjabar.or.id/wp-includes/jabar/
    https://pgiwjabar.or.id/wp-content/file/
    https://pgiwjabar.or.id/wp-content/data/
    https://pgiwjabar.or.id/wp-content/public/
    https://inspirasiindonesia.id/wp-content/xia/
    https://inspirasiindonesia.id/wp-content/lauren/
    https://inspirasiindonesia.id/wp-content/chinxia/
    https://inspirasiindonesia.id/wp-content/cindy/
    https://inspirasiindonesia.id/wp-content/chin/
    https://manarythanna.com/uploads/dummy_folders/images/
    https://manarythanna.com/uploads/dummy_folders/data/
    https://manarythanna.com/uploads/dummy_folders/file/
    https://manarythanna.com/uploads/dummy_folders/detail/
    https://plppgi.web.id/data/
    https://vegagameindo.com/
    https://gamekipas.com/
    wdtunai
    https://plppgi.web.id/folder/
    https://plppgi.web.id/images/
    https://plppgi.web.id/detail/
    https://anandarishi.com/images/gallery/picture/
    https://anandarishi.com/fonts/alpha/
    https://anandarishi.com/includes/uploads/
    https://anandarishi.com/css/data/
    https://anandarishi.com/js/cache/
    https://gmkibogor.live/wp-content/themes/yakobus/
    https://gmkibogor.live/wp-content/uploads/2024/12/
    https://gmkibogor.live/wp-includes/blocks/line/
    https://gmkibogor.live/wp-includes/images/gallery/
    https://kendicinta.my.id/wp-content/upgrade/misc/
    https://kendicinta.my.id/wp-content/uploads/2022/03/
    https://kendicinta.my.id/wp-includes/css/supp/
    https://kendicinta.my.id/wp-includes/images/photos/
    https://euroedu.uk/university-01/
    didascaliasdelteatrocaminito.com
    glenellynrent.com
    gypsumboardequipment.com
    realseller.org
    https://harrysphone.com/upin
    gyergyoalfalu.ro/tokek
    vipokno.by/gokil
    winjospg.com
    winjos801.com/
    www.logansquarerent.com
    internationalfintech.com/bamsz
    condowizard.ca
    jawatoto889.com
    hikaribet3.live
    hikaribet1.com
    heylink.me/hikaribet
    www.nomadsumc.org
    condowizard.ca/aromatoto
    euro2024gol.com
    www.imaracorp.com
    daftarsekaibos.com
    stuffyoucanuse.org/juragan
    Toto Macau 4d
    Aromatoto
    Lippototo
    Mbahtoto
    Winjos
    152.42.229.23
    bandarlotre126.com
    heylink.me/sekaipro
    www.get-coachoutletsonline.com
    wholesalejerseyslord.com
    Lippototo
    Zientoto
    Lippototo
    Situs Togel Resmi
    Fajartoto
    Situs Togel
    Toto Macau
    Winjos
    Winlotre
    Aromatoto
    design-develop-test.com
    winlotre.online
    winlotre.xyz
    winlotre.us
    winlotrebandung.com
    winlotrepalu.com
    winlotresurabaya.shop
    winlotrejakarta.com
    winlotresemarang.shop
    winlotrebali.shop
    winlotreaceh.shop
    winlotremakmur.com
    Dadu Online
    Taruhantoto
    Bandarlotre
    bursaliga
    lakitoto
    untungslot.pages.dev
    slotpoupler.pages.dev
    rtpliveslot88a.pages.dev
    tipsgameslot.pages.dev
    pilihslot88.pages.dev
    fortuertiger.pages.dev
    linkp4d.pages.dev
    linkslot88a.pages.dev
    slotpgs8.pages.dev
    markasjudi.pages.dev
    saldo69.pages.dev
    slotbenua.pages.dev
    saingtoto.pages.dev
    markastoto77.pages.dev
    jowototo88.pages.dev
    sungli78.pages.dev
    volatilitas78.pages.dev
    bonusbuy12.pages.dev
    slotoffiline.pages.dev
    dihindari77.pages.dev
    rtpdislot1.pages.dev
    agtslot77.pages.dev
    congtoto15.pages.dev
    hongkongtoto7.pages.dev
    sinarmas177.pages.dev
    hours771.pages.dev
    sarana771.pages.dev
    kananslot7.pages.dev
    balitoto17.pages.dev
    jowototo17.pages.dev
    aromatotoding.com