EDGE
Get a demo
Log In
All Updates

All Updates

icon
Filter
Product updates
Mistral AI releases Mixtral 8x22B, an LLM built on multiple MoE for optimized cost and performance
Foundation Models
Apr 10, 2024
Last week:
Product updates
Samsung showcases OLEDoS screen for XR headsets at SID 2024 event
Extended Reality
Yesterday
Partnerships
Velar partners with Bitlayer to launch Bitcoin-based perpetual DEX
Decentralized Finance (DeFi)
May 17, 2024
Product updates
Tofurky to unveil plant-based hot dogs and updates deli slices at NRA Show
Plant-based Meat
May 17, 2024
Product updates
LG Display announces micro-OLED display with 4K resolution and 10,000 nit brightness
Extended Reality
May 17, 2024
Funding
Turbine secures investment from Accenture Ventures
AI Drug Discovery
May 17, 2024
Partnerships
Dwolla partners with Visa to enhance account-to-account verification capabilities
FinTech Infrastructure
May 16, 2024
Product updates
Kajabi launches Creator.io, an AI chatbot system for digital creators
Creator Economy
May 16, 2024
Product updates
Armored Fresh to launch Oat Milk Cheddar Dip at NRA Show
Plant-based Dairy & Egg
May 16, 2024
FDA approval
Karius Receives FDA breakthrough designation for its DNA-based blood test
Precision Medicine
May 16, 2024
Funding
Metabolon raises USD 60 million in debt financing to strengthen R&D capabilities and enhance metabolomics platform
Precision Medicine
May 16, 2024
Foundation Models

Foundation Models

Apr 10, 2024

Mistral AI releases Mixtral 8x22B, an LLM built on multiple MoE for optimized cost and performance

Product updates

  • Mistral AI, an open-source developer of foundation models, has released 8x22B, an LLM built on a mixture of expert (MoE) architecture.

  • This approach aims to provide users with a combination of different models, specialized in different tasks, to optimize performance and costs by requiring only 44 billion active parameters per forward pass.

  • The model has a 65,000-token context window and 176 billion parameters. Additionally, the model is available under a permissive Apache 2.0 license.

Contact us

Gain access to all industry hubs, market maps, research tools, and more
Get a demo
arrow
menuarrow

By using this site, you agree to allow SPEEDA Edge and our partners to use cookies for analytics and personalization. Visit our privacy policy for more information about our data collection practices.