Mistral Unveils Ministral 3B and 8B AI Models for Edge Computing and On-Device Use

October 17, 2024 at 7:04:41 AM

TL;DR Mistral introduces two new AI models: Ministral 3B and Ministral 8B. These models excel in knowledge, reasoning, and efficiency for on-device and edge use cases, supporting up to 128k context length. Ministral 8B features a sliding-window attention pattern for faster inference. They cater to local, privacy-first applications like on-device translation and autonomous robotics. Both models outperform peers in benchmarks and are available now.

Mistral Unveils Ministral 3B and 8B AI Models for Edge Computing and On-Device Use

Mistral has introduced two new AI models, Ministral 3B and Ministral 8B, designed for on-device computing and edge use cases. These models excel in knowledge, commonsense reasoning, function-calling, and efficiency within the sub-10B category. They support up to 128k context length (currently 32k on vLLM), with Ministral 8B featuring an interleaved sliding-window attention pattern for faster and memory-efficient inference.

Use Cases

Les Ministraux cater to local, privacy-first inference needs for applications such as:

  • On-device translation
  • Internet-less smart assistants
  • Local analytics
  • Autonomous robotics

They are also efficient intermediaries for function-calling in multi-step workflows, handling input parsing, task routing, and API calls with low latency and cost.

The performance of les Ministraux has been benchmarked across multiple tasks, consistently outperforming peers. The models were compared to Gemma 2 2B, Llama 3.2 3B, Llama 3.1 8B, and Mistral 7B.

Pretrained Models

  • Ministral 3B and 8B were compared to other models in multiple categories, showcasing superior performance.

Instruct Models

  • Ministral 3B and 8B Instruct models were compared to Gemma 2 2B, Llama 3.2 3B, Llama 3.1 8B, and Gemma 2 9B, demonstrating significant improvements.

Availability and Pricing

Both models are available immediately with the following pricing:

  • Ministral 8B: $0.1 / M tokens (input and output), available under Mistral Commercial License and Mistral Research License.
  • Ministral 3B: $0.04 / M tokens (input and output), available under Mistral Commercial License.

For self-deployed use, commercial licenses are available upon request, with assistance in lossless quantization for specific use cases. Model weights for Ministral 8B Instruct are available for research use, and both models will soon be available from cloud partners.

Mistral AI continues to push the boundaries of frontier models, with Ministral 3B already outperforming the previous Mistral 7B on most benchmarks. Feedback is encouraged as they continue to innovate.

Have more questions on this topic? Ask our AI assistant for in-depth insights.

Read more from sources 👇

The Only Digital Marketing Feed You'll Ever Need.

Stay informed your way. Tailored updates when and how you want them. 100% Free.

10,000+ Users

500+ Sources

1000+ Tools

Or

Related Posts

Google launches Portraits AI coaching bots based on real experts like Kim Scott

Google launches Portraits AI coaching bots based on real experts like Kim Scott

Google
Google

Official Source

Official Source

Google is a Official Source. The source has been verified by Swipe Insight team.

Official Source
Meta to automate 90 percent of product risk assessments with AI system

Meta to automate 90 percent of product risk assessments with AI system

Google Ads Monthly Slides with AI Insights

Google Ads Monthly Slides with AI Insights

Featured
Markifact
Markifact

Verified Sponsor

Verified Sponsor

Markifact is a Verified Sponsor. Want to get featured here? Contact us.

Verified Sponsor
Google AI introduces new creative tools for ads video and brand management

Google AI introduces new creative tools for ads video and brand management

Google Ads AI +1 more
Google
Google

Official Source

Official Source

Google is a Official Source. The source has been verified by Swipe Insight team.

Official Source
Google unveils Flow AI filmmaking tool with Veo Imagen and Gemini models

Google unveils Flow AI filmmaking tool with Veo Imagen and Gemini models

Google
Google

Official Source

Official Source

Google is a Official Source. The source has been verified by Swipe Insight team.

Official Source
Google launches AI Mode for shopping with new virtual try-on feature using personal photos Trending ️‍🔥

Google launches AI Mode for shopping with new virtual try-on feature using personal photos

Google
Google

Official Source

Official Source

Google is a Official Source. The source has been verified by Swipe Insight team.

Official Source
Google launches NotebookLM mobile apps for Android and iOS with offline audio and sharing

Google launches NotebookLM mobile apps for Android and iOS with offline audio and sharing

Google
Google

Official Source

Official Source

Google is a Official Source. The source has been verified by Swipe Insight team.

Official Source
Perplexity partners with PayPal to launch AI-powered in-chat shopping for US users

Perplexity partners with PayPal to launch AI-powered in-chat shopping for US users

PayPal Newsroom
PayPal Newsroom

Official Source

Official Source

PayPal Newsroom is a Official Source. The source has been verified by Swipe Insight team.

Official Source

Related Tools

Markifact logo

Markifact

Verified Tool

Verified Tool

Markifact is a Verified Tool. Want to get this badge? Contact us.

Verified Tool

Marketing Workflows Powered by AI

Featured
Marketing Auditor logo

Marketing Auditor

Verified Tool

Verified Tool

Marketing Auditor is a Verified Tool. Want to get this badge? Contact us.

Verified Tool

Automated audits for Google Ads and Analytics.

Get Featured Here

Showcase your tool in this list.

Contact Us
Thunderbit logo

Thunderbit

No-code AI apps and automations for business users

Workflow Automation
Formula Bot logo

Formula Bot

AI-powered data analysis and visualization tool

Data Analysis