Mistral Small 3

Free

Open Source

LLM

horizontal

39 views

Efficient, open-source AI model rivaling larger competitors with lower resource requirements.

https://mistral.ai/news/mistral-small-3/

Published 2025/03/21

AgentHunter

Featured AI Agent

Visit Website

Agent Details

Mistral Small 3 is a 24B-parameter language model released under the Apache 2.0 license. It offers performance comparable to larger models like Llama 3.3 70B while being more than 3x faster on the same hardware. Designed for local deployment, it excels in tasks requiring robust language and instruction following with very low latency. The model can be quantized to run on a single RTX 4090 or a Macbook with 32GB RAM

Key Features

24B parameters
Apache 2.0 license
Low latency (150 tokens/s)
81% accuracy on MMLU
32k context window
Multilingual support
Function calling capabilities
Optimized for quantization

Use Cases

Fast-response conversational assistance
Low-latency function calling
Fine-tuning for subject matter experts
Local inference for sensitive data
Fraud detection in financial services
Customer triaging in healthcare
On-device command and control in robotics and manufacturing
Virtual customer service
Sentiment and feedback analysis

Video

Featured AI Agents

xAIcreator

AI-powered Twitter marketing tool for tracking trends, rewriting viral content, and optimizing posting schedules.

Freemium

1

PoseUp.ai

PoseUp.ai is an AI-powered photo enhancement tool that transforms ordinary photos into professional-quality images.

Freemium

0

KOLFind

KOLFind is an AI-driven platform that helps brands discover and connect with nano and micro influencers across TikTok, Instagram, and YouTube to drive effective influencer marketing campaigns.

Freemium

10