LogoAgentHunter
  • Submit
  • Industries
  • Categories
  • Agency
Logo
LogoAgentHunter

Discover, Compare, and Leverage the Best AI Agents

Featured On

Featured on yo.directory
yo.directory
Featured on yo.directory
Featured on Startup Fame
Startup Fame
Featured on Startup Fame
AIStage
Listed on AIStage
Sprunkid
Featured on Sprunkid
Featured on Twelve Tools
Twelve Tools
Featured on Twelve Tools
Listed on Turbo0
Turbo0
Listed on Turbo0
Featured on Product Hunt
Product Hunt
Featured on Product Hunt
Game Sprunki
Featured on Game Sprunki
AI Toolz Dir
Featured on AI Toolz Dir
Featured on Microlaunch
Microlaunch
Featured on Microlaunch
Featured on Fazier
Fazier
Featured on Fazier
Featured on Techbase Directory
Techbase Directory
Featured on Techbase Directory
backlinkdirs
Featured on Backlink Dirs
Featured on SideProjectors
SideProjectors
Featured on SideProjectors
Submit AI Tools
Featured on Submit AI Tools
AI Hunt
Featured on AI Hunt
Featured on Dang.ai
Dang.ai
Featured on Dang.ai
Featured on AI Finder
AI Finder
Featured on AI Finder
Featured on LaunchIgniter
LaunchIgniter
Featured on LaunchIgniter
Imglab
Featured on Imglab
AI138
Featured on AI138
600.tools
Featured on 600.tools
Featured Tool
Featured on Featured Tool
Dirs.cc
Featured on Dirs.cc
Ant Directory
Featured on Ant Directory
Featured on MagicBox.tools
MagicBox.tools
Featured on MagicBox.tools
Featured on Code.market
Code.market
Featured on Code.market
Featured on LaunchBoard
LaunchBoard
Featured on LaunchBoard
Genify
Featured on Genify
Copyright © 2025 All Rights Reserved.
Product
  • AI Agents Directory
  • AI Agent Glossary
  • Industries
  • Categories
Resources
  • AI Agentic Workflows
  • Blog
  • News
  • Submit
  • Coummunity
  • Ebooks
Company
  • About Us
  • Privacy Policy
  • Terms of Service
  • Sitemap
Friend Links
  • AI Music API
  • ImaginePro AI
  • Dog Names
  • Readdit Analytics
Back to News List

Small Language Models Are Gaining Popularity Among Researchers

April 13, 2025•Stephen Ornes•Original Link•2 minutes
ArtificialIntelligence
MachineLearning
Technology

While larger models offer versatility, smaller models are becoming attractive due to their reduced footprint and efficiency.

Large language models (LLMs) like those from OpenAI, Meta, and DeepSeek are powerful but come with significant costs. These models, which use hundreds of billions of parameters, require massive computational resources for training and operation. For example, Google reportedly spent $191 million to train its Gemini 1.0 Ultra model. Additionally, a single ChatGPT query consumes about 10 times more energy than a Google search, according to the Electric Power Research Institute.

In response, researchers are turning to small language models (SLMs). Companies like IBM, Google, Microsoft, and OpenAI have released SLMs with just a few billion parameters. While these models are not as versatile as LLMs, they excel in specific tasks such as summarizing conversations, serving as health care chatbots, and collecting data in smart devices. Zico Kolter, a computer scientist at Carnegie Mellon University, noted that "For a lot of tasks, an 8 billion–parameter model is actually pretty good." SLMs can also run on devices like laptops or cell phones, reducing reliance on large data centers.

Training and Optimizing Small Models

To make SLMs effective, researchers use techniques like knowledge distillation, where large models generate high-quality training data for smaller ones. This method ensures that SLMs learn from cleaner, more organized data. Another approach is pruning, which involves removing unnecessary parts of a neural network to improve efficiency. Pruning was inspired by the human brain and was first proposed by Yann LeCun in a 1989 paper. This technique allows researchers to fine-tune SLMs for specific tasks or environments.

Advantages of Small Models

SLMs offer several benefits:

  • Cost-Effectiveness: They require fewer computational resources, making them cheaper to train and deploy.
  • Transparency: With fewer parameters, their reasoning processes are easier to understand.
  • Experimentation: Researchers can test new ideas with lower stakes, as noted by Leshem Choshen of the MIT-IBM Watson AI Lab.

While LLMs will remain useful for tasks like generalized chatbots and drug discovery, SLMs provide a practical alternative for targeted applications. As Choshen put it, "These efficient models can save money, time, and compute."

Original story reprinted with permission from Quanta Magazine.

Related News

August 18, 2025•ABcontributor

Zscaler CAIO on securing AI agents and blending rule-based with generative models

Claudionor Coelho Jr, Chief AI Officer at Zscaler, discusses AI's rapid evolution, cybersecurity challenges, and combining rule-based reasoning with generative models for enterprise transformation.

ArtificialIntelligence
Cybersecurity
GenerativeAI
August 18, 2025•Bryan Wassel

Human-AI collaboration boosts customer support satisfaction

AI enhances customer support when used as a tool for human agents, acting as a sixth sense or angel on the shoulder, according to Verizon Business study.

CustomerExperience
ArtificialIntelligence
CX

About the Author

Dr. Lisa Kim

Dr. Lisa Kim

AI Ethics Researcher

Leading expert in AI ethics and responsible AI development with 13 years of research experience. Former member of Microsoft AI Ethics Committee, now provides consulting for multiple international AI governance organizations. Regularly contributes AI ethics articles to top-tier journals like Nature and Science.

Expertise

AI Ethics
Algorithmic Fairness
AI Governance
Responsible AI
Experience
13 years
Publications
95+
Credentials
2
LinkedInResearchGate

Agent Newsletter

Get Agentic Newsletter Today

Subscribe to our newsletter for the latest news and updates