Inference
The process of a trained AI model generating a response or making a prediction based on new input.
Detailed Definition
Inference is when the model 'runs.' When you ask ChatGPT a question and it generates a response, that's it doing inference. It is the application phase after the model has been trained, where it uses its learned knowledge to perform its task.
Core ConceptsMore in this Category
Action Model
An internal model used by AI agents to predict the potential outcomes of their actions in specific states.
Agent
An AI system capable of taking actions autonomously to achieve specific goals in an environment.
Algorithm
A set of rules or instructions designed to solve a specific problem or perform a task.
Artificial Intelligence (AI)
The simulation of human intelligence in machines programmed to think and learn like humans.
Token
The basic unit of text that an AI model processes, which can be a word or part of a word.
Model
An AI model is a computer program built to work like a human brain, processing input to generate a response.