Vllm
Definition
vLLM (Virtual Large Language Model) is an open-source library designed to accelerate LLM …
Inference
Terms tagged with Inference
Text Embeddings Inference
Definition
Text Embeddings Inference refers to the deployment and optimization of models that …
Text Generation Inference
Definition
Text Generation Inference (TGI) is a dedicated software framework designed to serve large …
Self-Consistency
Definition
Primarily used with Large Language Models (LLMs), this technique improves accuracy by …
PagedAttention
Definition
PagedAttention is a technique introduced by the vLLM project to improve the efficiency of …
Inferential theory of learning
Definition
This theory posits that learning is essentially a process of probabilistic inference. …
Expectation propagation
Definition
Expectation Propagation (EP) approximates intractable integrals by iteratively refining …
Eager learning
Definition
In eager learning, the system constructs a general target function or model based on the …
Bayesian programming
Definition
Bayesian programming is a mathematical framework that generalizes Bayes’ theorem to …
Bayesian learning mechanisms
Definition
Bayesian learning mechanisms update beliefs about model parameters using Bayes’ …
Monte
Definition
Monte Carlo techniques are a class of computational algorithms that rely on repeated …
Causal
Definition
In artificial intelligence, causal modeling seeks to understand how interventions on one …