Probability distribution

Lore & Background

In probability theory and statistics, a probability distribution describes how probabilities are assigned to the possible results of a random phenomenon—more precisely, to events, which are sets of possible outcomes of a probabilistic experiment. Informally, a probability distribution tells us how likely different results are. Formally, it is a probability measure: a function that assigns probabilities to events in a way that satisfies the axioms of probability.

Probability distributions are closely linked to random variables. A random variable is a function that assigns a value to each outcome of a probabilistic experiment; it induces a probability distribution on the set of values it can take. For example, the result of a coin toss can be represented by a random variable X that equals 1 for heads and 0 for tails. If the coin is fair, this distribution assigns probability 1/2 to X = 1 and probability 1/2 to X = 0.

In practice, probability distributions are often described by functions such as cumulative distribution functions, probability mass functions, or probability density functions. Which description is used depends on the nature of the distribution: probability mass functions are used for discrete distributions, while probability density functions are used for many continuous distributions. Probability distributions that occur frequently or have special theoretical importance are often given specific names.

The Mathematical Core

The Poisson distribution is a discrete probability model that quantifies how likely it is to observe exactly k occurrences within a fixed interval, given that events arrive at a known, constant average rate and each event is independent of when the previous one happened. Its probability mass function takes the elegant form of λ to the power k, multiplied by e to the negative λ, all divided by k factorial, where k ranges over zero, one, two, and so on.

The single parameter λ, which must be a positive real number, simultaneously determines both the mean and the variance of the distribution—a notable property that simplifies modeling considerably. When a problem provides an average event rate r rather than a total expected count, the formula adapts naturally by substituting λ with the product of r and the interval length t. This flexibility makes the distribution a workhorse for any scenario involving a large pool of potential events, each individually rare, where one wishes to count how many actually materialize during a specified window.

Reader's Guide

Probability distributions are fundamental to probability theory and statistics, providing the formal framework for quantifying uncertainty in random phenomena. They allow the assignment of probabilities to events—subsets of the sample space—and are essential for modeling everything from coin flips to continuous measurements like weight.

The distinction between discrete and continuous distributions is key: discrete distributions use probability mass functions to assign probabilities to individual outcomes, while continuous distributions use probability density functions, where any single outcome has probability zero but intervals can have positive probability. The cumulative distribution function describes the probability that a random variable is no larger than a given value. By linking random variables to probability measures via pushforward measures, probability distributions enable rigorous statistical inference and are the basis for many named distributions used across science and engineering.