All Topics  
Almost surely

 

   Email Print
   Bookmark   Link






 

Almost surely



 
 
In probability theory
Probability theory

Probability theory is the branch of mathematics concerned with analysis of Statistical randomness phenomena. The central objects of probability theory are random variables, stochastic processes, and event s: mathematical abstractions of determinism events or measured quantities that may either be single occurrences or evolve over time in an a...
, one says that an event
Event (probability theory)

In probability theory, an event is a Set of outcomes to which a probability is assigned. Typically, when the sample space is finite, any subset of the sample space is an event ....
 happens almost surely (a.s.) if it happens with probability one. The concept is analogous to the concept of "almost everywhere
Almost everywhere

In measure theory , one says that a property holds almost everywhere if the set of elements for which the property does not hold is a null set, i.e....
" in measure theory. While there is no difference between almost surely and surely (that is, entirely certain to happen) in many basic probability experiments, the distinction is important in more complex cases relating to some sort of infinity
Infinity

Infinity comes from the Latin infinitas or "unboundedness." It refers to several distinct concepts – usually linked to the idea of "without end" – which arise in philosophy, mathematics, and theology....
. For instance, the term is often encountered in questions that involve infinite time, regularity properties or infinite-dimension
Dimension

In mathematics, the dimension of a space is roughly defined as the minimum number of coordinates needed to specify every point within it. For example: a point on the unit circle in the plane can be specified by two Cartesian coordinates but one can make do with a single coordinate , so the circle is 1-dimensional even though it exists in...
al spaces such as function space
Function space

In mathematics, a function space is a Set of function s of a given kind from a set X to a set Y. It is called a space because in many applications, it is a topological space or a vector space or both....
s.






Discussion
Ask a question about 'Almost surely'
Start a new discussion about 'Almost surely'
Answer questions from other users
Full Discussion Forum



Encyclopedia


In probability theory
Probability theory

Probability theory is the branch of mathematics concerned with analysis of Statistical randomness phenomena. The central objects of probability theory are random variables, stochastic processes, and event s: mathematical abstractions of determinism events or measured quantities that may either be single occurrences or evolve over time in an a...
, one says that an event
Event (probability theory)

In probability theory, an event is a Set of outcomes to which a probability is assigned. Typically, when the sample space is finite, any subset of the sample space is an event ....
 happens almost surely (a.s.) if it happens with probability one. The concept is analogous to the concept of "almost everywhere
Almost everywhere

In measure theory , one says that a property holds almost everywhere if the set of elements for which the property does not hold is a null set, i.e....
" in measure theory. While there is no difference between almost surely and surely (that is, entirely certain to happen) in many basic probability experiments, the distinction is important in more complex cases relating to some sort of infinity
Infinity

Infinity comes from the Latin infinitas or "unboundedness." It refers to several distinct concepts – usually linked to the idea of "without end" – which arise in philosophy, mathematics, and theology....
. For instance, the term is often encountered in questions that involve infinite time, regularity properties or infinite-dimension
Dimension

In mathematics, the dimension of a space is roughly defined as the minimum number of coordinates needed to specify every point within it. For example: a point on the unit circle in the plane can be specified by two Cartesian coordinates but one can make do with a single coordinate , so the circle is 1-dimensional even though it exists in...
al spaces such as function space
Function space

In mathematics, a function space is a Set of function s of a given kind from a set X to a set Y. It is called a space because in many applications, it is a topological space or a vector space or both....
s. Basic examples of use include the law of large numbers
Law of large numbers

The law of large numbers is a theorem in probability that describes the long-term stability of the arithmetic mean of a random variable. Given a random variable with a finite expected value, if its values are repeatedly sampled, as the number of these observations increases, their mean will tend to approach and stay close to the expected va...
 (strong form) or continuity of Brownian paths
Brownian motion

Brownian motion is the seemingly random movement of particles suspended in a liquid or gas or the mathematical model used to describe such random movements, often called a particle theory....
.

Formal definition

Let (O, F, P) be a probability space
Probability space

A probability space, in probability theory, is the conventional mathematical model of randomness. This mathematical object, sometimes called also probability triple, formalizes three interrelated ideas by three mathematical notions....
. One says that an event
Event (probability theory)

In probability theory, an event is a Set of outcomes to which a probability is assigned. Typically, when the sample space is finite, any subset of the sample space is an event ....
 E in F happens almost surely if P(E) = 1. Alternatively, an event E happens almost surely if the probability of E not occurring is zero.

An alternative definition from a measure theoretic
Measure (mathematics)

In mathematics, more specifically in measure theory, a measure on a set is a systematic way to assign to each suitable subset a number, intuitively interpreted as the size of the subset....
-perspective is that (since P is a measure over O) E happens almost surely if E = O almost everywhere
Almost everywhere

In measure theory , one says that a property holds almost everywhere if the set of elements for which the property does not hold is a null set, i.e....
.

"Almost sure" versus "sure"

The difference between an event being almost sure and sure is the same as the subtle difference between something happening with probability 1 and happening always.

If an event is sure, then it will always happen. No other event (even events with probability 1) can possibly occur. If an event is almost sure, then other events are theoretically possible in a given sample space, however as the cardinality of the sample space increases, the probability of any other event asymptotically converges toward zero. Thus, one can never definitively say for any sample space that other events will never occur, but can in the general case assume this to be true. In this respect, the concept is similar to that of a mathematical limit
Limit (mathematics)

In mathematics, the concept of a "limit" is used to describe the behavior of a Function as its argument or input either "gets close" to some point, or as the argument becomes arbitrarily large; or the behavior of a sequence's elements as their index increases indefinitely....
.

Throwing a dart

For example, imagine throwing a dart at a unit square wherein the dart will impact exactly one point, and imagine that this square is the only thing in the universe. There is physically nowhere else for the dart to land. Then, the event that "the dart hits the square" is a sure event. No other alternative is imaginable.

Next, consider the event that "the dart hits the diagonal of the unit square exactly". The probability that the dart lands on any subregion of the square is equal to the area of that subregion. But, since the area of the diagonal of the square is zero, the probability that the dart lands exactly on the diagonal is zero. So, the dart will almost surely not land on the diagonal. Nonetheless the set of points on the diagonal is not empty and a point on the diagonal is no less possible than any other point.

The same may be said of any point on the square. Any such point P will contain zero area and so will have zero probability of being hit by the dart. However, the dart clearly must hit the square somewhere. Therefore, in this case, it is not only possible or imaginable that an event with zero probability will occur; one must occur. Thus, we would not want to say we were certain that a given event would not occur, but rather almost certain.

Tossing a coin

Suppose that an "ideal" (edgeless) fair coin
Fair coin

In probability theory and statistics, a sequence of statistical independence Bernoulli trials with probability 1/2 of success on each trial is metaphorically called a fair coin....
 is flipped again and again. A coin has two sides, heads and tails, and therefore the event that "heads or tails is flipped" is a sure event. There can be no other result from such a coin.

The infinite sequence of all heads (H-H-H-H-H-H-…), ad infinitum
Ad infinitum

Ad infinitum is a Latin List of Latin phrases meaning "to infinity."In context, it usually means "continue forever, without limit" and thus can be used to describe a non-terminating process, a non-terminating repeating process, or a set of instructions to be repeated "forever", among other uses....
, is possible in some sense (it does not violate any physical or mathematical laws to suppose that tails never appears) but it is very, very improbable. In fact, the probability of tails never being flipped in an infinite series is zero. Thus, though we cannot definitely say tails will be flipped at least once, we can say there will almost surely be at least a single tails flip in an infinite sequence of flips. (Note that given the statements made in this paragraph, any predefined ordering would have zero-probability in an infinite series. This makes sense because there are an infinite number of possibilities and .)

However, if instead of an infinite number of flips we stop flipping after some finite time, say a million flips, then the all-heads sequence has non-zero probability. The all-heads sequence has probability 2−1,000,000, thus the probability of getting a tails is 1 − 2−1,000,000 < 1, and the event is no longer almost sure.

Asymptotically almost surely

In asymptotic analysis
Asymptotic analysis

In pure mathematics and applied mathematics, particularly the analysis of algorithms, real analysis, and engineering, asymptotic analysis is a method of describing Limit ing behaviour....
, one says that a property holds asymptotically almost surely (a.a.s.) if, over a sequence of sets, the probability converges to 1. For instance, a large number is asymptotically almost surely composite
Composite number

A composite number is a negative and non-negative numbers integer which has a positive divisor other than one or itself. In other words, if 0 < n is an integer and there are integers 1 < a, b < n such that n = a ? b then n is composite....
, by the prime number theorem
Prime number theorem

In number theory, the prime number theorem describes the asymptotic analysis distribution of the prime numbers. The prime number theorem gives a rough description of how the primes are distributed....
; and in random graph theory
Random graph

In mathematics, a random graph is a Graph_ that is generated by some random process. The theory of random graphs lies at the intersection between graph theory and probability theory, and studies the properties of typical random graphs....
, the statement "G(n,pn) is connected
Connectivity (graph theory)

In mathematics and computer science, connectivity is one of the basic concepts of graph theory. It is closely related to the theory of network flow problems....
" (where G(n,p)
Erdos–Rényi model

In graph theory, the Erdos-R?nyi model, named for Paul Erdos and Alfr?d R?nyi, is either of two models for generating random graphs, including one that sets an edge between each pair of nodes with equal probability, statistical independence of the other edges....
 denotes the graphs on n vertices with edge probability p) is true a.a.s when pn > for any e > 0.

In number theory
Number theory

Number theory is the branch of pure mathematics concerned with the properties of numbers in general, and integers in particular, as well as the wider classes of problems that arise from their study....
 this is referred to as "almost all
Almost all

In mathematics, the phrase almost all has a number of specialised uses."Almost all" is sometimes used synonymously with "all but finite setly many" or "all but a countable set" ; see almost....
", as in "almost all numbers are composite". Similarly, in graph theory, this is sometimes referred to as "almost surely".

See also

  • Convergence of random variables
    Convergence of random variables

    In probability theory, there exist several different notions of convergence of random variables. The convergence of sequences of random variables to some Limit ing random variable is an important concept in probability theory, and its applications to statistics and stochastic processes....
    , for "almost sure convergence"
  • Constant random variable, for "almost surely constant"
  • Almost everywhere
    Almost everywhere

    In measure theory , one says that a property holds almost everywhere if the set of elements for which the property does not hold is a null set, i.e....
    , the corresponding concept in measure theory
  • Infinite monkey theorem
    Infinite monkey theorem

    The infinite monkey theorem states that a monkey hitting keys at random on a typewriter keyboard for an infinite amount of time will almost surely type a given text, such as the complete works of William Shakespeare....
    , a theorem using the aforementioned terms.