All Topics  
Stochastic

 

   Email Print
   Bookmark   Link






 

Stochastic



 
 
Stochastic (from the Greek
Greek language

Greek is an Indo-European languages native to the southern Balkan peninsula, the language of the Greek people. It forms an independent branch within Indo-European....
 "St????" for "aim" or "guess") means random.

A stochastic process
Stochastic process

A stochastic process, or sometimes random process, is the counterpart to a deterministic process in probability theory. Instead of dealing with only one possible 'reality' of how the process might evolve under time , in a stochastic or random process there is some indeterminacy in its future evolution described by probability distribu...
 is one whose behavior is non-deterministic
Deterministic system (mathematics)

In mathematics, a deterministic system is a system in which no randomness is involved in the development of future states of the system. Deterministic mathematical model thus produce the same output for a given starting condition....
 in that a system's subsequent state is determined both by the process's predictable actions and by a random element. Stochastic crafts are complex systems whose practitioners, even if complete experts, acknowledge that outcomes result from both known and unknown causes.






Discussion
Ask a question about 'Stochastic'
Start a new discussion about 'Stochastic'
Answer questions from other users
Full Discussion Forum



Encyclopedia


Stochastic (from the Greek
Greek language

Greek is an Indo-European languages native to the southern Balkan peninsula, the language of the Greek people. It forms an independent branch within Indo-European....
 "St????" for "aim" or "guess") means random.

A stochastic process
Stochastic process

A stochastic process, or sometimes random process, is the counterpart to a deterministic process in probability theory. Instead of dealing with only one possible 'reality' of how the process might evolve under time , in a stochastic or random process there is some indeterminacy in its future evolution described by probability distribu...
 is one whose behavior is non-deterministic
Deterministic system (mathematics)

In mathematics, a deterministic system is a system in which no randomness is involved in the development of future states of the system. Deterministic mathematical model thus produce the same output for a given starting condition....
 in that a system's subsequent state is determined both by the process's predictable actions and by a random element. Stochastic crafts are complex systems whose practitioners, even if complete experts, acknowledge that outcomes result from both known and unknown causes. Classical examples of this are medicine
Medicine

Medicine is the art and science of healing. It encompasses a range of health care practices evolved to maintain and restore health by the prevention and treatment of illness....
: a doctor can administer the same treatment to multiple patients suffering from the same symptoms, but the patients may not all react to the treatment the same way. This makes medicine a stochastic process. Additional examples are warfare
Warfare

Warfare refers to the conduct of conflict between opponents, and usually involves escalation of aggression from the proverbial "war of words" between politics and diplomacy to full-scale War, waged until one side accepts defeat or peace terms are agreed on....
, meteorology
Meteorology

Meteorology is the interdisciplinary scientific study of the Earth's atmosphere that focuses on weather processes and forecasting . Studies in the field stretch back millennia, though significant progress in meteorology did not occur until the eighteenth century....
, and rhetoric
Rhetoric

Rhetoric is the art of using language as a means to persuade. Along with logic and dialectic, rhetoric is one of the three ancient arts of discourse....
, where success and failure are so difficult to predict that explicit allowances are made for uncertainty.

Mathematical theory

In mathematics
Mathematics

Mathematics is the study of quantity, structure, space, change, and related topics of pattern and form. Mathematicians seek out patterns whether found in numbers, space, natural science, computers, imaginary abstractions, or elsewhere....
, specifically in probability theory
Probability theory

Probability theory is the branch of mathematics concerned with analysis of Statistical randomness phenomena. The central objects of probability theory are random variables, stochastic processes, and event s: mathematical abstractions of determinism events or measured quantities that may either be single occurrences or evolve over time in an a...
, the field of stochastic process
Stochastic process

A stochastic process, or sometimes random process, is the counterpart to a deterministic process in probability theory. Instead of dealing with only one possible 'reality' of how the process might evolve under time , in a stochastic or random process there is some indeterminacy in its future evolution described by probability distribu...
es has been a major area of research. It is often assumed to be related to statistics; this is in fact a mistake, as stochastics are often used in physical systems.

A stochastic matrix
Stochastic matrix

In mathematics, a stochastic matrix, probability matrix, or transition matrix is used to describe the transitions of a Markov chain....
 is a matrix
Matrix (mathematics)

In mathematics, a matrix is a rectangular array of numbers, as shown at the right. In addition to a number of elementary, entrywise operations such as matrix addition a key notion is matrix multiplication....
 that has non-negative real
Real number

In mathematics, the real numbers may be described informally in several different ways. The real numbers include both rational numbers, such as 42 and −23/129, and irrational numbers, such as pi and the square root of two; or, a real number can be given by an infinite decimal representation, such as 2.4871773339...., where the digits co...
 entries that sum to one in each row.

Artificial intelligence

In artificial intelligence
Artificial intelligence

Artificial intelligence is the intelligence of machines and the branch of computer science which aims to create it. Major AI textbooks define the field as "the study and design of intelligent agents,"...
 stochastic programs work by using probabilistic methods to solve problems, as in simulated annealing
Simulated annealing

Simulated annealing is a generic probabilistic algorithm metaheuristic for the global optimization problem of applied mathematics, namely locating a good approximation to the global optimum of a given function in a large search space....
, stochastic neural network
Stochastic neural network

Stochastic neural networks are a type of artificial neural networks, which is a tool of Artificial intelligence. They are built by introducing random variations into the network, either by giving the network's Artificial neuron Stochastic process transfer functions, or by giving them stochastic weights....
s, stochastic optimization
Stochastic optimization

Stochastic optimization methods are optimization algorithms which incorporate probability elements, either in the problem data , or in the algorithm itself , or in both ....
, and genetic algorithms. A problem itself may be stochastic as well, as in planning under uncertainty. A deterministic environment is much simpler for an agent to deal with.

Teaching

An instructor may apply methodology to teaching which when practiced is the same for all students in the course; however, all students absorb knowledge & information in different ways and thus a strict pattern of teaching can have different effects on the overall outcome of each student.

Natural science

An example of a stochastic process
Stochastic process

A stochastic process, or sometimes random process, is the counterpart to a deterministic process in probability theory. Instead of dealing with only one possible 'reality' of how the process might evolve under time , in a stochastic or random process there is some indeterminacy in its future evolution described by probability distribu...
 in the natural world is pressure
Pressure

Pressure is the force per unit area applied to an object in a direction surface normal to the surface. Gauge pressure is the pressure relative to the local atmospheric or ambient pressure....
 in a gas
Gas

In physics, a gas is a state of matter, consisting of a collection of particles without a definite shape or volume that are in more or less random motion....
 as modeled by the Wiener process
Wiener process

In mathematics, the Wiener process is a continuous-time stochastic process named in honor of Norbert Wiener. It is often called Brownian motion, after Robert Brown ....
. Even though (classically speaking) each molecule is moving in a deterministic path, the motion of a collection of them is computationally and practically unpredictable. A large enough set of molecules will exhibit stochastic characteristics, such as filling the container, exerting equal pressure, diffusing along concentration gradients, etc. These are emergent properties of the system.

Biology


  • Stochastic resonance
    Stochastic resonance

    Stochastic resonance is observed when noise added to a system improves the system's performance in some fashion. More technically, SR occurs if the signal-to-noise ratio of a nonlinear system or device increases for moderate values of noise intensity....
In biological systems, introducing stochastic 'noise' has been found to help improve the signal strength of the internal feedback loops for balance and other vestibular communication. It has been found to help diabetic and stroke patients with balance control.

  • Stochastic theory of hematopoiesis

Quantum physics


The name "Monte Carlo" for the stochastical Monte Carlo method
Monte Carlo method

Monte Carlo methods are a class of computational algorithms that rely on repeated random sampling to compute their results. Monte Carlo methods are often used when computer simulation physics and mathematics systems....
 was popularized by physics researchers Stanislaw Ulam, Enrico Fermi
Enrico Fermi

Enrico Fermi was an Italian physicist most noted for his work on the development of the first nuclear reactor, and for his contributions to the development of Quantum mechanics, nuclear physics and particle physics, and statistical mechanics....
, John von Neumann
John von Neumann

John von Neumann was a Hungarian American mathematician who made major contributions to a vast range of fields, including set theory, functional analysis, quantum mechanics, ergodic theory, continuous geometry, economics and game theory, computer science, numerical analysis, hydrodynamics , and statistics, as well as many other mathematical...
, and Nicholas Metropolis
Nicholas Metropolis

Nicholas Constantine Metropolis was a Greek American mathematician, physicist, and computer scientist....
, among others; the name is a reference to the Monte Carlo Casino
Monte Carlo Casino

The Monte Carlo Casino is one of the most famous tourist attractions of Monaco.The casino complex is a gambling facility which also includes the Grand Th??tre de Monte Carlo, an opera and ballet house, and the headquarters of the Ballets de Monte Carlo....
 in Monaco
Monaco

Monaco , officially the Principality of Monaco , is a small sovereign city-state located in South Western Europe . The territory lies on the northern coast of the Mediterranean Sea....
 where Ulam's uncle would borrow money to gamble. The use of randomness
Randomness

Randomness is a lack of order, purpose, Causality, or predictability. Randomness as defined by Aristotle is the situation, when a choice is to be made which has no logical component by which to determine or make the choice ....
 and the repetitive nature of the process are analogous to the activities conducted at a casino.

Random methods of computation and experimentation (generally considered forms of stochastic simulation
Stochastic simulation

Stochastic simulation algorithms and methods were initially developed to analyse chemical reactions involving large numbers of species with complex reaction kinetics....
) can be arguably traced back to the earliest pioneers of probability theory (see, e.g., Buffon's needle
Buffon's needle

In mathematics, Buffon's needle problem is a question first posed in the 18th century by Georges-Louis Leclerc, Comte de Buffon:Using integral geometry, the problem can be solved to get a Monte Carlo method to approximate pi....
, and the work on small samples by William Gosset), but are more specifically traced to the pre-electronic computing era. The general difference usually described about a Monte Carlo form of simulation is that it systematically "inverts" the typical mode of simulation, treating deterministic problems by first finding a probabilistic analog (see Simulated annealing
Simulated annealing

Simulated annealing is a generic probabilistic algorithm metaheuristic for the global optimization problem of applied mathematics, namely locating a good approximation to the global optimum of a given function in a large search space....
). Previous methods of simulation and statistical sampling generally did the opposite: using simulation to test a previously understood deterministic problem. Though examples of an "inverted" approach do exist historically, they were not considered a general method until the popularity of the Monte Carlo method spread.

Perhaps the most famous early use was by Enrico Fermi in 1930, when he used a random method to calculate the properties of the newly-discovered neutron
Neutron

The neutron is a subatomic particle with no net electric charge and a mass slightly larger than that of a proton.Neutrons are usually found in atomic nucleus....
. Monte Carlo methods were central to the simulation
Simulation

Simulation is the imitation of some real thing, state of affairs, or process. The act of simulating something generally entails representing certain key characteristics or behaviors of a selected physical or abstract system....
s required for the Manhattan Project
Manhattan Project

The Manhattan Project was the project to develop the first atomic weapon during World War II; involving the United States, the United Kingdom, and Canada....
, though were severely limited by the computational tools at the time. Therefore, it was only after electronic computers were first built (from 1945 on) that Monte Carlo methods began to be studied in depth. In the 1950s they were used at Los Alamos
Los Alamos National Laboratory

Los Alamos National Laboratory is a United States Department of Energy United States Department of Energy National Labs, managed and operated by Los Alamos National Security, LLC , located in Los Alamos, New Mexico....
 for early work relating to the development of the hydrogen bomb, and became popularized in the fields of physics
Physics

Physics is the natural science which examines basic concepts such as energy, force, and spacetime and all that derives from these, such as mass, charge, matter and its Motion ....
, physical chemistry
Physical chemistry

Physical chemistry is the application of physics to macroscopic, microscopic, atomic, subatomic, and particulate phenomena in chemical systems within the field of chemistry traditionally using the principles, practices and concepts of thermodynamics, quantum chemistry, statistical mechanics and kinetics....
, and operations research
Operations research

Operations Research in the USA, South Africa and Australia, and Operational Research in Europe and Canada, is an interdisciplinary branch of applied mathematics and formal science that uses methods such as mathematical modeling, statistics, and algorithms to arrive at optimal or near optimal solutions to complex problems....
. The Rand Corporation and the U.S. Air Force were two of the major organizations responsible for funding and disseminating information on Monte Carlo methods during this time, and they began to find a wide application in many different fields.

Uses of Monte Carlo methods require large amounts of random numbers, and it was their use that spurred the development of pseudorandom number generator
Pseudorandom number generator

A pseudorandom number generator is an algorithm for generating a sequence of numbers that approximates the properties of random numbers. The sequence is not truly random in that it is completely determined by a relatively small set of initial values, called the PRNG's state. Although sequences that are closer to truly random can be gen...
s, which were far quicker to use than the tables of random numbers which had been previously used for statistical sampling.

Geomorphology

  • Stochastic theory of meander formation
    Meander

    A meander in general is a bend in a sinuosity watercourse, also known as an oxbow loop, or simply an oxbow. A meander is formed when the moving water in a river erodes the outer banks and widens its valley creating a meander....


Music

In music
Music

Music is an art form whose media is sound organized in time. Common elements of music are pitch , rhythm , dynamics , and the sonic qualities of timbre and texture ....
, stochastic elements are randomly generated elements created by strict mathematical
Mathematics

Mathematics is the study of quantity, structure, space, change, and related topics of pattern and form. Mathematicians seek out patterns whether found in numbers, space, natural science, computers, imaginary abstractions, or elsewhere....
 processes.

Stochastic processes can be used in music to compose a fixed piece or can be produced in performance. Stochastic music was pioneered by Iannis Xenakis
Iannis Xenakis

Iannis Xenakis was a Greeks modernist composer, musical theoretician, and architect. He is regarded as an important and influential composer of the twentieth century....
, who used probability
Probability

Probability, or wikt:chance, is a way of expressing knowledge or belief that an Event will occur or has occurred. In mathematics the concept has been given an exact meaning in probability theory, that is used extensively in such areas of study as mathematics, statistics, finance, gambling, science, and philosophy to draw conclusions about t...
, game theory
Game theory

Game theory is a branch of applied mathematics that is used in the social sciences , biology, engineering, political science, international relations, computer science , and philosophy....
, group theory
Group theory

In mathematics and abstract algebra, group theory studies the algebraic structures known as group .The concept of a group is central to abstract algebra: other well-known algebraic structures, such as ring , field , and vector spaces can all be seen as groups endowed with additional operations and axioms....
, set theory
Set theory

Set theory is the branch of mathematics that studies Set , which are collections of objects. Although any type of object can be collected into a set, set theory is applied most often to objects that are relevant to mathematics....
, and Boolean algebra, and frequently used computer
Computer

A computer is a machine that manipulates Data according to a list of Code .The first devices that resemble modern computers date to the mid-20th century , although the computer concept and various machines similar to computers existed earlier....
s to produce his scores. Earlier, John Cage
John Cage

John Milton Cage Jr. was an American composer. A pioneer of Aleatoric music, electronic music and Extended technique, Cage was one of the leading figures of the post-war avant-garde and, in the opinion of many, the most influential American composer of the 20th century....
 and others had composed aleatoric
Aleatoric music

Aleatoric music is music in which some Aspect of music is left to Randomness, and/or some primary element of a composed work's realization is left to the determination of its performer....
 or indeterminate music, which is created by chance processes but does not have the strict mathematical basis (Cage's Music of Changes
Music of Changes

Music of Changes is a piece for solo piano by John Cage. Composed in 1951 for David Tudor, it was the first instrumental Aleatoric music piece Cage completed....
, for example, uses a system of charts based on the I-Ching).

Color reproduction

When color reproductions are made, the image is separated into its component colors by taking multiple photographs filtered for each color. One resultant film or plate represents each of the cyan, magenta, yellow, and black data. Color printing
Color printing

Color printing is the reproduction of an image or text in color .While there are many techniques for reproducing images in color, specific graphic processes and industrial equipment are used for mass reproduction of color images on paper....
 is a binary system, where ink is either present or not present, so all color separations to be printed must be translated into dots at some stage of the workflow. Traditional linescreens which are amplitude modulated
Amplitude modulation

Amplitude modulation is a technique used in electronic communication, most commonly for transmitting information via a radio carrier wave....
 had problems with moiré but were used until stochastic screening became available. A stochastic (or frequency modulated
Frequency modulation

In telecommunications, frequency modulation conveys information over a carrier wave by varying its frequency . In analog signal applications, the instantaneous frequency of the carrier is directly proportional to the instantaneous value of the input signal....
) dot pattern creates a more photorealistic image.

Language and linguistics

Non-deterministic approaches in language studies are largely inspired by the work of Ferdinand de Saussure
Ferdinand de Saussure

Ferdinand de Saussure was a Switzerland linguistics whose ideas laid a foundation for many significant developments in linguistics in the 20th century....
. In usage-based linguistic theories, for example, where it is argued that competence
Competence

Competence is the ability to perform a specific task, action or function successfully. Incompetence is its opposite.*Competence , the ability of a cell to take up DNA...
, or langue, is based on performance
Performance

A performance, in performing arts, generally comprises an event in which one group of people behave in a particular way for another group of people ....
, or parole, in the sense that linguistic knowledge is based on frequency of experience, grammar is often said to be probabilistic
Probability

Probability, or wikt:chance, is a way of expressing knowledge or belief that an Event will occur or has occurred. In mathematics the concept has been given an exact meaning in probability theory, that is used extensively in such areas of study as mathematics, statistics, finance, gambling, science, and philosophy to draw conclusions about t...
 and variable rather than fixed and absolute. This is so, because one's competence
Competence

Competence is the ability to perform a specific task, action or function successfully. Incompetence is its opposite.*Competence , the ability of a cell to take up DNA...
 changes in accordance with one's experience with linguistic units. This way, the frequency of usage-events determines one's knowledge of the language in question. For much later work in this area, see Julia Kristeva
Julia Kristeva

Julia Kristeva is a Bulgarians-France philosopher, literary critic, psychoanalysis, French feminist, and, most recently, novelist, who has lived in France since the mid-1960s....
 on her usage of the 'semiotic,' Luce Irigaray
Luce Irigaray

Luce Irigaray is a Belgian people Feminism, philosopher, linguist, psychoanalytic theory and culture theory. She is best known for her works Speculum of the Other Woman and This Sex Which Is Not One ....
 on reverse Heideggerian epistomology, and Pierre Bourdieu
Pierre Bourdieu

Pierre Bourdieu was an acclaimed France Sociology and writer known for his outspoken political views and public engagement. One of the principal players in French intellectual life, Bourdieu became the "intellectual reference" for movements opposed to neo-liberalism and globalisation that developed in France and elsewhere during the 1990s....
 on polythetic space for examples of stochastic social science theory.

Business


Manufacturing


Manufacturing processes are assumed to be stochastic processes. This assumption is largely valid for either continuous or batch manufacturing processes. Testing and monitoring of the process is recorded using a process control chart
Control chart

The control chart, also known as the Shewhart chart or process-behaviour chart, in statistical process control is a tool used to determine whether a manufacturing or business Process is in a state of statistical control or not....
 which plots a given process control parameter over time. Typically a dozen or many more parameters will be tracked simultaneously. Statistical models are used to define limit lines which define when corrective actions must be taken to bring the process back to its intended operational window.

Finance

The financial markets use stochastic models to represent the seemingly random behaviour of assets such as stocks
Stocks

Stocks are devices used since medieval times for public humiliation, corporal punishment, and torture. The stocks are similar to the pillory and the pranger, as each consists of large, hinged, wooden boards; the difference, however, is that when a person is placed in the stocks, their feet are locked in place, and sometimes as well their hand...
, commodities and interest rates. These models are then used by quantitative analysts
Quantitative analyst

A quantitative analyst is a person who works in finance using numerical or quantitative techniques. Similar work is done in most other modern industries, but the work is not called quantitative analysis....
 to value options on stock prices, bond prices, and on interest rates, see Markov models
Markov chain

In mathematics, a Markov chain, named after Andrey Markov, is a stochastic process with the Markov property. Having the Markov property means that, given the present state, future states are independent of the past states. In other words, the description of the present state fully captures all the information that could influence th...
. Moreover, it is at the heart of the insurance industry
Insurance

Insurance, in law and economics, is a form of risk management primarily used to Hedge against the risk of a contingent loss. Insurance is defined as the equitable transfer of the risk of a loss, from one entity to another, in exchange for a premium, and can be thought of as a guaranteed small loss to prevent a large, possibly devastating los...
. One modern example of financial stochastic theory would the Black Swan theory
Black swan theory

The Black Swan theory refers to a large-impact, hard-to-predict, and rare event beyond the realm of normal expectations. Unlike the philosophical "Falsifiability#Inductive_categorical_inference", the "Black Swan" theory refers only to events of large consequence and their dominant role in history....
 by stochastic Professor Nassim Nicholas Taleb. Taleb being a philosopher of Randomness gives intuitive explanations for stochastical finance in his book Fooled by Randomness
Fooled by Randomness

Fooled by Randomness: The Hidden Role of Chance in Life and in the Markets is a book written by Nassim Taleb, a philosopher of randomness about the fallibility of human knowledge....
.

Not to be confused with stochastic oscillator
Stochastic oscillator

The stochastic oscillator is a momentum Trading Indicator used in technical analysis, introduced by George Lane in the 1950s, to compare the closing price of a commodity to its price range over a given time span....
s in Technical analysis
Technical analysis

Technical analysis is a security analysis technique that claims the ability to forecast the future direction of prices through the study of past market data, primarily price and volume....
.

Further reading

  • Formalized Music: Thought and Mathematics in Composition by Iannis Xenakis
    Iannis Xenakis

    Iannis Xenakis was a Greeks modernist composer, musical theoretician, and architect. He is regarded as an important and influential composer of the twentieth century....
    , ISBN 1-57647-079-2
  • Frequency and the Emergence of Linguistic Structure by Joan Bybee and Paul Hopper (eds.), ISBN 1-58811-028-1/ISBN 90-272-2948-1 (Eur.)