Event Stream Processing
Encyclopedia
Event stream processing, or ESP, is a set of technologies designed to assist the construction of event-driven information systems. ESP technologies include event visualization, event databases, event-driven middleware, and event processing languages, or complex event processing
(CEP). In practice, the terms ESP and CEP are often used interchangeably, with CEP becoming a more fashionable term recently. ESP deals with the task of processing multiple streams of event data with the goal of identifying the meaningful events within those streams, employing techniques such as detection of complex patterns of many events, event correlation and abstraction, event hierarchies, and relationships between events such as causality, membership, and timing, and event-driven processes.
ESP enables applications such as algorithmic trading
in financial services, RFID event processing applications, fraud detection, process monitoring, and location-based service
s in telecommunications.
WHEN Person.Gender EQUALS "man" AND Person.Clothes EQUALS "tuxedo"
FOLLOWED-BY
Person.Clothes EQUALS "gown" AND
(Church_Bell OR Rice_Flying)
WITHIN 2 hours
ACTION Wedding
Complex Event Processing
Complex event processing consists of processing many events happening across all the layers of an organization, identifying the most meaningful events within the event cloud, analyzing their impact, and taking subsequent action in real time....
(CEP). In practice, the terms ESP and CEP are often used interchangeably, with CEP becoming a more fashionable term recently. ESP deals with the task of processing multiple streams of event data with the goal of identifying the meaningful events within those streams, employing techniques such as detection of complex patterns of many events, event correlation and abstraction, event hierarchies, and relationships between events such as causality, membership, and timing, and event-driven processes.
ESP enables applications such as algorithmic trading
Algorithmic trading
In electronic financial markets, algorithmic trading or automated trading, also known as algo trading, black-box trading or robo trading, is the use of electronic platforms for entering trading orders with an algorithm deciding on aspects of the order such as the timing, price, or quantity of the...
in financial services, RFID event processing applications, fraud detection, process monitoring, and location-based service
Location-based service
A Location-Based Service is an information or entertainment service, accessible with mobile devices through the mobile network and utilizing the ability to make use of the geographical position of the mobile device....
s in telecommunications.
Example
This example of an EPL (Event Processing Language) modelled on SQL illustrates how such a language may be used to perform complex event processing. This code fragment detects weddings among a flow of external "events" such as church bells ringing, the appearance of a man in a tuxedo or morning suit, a girl in a flowing white gown and rice flying through the air. A "complex" or "composite" event is what one infers from the individual simple events: a wedding is happening.WHEN Person.Gender EQUALS "man" AND Person.Clothes EQUALS "tuxedo"
FOLLOWED-BY
Person.Clothes EQUALS "gown" AND
(Church_Bell OR Rice_Flying)
WITHIN 2 hours
ACTION Wedding
See also
- Complex event processingComplex Event ProcessingComplex event processing consists of processing many events happening across all the layers of an organization, identifying the most meaningful events within the event cloud, analyzing their impact, and taking subsequent action in real time....
(CEP) - A related technology for building and managing event-driven information systems. - Data Stream Management SystemData Stream Management SystemA Data-stream management system is a computer program that controls the maintenance and querying of data in data streams.A key feature of these DSMSs is the ability to execute a continuous query against a data stream. The use of a DSMS to manage a data stream is roughly analogous to the use of a...
(DSMS) - A type of software system for managing and querying data streams - openPDCOpenPDCThe openPDC is a complete set of applications for processing streaming time-series data in real-time. The name stands for "open source phasor data concentrator" and was originally designed for the concentration and management of real-time streaming synchrophasors...
A complete set of applications for processing streaming time-series data in real-time. - Real-time computingReal-time computingIn computer science, real-time computing , or reactive computing, is the study of hardware and software systems that are subject to a "real-time constraint"— e.g. operational deadlines from event to system response. Real-time programs must guarantee response within strict time constraints...
- ESP systems are typically real-time systems - RFID - Radio-frequency identification, or RFID, recommends application of ESP to prevent from data flooding
- SCADASCADASCADA generally refers to industrial control systems : computer systems that monitor and control industrial, infrastructure, or facility-based processes, as described below:...
- Supervisory control and data acquisition, a similar technology used in engineering applications - Emergency processing and management
External links
- Processing Flows of Information: From Data Stream to Complex Event Processing - Survey article on Data Stream and Complex Event Processing Systems