SENACOR TECHNOLOGIES AG VORDERE CRAMERGASSE 11 D-90478 NÜRNBERG

SENACOR TECHNOLOGIES AG SEITE 1

SENACOR TECHNOLOGIES AG

VORDERE CRAMERGASSE 11

D-90478 NÜRNBERG

[email protected]

WWW.SENACOR.COM

Florian Springer

Business IT Consultant

Dr. Rainer v. AmmonManaging Director

CENTRUM FÜR INFORMATIONS-TECHNOLOGIE-TRANSFER (CITT) GmbHKONRAD-ADENAUERALLE 30D-93051 REGENSBURG

+49 171 756 [email protected]

SENACOR TECHNOLOGIES AG

Event-Driven Busines Process Management taking the example of DHLR. v. Ammon, C. Emmersberger, F. Springer, C. Wolff

Vienna 08/09/28


The forecast of ED-BPM for the next decades

EDBPM – a combination of two disciplines: Business Process Management (BPM) and Complex Event Processing (CEP)

A reference model for ED-BPM – how its components work together

The business modeller and the event modeller – different qualifications not in personal union

DHL Use Case - First experiences from the DHL-Project

Agenda


Forecast of Prof. David Luckham:

we need skilled people at least up to 2050…

we are only at the end of the period of Simple CEP

Forcast of ED-BPM for the next decades


The forecast of ED-BPM for the next decades

The warning of Roy Schulte (VP of Gartner) since 2006…

…we won‘t have enough skilled people who would be able to do all the jobs and projects

The statement of Prof. Mani Chandy (California Techical University) at the Gartner Event Processing Summit 2007…

…The work of IT during the next twenty years will be to complete the evolution of business processes from sequences of slow-moving, disjointed applications to more responsive end-to-end, event-based straight-through flows of action.


monitoring of time-critical bottleneck factors

and transaction control

transparency over integrated represented

processes

representation of the effects of system availabilities and

-disturbances

process and system-linked emergency and

disturbance management

monitoring of SLA-compliance

WorkflowManagement

BusinessProcess

Monitoring

Managing and monitoring of processes means ...

http://www.scientific.de/produkte/opnet/itguru.html











passwdchange

account login

account login

depositactivity history

withdrawal

logout

account balance

transferdeposit new auto pay

enquiry

enquirylogout

passwdchange

new auto payaccount login

account login

depositactivity history

withdrawal

logout

account login

transferdeposit new auto pay

enquiry

enquiry

logout

event cloud with thousands of events per sec…

…e.g. above a bank

event patterns and complex event processing…

The important steps: 1. Redesign the business processes for SOA and BPM 2. Make a SOA, identify services, build WSDL-interfaces…3. Precise description of patterns of events4. Detecting patterns in the event cloud5. Abstraction of complex event pattern instances to higher level events

Senso

r

Senso

r

Big Picture: Monitoring Business Proceses and Activities


…

…

Business Process 1

genCBE (start,service1)

genCBE (exit,service1)





…

exitService_1startedService_1

startedService_3exitService_3

startedService_2

exitService_2


startedService_6

exitService_6

startedService_5

exitService_5

startedService_7

exitService_7


Low level events without semantics

Visualization of the processed/correlated events via Business Activity Monitoring

The Pain Point: The Event Cloud, todays IT-Blindness and the „Event Tornado“

Business Process n


The Challenge and the Principle of BPM/BAM/CEP

AppServer

Monitor / Analyze / Act

WorkflowModeler

EventModeler

Enterprise cockpit

EventStore

• realize scenarioprocess instances

• set parameters

analysehistory…

Low Level Event Clouds / Streams

Adapterse.g. RFID, topics of Pub/Sub, …

Normalized events,build business level events

Workflow Enginebased on BPEL

Rules Engine

„special“ SQLresp. other languages

IF …AND …FOLLOWED BY…WITHIN…ACTION

Scenario

e.g. credit offers (completed)e.g. payments

calculate pott, offer rates, profit…

workflows

Domain specific reference models for event patterns


A proposal for a curriculum of a new Master course of study “Event-Driven Business Process Management”

Draft V0.1

Mastercourse-EDBPM-v01.doc(www.citt-online.com)


Description: Curriculum together with required credits and examinations

Certificate: Master of Science

Programme Duration: Four Semesters (120 credits/cr)



Concept:

The course consists of the fields of study Business Process Management, Complex Event Processing, Business Activity Montoring included Business Intelligence and Data Warehousing, Computer Networks, Messaging as well as several application disciplines like Algorithmic Trading, Supply Chain Management in the retail domain, fraud detection in the banking and insurance domain etc.

All courses are completed with course-related tests and Credits (cr) according to European Credit Transfer System (ECTS) are awarded. All courses are given in English and are designed as distance learning/eLearning courses.


Current research work and projects in ED-BPM

Previous Tasks

Several Proof of Concept (PoC) Implementations

PoC in the logistics domain in cooperation with Deutsche Post AG and Oracle

Event Driven Business Process Management taking the Example of Deutsche Post AG, An evaluation of the Approach of Oracle and the SOPERA Open Source SOA Framework(C. Emmersberger, F. Springer; September 07 – March 08)

PoC in the finance domain in cooperation with TeambankMonitoring Application for monitoring the credit application easyCredit of Team Bank and the evaluation of several CEP approaches(H.-M. Brands, D. Guschakowski; 2007)


DHL Use Case – A Logistics Use Case for EDBPM

Event-Driven Business Process Management (EDBPM) is a combination of two different disciplines:

– Business Process Management (BPM): Deals with the management of business processes with the approach to increase the efficiency, flexibility and technology integration of the business.Business Processes describe the unique way of doing business. Today they are seen as the most valuable asset of a corporation.

– Complex Event Processing (CEP): Event processing concept that deals with handling multiple events within an event cloud to identify meaningful event patterns.It is an emerging technology for obtaining relevant situation knowledge from distributed systems in realtime (= event time + processing time)

EDBPM Background and Definition



Deutsche Post AG is the world largest logistic company

Investigates the feasibility of combining Oracles tools for BPEL, CEP and BAM with the latest Sopera Enterprise Service Bus (ESB)

Use case serves a PoC implementation for a solution combing the goals of service-oriented architecture (SOA) with the advantages of CEP

Use case contains a typical business process at Deutsche Post addressing “shipping”, “monitoring/investigation” and “claim”

Sopera services are orchestrated through Oracle’s BPEL engine and implement the process functionalities. They are capable to send events.

Oracle’s CEP Engine queries the events and sends results to the BAM application for displaying and alerting purpose

Logistics Use Case for EDBPM

allocate package to

transportation

XOR

Transport by truck

Transport by ...

Transport by plane

Move and check in

Move and check in

...

XOR

Start Shipment

...

Traffic events

RFID events

Weather events

...

C. Emmersberger, F. Springer: Event Driven Business Process Management taking the Example of Deutsche Post AG, An evaluation of the Approach of Oracle and the SOPERA Open Source SOA Framework

Example: extract of shipment process

http://www.citt-online.de/downloads/EmmSpr_Diplomarbeit_Final.pdf

http://www.citt-online.de/downloads/EmmSpr_Diplomarbeit_Final.pdf



Logistics Use Case for EDBPM

Shipment

Investigation

Claim



Development:

Service development in SOPERA

Service orchestration in Oracle BPEL

Setup events, which should be sent from the Notification Receiver (event service). Settings are defined within SOPERA policies (XML)

Development of CEP patterns in Oracle CEP with CQL

Design of reports for the BAM dashboard in Oracle BAM

External events (e.g. traffic)

Runtime:

Execution of a business process in the BPEL Engine

Notification Receiver deals as event service. Creates and sends business and technical events to a specified endpoint (BAM, CEP), depending on the settings.

Complex Event Processing in Oracle CEP

Process reporting in Oracle BAM

Simplified Illustration of Components and Interaction



Hurdle: Oracle BPEL Engine and SOPERA are running isolated from each other The SOPERA Web service has no information about the process which has executed the service CEP has no chance to connect events coming directly from BPEL with SOPERA Service events

Task: Connect the independent events

Solution: Enhancing the message payload with BPEL process information. BPELContent includes the filed “ProcessID” as an unique identifier for an executed process BPELContent is sent every time when a service is called during process execution. This mechanism closes

the gap between Oracle and SOPERA

Merging Event Information of Oracle and SOPERA

BPELContent

BPEL event

Service event



Intrusive generated events:

Service has to implement code for event generation

Disadvantage:

– Existing code has to be changed (e.g. a bank would not allow to change existing code)

– Business functionality and monitoring have to work independent. Service should provide only business functionality.

Advantage:

– Information which is not part of the payload can be used

Non-intrusive generated events:

Information is extracted out of the payload and the service with adapters and sensors. The extracted information has to be merged to an event.

Disadvantage:

Only payload and public service information can be part of an event

Advantage:

Service Code has not to be changed

Service has not to deal with monitoring functionality

SOPERA SOPERA

Differences in Event Generation



Aggregation and correlation to business level complex events

Complex Event

Traffic jam

Service executed

External EventProcess Event

Process started

Technical event Weather

Highway No.1, Monterey

Highway 101, Redwood City

Co

mp

lexi

ty

high

low

Business event

Package X delivered

Customer claim

Several event types influence the business process:

Process events: happening during process execution and Business events: providing business content, e. g. parcel allocated to truck Technical events: providing technical content, e. g. service not available

External events: events occur outside the business process, but also influencing the process, e. g. weather, traffic


CONCLUSION

The Paper Provides:

– First link between BPM and CEP

– Main concepts of both technologies in a general reference model for EDBPM

Summary:

– EDBPM is able to detect possible errors within a business process using CEP technology and alert responsible persons using BAM

– Added business value compared to pure BPM solutions

Perspective:

– Automatic reaction on errors has to be implemented in future solutions, e.g. conditional decision and reaction logic

– Additional use cases can be defined for various domains and first projects on the basis of such “Event Driven BPM” platforms start in 2008

– Research projects for a faster set-up of EDBPM are currently under preparation

Detailed Information:

– Further information about the PoC can be seen on www.citt-online.com in a video presentation hold on the 6th CEP/BAM expert meeting in Regensburg


Current research work and projects in ED-BPM

Tasks for the future

Analyzing different domains and provide CEP patterns and

best practices for each domain

Current PhD thesis:

Domain Specific Reference Models for Complex Event Processing Patterns in the domain of Finance/Banking (F. Springer)

Domain Specific Reference Models for Complex Event Processing Patterns in the Automotive Domain (C. Emmersberger)

Domain Specific Reference Models for Complex Event Processing Patterns in the Retail Domain (T. Paulus)


Backup

Backup


Architectural Project Overview

Complete Component Overview plus Event Could



SOPERA provides a standards-based framework for SOA solutions

A central Service Registry manages all services

Services can be deployed in Tomcat, JEE Application Servers

Service interfaces and bindings are described by plain WSDL documents instead of using the proprietary SOPERA descriptions

SOPERA Service



Oracle AS 10g contains the BPEL engine

Services are orchestrated through a BPEL process which is deployed on the BPEL Engine

SOPERA services are invoked by using partner links

Oracle BPEL



It is the binding component between SOPERA services and Oracle JMS Provider

Runs as a service within a Tomcat server Registered in the SOPERA service registry Passes events, generated by the service back

bone as well as the services to JMS provider

SOPERA Notification Receiver



Oracle BAM 10g runs within a Microsoft IIS environment

It pulls events from the JMS Provider through Enterprise Message Sources (EMS) and stores them into Data Sinks (DS)

Plans contain the description how the events are processed between an EMS and a DS

On top of the DS, BAM offers the ability to create real time dashboards

Oracle Business Activity Monitoring



Oracle Business Activity Monitoring



Oracle CEP offers the ability to fetch events from different event sources

Incoming events are queried in a SQL like language called CQL (Continous Query Language)

Based on the query result new events can be generated

The generated events are pushed on to output streams to be able to react on these events

Oracle Complex Event Processing


Financial Use Case for EDBPM

Financial Use Case for EDBPM

– Intended as a test of functionality demonstrating the applicability and usability of EDBPM for real-time monitoring of online business processes

– Application domain is monitoring the credit application easyCredit of Team Bank(German online credit system featuring instant credit application confirmation for customers)

– Focus on real-time monitoring of potential credit process cancellations

– Front-end components based on metrics and key performance indicators (KPIs) visualized in BAM dashboards

– For prototypical implementation, different CEP, BAM and Event Processing Languages (EPLs) have been analyzed, among them: Coral8, Systar, StreamBase, Tibco

H.-M. Brands, D. Guschakowski: Complex Event Processing in the context of Business Activity Monitoring, An evaluation of different approaches and tools taking the example of the Next Generation easyCredit

http://www.citt-online.com/downloads/Diplomarbeit_BaGu_Final.pdf

http://www.citt-online.com/downloads/Diplomarbeit_BaGu_Final.pdf


Open Source-Approach

AppServer BPM CEP Dashboard Comments

jBoss jBPM Esper Macromedia?

Packaged Approaches


WebSphere ProcessServer

AMiT BusinessMonitor

Oracle Fusion Oracle Fusion Oracle Fusion Oracle Fusion

Tibco ESB Tibco BPM BE BE

BEA Weblogic ALBPM Coral8 ALBPM

______ _____ ______ Packaged or Best-of-Breed Approaches: Is predictive Business a Multi Vendors-Approach?


Best-of-Breed-Approaches


jBoss jBPM AMiT BusinessMonitor

Weblogic ALBPM/WLI AptSoft AptSoft

Business Bridge

BusinessBridge

Coral8 IDS PPM or BAM

StreamBase StreamBase

Apama Apama

TEST

Packaged or Best-of-Breed Approaches: Is predictive Business a Multi Vendors-Approach?


EPL-Approaches Example

Pseudo-SQL INSERT INTO RawAlertsSELECT XMLElement("Events", XMLAgg(XMLElement("event", XMLAttributes(TO_STRING(BigQuotes.quote) AS "Quote", TO_STRING(BigQuotes.volume) AS "Volume", TO_STRING(BigQuotes.Ts, 'YYYY-MM-DD HH:MI') AS "EventTimeStamp"))) ) AS Events, InQuote.Quote AS Quote, SUM(BigQuotes.Quote) AS SumOfQuotesFROM InQuote AS BigQuotes KEEP 1 HOUR KEEP 3 ROWS , InQuoteHAVING InQuote.Volume > 300000 AND COUNT(*) >= 3OUTPUT EVERY 1 HOUR;

Special Rules Languages 1. u.<sell,x,y,q,h>.v.<buy,x,y',q',p> => u.v :-> <settlement,x,y',y,min(q,q'),h,p> if p>=h and nmatches(v , u'.<sell,x,_,_,h'>.v' if p>=h') = 02. u.<buy,x,y,q,p> => u if nmatches(u,<sell,x,_,_,h> if p<h) /*get rid of of bids that cannot be settled*/3. u.<sell,x,y,_,_>.v.<sell,x,y,q,p> => u.v.<sell,x,y,q,p> /*override sell requests by the same customer on the same item*/

Java- or other 3GL generated Code

Proprietary 4GL-based approaches

GUI-based approaches (graphical editors) and code generation



EPL-Approaches CEP-platform Usability

Pseudo-SQL - Coral8 (CCL)- StreamBase (StreamSQL)- Esper (EQL)- Aleri- ?Oracle?

Special Rules Languages - AMiT- ?Apama?- Tibco- ?Oracle?

Java- or other 3GL generated Code - Tibco- Apama- ?Esper?- Aleri Studio- ?Oracle?

Proprietary 4GL-based approaches - ?Aleri XML?- ?


- ?AMIT?- ?Apama?- AptSoft- StreamBase



EPL-Approaches CEP-platform Usability / User Type

Pseudo-SQL - Coral8 (CCL)- StreamBase (StreamSQL)- Esper (EQL)- Aleri- ?Oracle?

- skilled EPL-programmers- not the community of SQL-programmers?!

Special Rules Languages - AMiT- ?Apama?- Tibco- ?Oracle?

- skilled proprietary EPL-programmers- will never be a community

Java- or other 3GL generated Code - Tibco- Apama- Esper?- Aleri Studio- ?Oracle?

- community of Java-programmers

Proprietary 4GL-based approaches - ?Aleri XML?- ?

- skilled proprietary 4GL-programmers- will never be a community


- ?AMIT?- ?Apama?- AptSoft- StreamBase

- C-level managers?- marketing employees?- appropriate for all requirements of

applications?- only GUI or additionally to a EPL?



Complex Event Processing in the retail domain

Scenario: Complex, heterogenous and distributed IT Landscape Multiple vendor-independent hard- and softwaresystems Multiplicator effect generates high ammount of bussines data Crossing with other domains ( Logistics, Finance, etc.)

Benefits: Shorter response time in case of failures and deviation;

based on event driven realtime-analysis of business-data and historical data

Proactive and predictive acting; based on combination of reference, historical and realtime data for detecting failures and deviation in realtime

Usecases: Realtime – Marketing Stock- and Order-Management Supply-Chain-Management Customer – Binding Hard- and Software-Monitoring


Analyzing historical data and

process dataCEP Lifecycle

React on errors within

business processes

Create CEP patterns detecting potential

errors

Company Strategy

Results of

Analysis

congnition of daily

operation

Documents

SENACOR TECHNOLOGIES AG VORDERE CRAMERGASSE 11 D-90478 NÜRNBERG