Flexible EAI-Lösungen mit Glass sh@WebServlet(urlPatterns = {"/order/import"}) public class ImporterServlet extends HttpServlet {@Inject OrderBean bean; @Inject CsvDataParser parser;

We take care of it - personally!

© 2013 innoQ Deutschland GmbH

Flexible EAI-Lösungen mit GlassfishPraxisbeispiele und War Stories zu EAI-Pattern

Alexander Heusingfeld, @goldstiftMartin Huber, @waterback

Tuesday 8 October 13

http://aheusingfeld.github.io/

http://aheusingfeld.github.io/




EAI Pattern in 2013?



EAI Pattern in 2013?

Nobody does that anymore!



That’s THE problem!



Multitude of potential service consumers

Integration is ubiquitous

CRMApplication





CRMApplication

ERPApplication





CRMApplication?





CRMApplication



Patterns? Wasn’t there a book?



Patterns? Wasn’t there a book? Design Patterns (Gamma et al), 1994




Proven solutions for common problems





Enterprise Integration Patterns (Hohpe & Woolf), 2003






Swiss-army knife for asynchronous messaging






Swiss-army knife for asynchronous messaging

www.eaipatterns.com


http://www.eaipatterns.com

http://www.eaipatterns.com


“We all believe that asynchronous messaging carries the greatest promise.”

- Martin Fowler (Foreword of Enterprise Integration Patterns, 2003)



MESSAGING?

http://bit.ly/PtrhWy





Benefits of async. Messaging




decoupled




decoupled

integrated platforms/ languages




decoupled


reliable communication




decoupled



disconnected




decoupled



disconnected

throttled




But why those Patterns?



Thoughts on EAI patterns




not invented, but observed





don’t solve everything






provide ideas






provide ideas

good ones evolve






provide ideas

good ones evolve

changes are incorporated at eaipatterns.com


http://www.eaipatterns.com/

http://www.eaipatterns.com/


Simple order management system (CRUD)

Real Life Scenario

ordermanagement

system




Real Life Scenario

ordermanagement

system

• basic Java EE




Real Life Scenario

ordermanagement

system

• basic Java EE• Just CRUD operations




Real Life Scenario

ordermanagement

system

• basic Java EE• Just CRUD operations• “information silo”




Real Life Scenario

ordermanagement

system

• basic Java EE• Just CRUD operations• “information silo”



Simple Change

ordermanagement

system



Enhance the system with an importer!

Simple Change

ordermanagement

system




Simple Change

• Receive CSV-data via HTTP POST

ordermanagement

system




Simple Change

• Receive CSV-data via HTTP POST• CSV contains header and detail records

ordermanagement

system




Simple Change

• Receive CSV-data via HTTP POST• CSV contains header and detail records• Import data into database

ordermanagement

system



A Simple Java EE sample@WebServlet(urlPatterns = {"/order/import"})public class ImporterServlet extends HttpServlet { @Inject OrderBean bean; @Inject CsvDataParser parser;

@Override protected void doPost(HttpServletRequest request, HttpServletResponse response) throws ServletException, IOException { String data = request.getParameter("csvdata"); List<Order> orders = parser.transform(data); for (Order order : orders) { bean.persist(order); } }}



Enhanced the system with an importer!

System

Simple Change done

ordermanagement

systemHTTP

csv

Tran

sfor

m

Business Partner



Integrate the system of a forwarder

System

Change happens

ordermanagement

systemHTTP

csvTr

ansf

orm

Business Partner

forwardersystem

FTP

SMTP

SOAP WSSEREST



Recognize an integration task

when it‘s staring in your face?



EASY!

http

://w

ww

.flic

kr.c

om/p

hoto

s/w

espi

onag

e/18

4793

114


http://www.flickr.com/photos/wespionage/184793114

http://www.flickr.com/photos/wespionage/184793114


Build an easy and maintainable solution

for multiple integration challenges?



NO PROBLEM!

http

://w

ww

.flic

kr.c

om/p

hoto

s/m

roac

h/39

2290

3520

/


http://www.flickr.com/photos/mroach/3922903520/



Something wrong here?@WebServlet(urlPatterns = {"/order/import"})public class ImporterServlet extends HttpServlet { @Inject OrderBean bean; @Inject CsvDataParser parser;






testable?





testable?reusable?





testable?reusable?

extensible?



How could we do better?



Pipes and Filtershttp://www.enterpriseintegrationpatterns.com/PipesAndFilters.html


http://www.eaipatterns.com/Messaging.html



Pipes and Filtersdivide your task into small steps

http://www.enterpriseintegrationpatterns.com/PipesAndFilters.html





RoutePipe

Apply pipes & filters pattern

Pipeoutboundtransforminbound



RoutePipe



Servlet



RoutePipe



Servlet Custom



RoutePipe



Servlet Custom JPA



When you got the right tools to do the job?



INFALLIBLE!

http

://w

ww

.flic

kr.c

om/p

hoto

s/oh

skyl

ab/4

5476

9350

2





Is there something simpler?



ADAPTERS?

http

://w

ww

.flic

kr.c

om/p

hoto

s/m

roac

h/39

2290

3520

/Pr

oper

ty o

f Chi

nBuy

e Li

mite

d. h

ttp://

bit.l

y/xB

KwGw




http://bit.ly/xBKwGw

http://bit.ly/xBKwGw


EAI Frameworks

Apache Camel Spring Integration



A simple camel route

from("jetty:http://localhost:9080/order/import") .routeId(“orderimport”) .process(new PostParameterProcessor(“csvdata”)) .process(new StringRemover(new String[]{"\""})) .unmarshal().csv() .split(body(List.class)) .aggregate(header("orderId"), new MySpecialAggregationStrategy()).completionTimeout(3000) .to("seda:singlepartsroute");


http://localhost:9080/order/import

http://localhost:9080/order/import


Spring Integration sample<int-http:inbound-channel-adapter ! id="orderImportHttpAdapter"! path="/order/import” supported-methods="POST"! channel="ordersIn"/>

<int:channel="ordersIn"/>

<int:splitter input-channel="ordersIn" ref="orderSplitter" method="split" output-channel="ordersToDB" /><bean id="orderSplitter" class="com.innoq.samples.eai.OrderSplitter"/>

<int:channel="ordersToDB"/>

<int-jpa:updating-outbound-gateway request-channel="ordersToDB" entity-class="com.innoq.samples.eai.domain.Order" entity-manager="em"/>



Configuration in XML?



Configuration in XML?



OracleDB + AQ

Admin UI

Real-life scenario: Control Bus

xml-route-config

EAI-Node

EAI-Node

EAI-Nodectrl-queue

TomcatEmbedded Jetty



OracleDB + AQ


xml-route-config

EAI-Node

database connection

EAI-Node

EAI-Nodectrl-queue

Initial Node configuration

node type (command line arg)

Admin UI



OracleDB + AQ


xml-route-config

EAI-Node

subscribe to control queue

EAI-Node

EAI-Nodectrl-queue

1. Server startup

Admin UI



OracleDB + AQ


xml-route-config

EAI-Node

load node-type specific config

EAI-Node

EAI-Nodectrl-queue

subscribe to control queue

1. Server startup

Admin UI



OracleDB + AQ

Config change @Runtime

xml-route-config

EAI-Node

EAI-Node

EAI-Nodectrl-queue

2. during runtimeroute config is changed

Admin UI



OracleDB + AQ


xml-route-config

EAI-Node

EAI-Node

EAI-Nodectrl-queue

2. during runtimeroute config is changed

publish config update message

Admin UI



OracleDB + AQ


xml-route-config

EAI-Node

interpret relevance of control message

EAI-Node

EAI-Nodectrl-queue

3. upon control message arrival

Admin UI



OracleDB + AQ


xml-route-config

EAI-Node

affected nodes reload configuration

EAI-Node

EAI-Nodectrl-queue

interpret relevance of control message

3. upon control message arrival

Admin UI



OracleDB + AQ

Admin UI

What would we change today?

xml-route-config

EAI-Node

EAI-Node

EAI-Nodectrl-queue

GlassFish 4.0



More EAI-Patterns in the wild



Message Routerhttp://www.enterpriseintegrationpatterns.com/MessageRouter.html





Message Routerforward by condition

http://www.enterpriseintegrationpatterns.com/MessageRouter.html





Message Routerhttp://www.enterpriseintegrationpatterns.com/MessageRouter.html





Message Router

from(“ibmmq:QUEUE.IN“).noAutoStartup() .transacted() .policy(required) .routeId(BasicRouteBuilder.stdfromRouteId(this.componentBaseName)) .process(vslHeadersProcessor) .setHeader(HDR_DUMMYCOMPLCHK_IBR, constant(PASSEDMSG)) .bean(inboundTargetDispatcherBean) .wireTap("seda:inboundRouter.log");

Apache Camel running in WAS6.1



Message Router

from(“ibmmq:QUEUE.IN“).noAutoStartup() .transacted() .policy(required) .routeId(BasicRouteBuilder.stdfromRouteId(this.componentBaseName)) .process(vslHeadersProcessor) .setHeader(HDR_DUMMYCOMPLCHK_IBR, constant(PASSEDMSG)) .bean(inboundTargetDispatcherBean) .wireTap("seda:inboundRouter.log");

Apache Camel running in WAS6.1



Message Routerhttp://www.eaipatterns.com

/MessageRouter.html

public class InboundTargetMsgDispatcherBean implements Constants {

/** * Map for all eligible Target Endpoints of the InboundRouter. */ private final Map<String, String[]> allTargets = new HashMap<String, String[]>(NROFROUTES);

...

@RecipientList public String[] route(@Header(HDR_JMSX_GROUPID) String group) { String[] t = allTargets.get(group); return t; }

/** * creates valid endpoint-uris from targetJMSUri and numbering. */ private void createAllTargets() { if (allTargets.keySet().size() == 0) { for (int i = 0; i < NROFROUTES; i++) { String target = createTargetJMSUri(i); allTargets.put(String.valueOf(i), new String[] { target }); } } }


http://www.eaipatterns.com/MessageRouter.html

http://www.eaipatterns.com/MessageRouter.html


Transformerwww.enterpriseintegrationpatterns.com/MessageTransformationIntro.html





Transformation mit BPMN-System (1)



Transformation für BPMN-System (2)

from(“http://localhost:8080/authservice/proxy/transformed?bridgeEndpoint=true“) .routeId("bankapp.transformation.dispatch." + identification) .choice() .when().xpath("//v10:*[1]", inputNS) .to("direct:transform_v10_v11“) .otherwise() .to(outputEndpoint) .endChoice();


http://localhost:8080/authservice/proxy/transformed?bridgeEndpoint=true&throwExceptionOnFailure=false

http://localhost:8080/authservice/proxy/transformed?bridgeEndpoint=true&throwExceptionOnFailure=false



from(“http://localhost:8080/authservice/proxy/transformed?bridgeEndpoint=true“) .routeId("bankapp.transformation.dispatch." + identification) .choice() .when().xpath("//v10:*[1]", inputNS) .to("direct:transform_v10_v11“) .otherwise() .to(“http://localhost:8380/routingservice/proxy/” + “BPMNSystemSpecEP?bridgeEndpoint=true“) .endChoice();


http://localhost:8380/routingservice/proxy/getBankMortgageCertificateEndpoint?bridgeEndpoint=true






















from(“direct:transform_v10_v11“) .routeId("projectX.route.transformation.transform.v10_v11“) .setBody().xpath("/s:Envelope/s:Body/*[1]", soapNS) .to("xslt:xsl/BankX/Bank_v10_v11.xsl") .bean(XBankTransformerBean, "transform_v10_v11") .setBody().simple(TransformationConstants.soapStart +"$ {in.body}"+TransformationConstants.soapEnd) .process(new ContentPrinter("v10-v11“)) .inOut(“http://localhost:8380/routingservice/proxy/BPMNSystemSpecEP?“+ „bridgeEndpoint=true“) .to("direct:response" + reverseidentification);








from(“direct:transform_v10_v11“) .routeId("projectX.route.transformation.transform.v10_v11“) .setBody().xpath("/s:Envelope/s:Body/*[1]", soapNS) .to("xslt:xsl/BankX/Bank_v10_v11.xsl") .bean(XBankTransformerBean, "transform_v10_v11") .setBody().simple(TransformationConstants.soapStart +"$ {in.body}"+TransformationConstants.soapEnd) .process(new ContentPrinter("v10-v11“)) .inOut(outputEndpoint) .to("direct:response" + reverseidentification);











Transformation für BPMN-System (3)from("direct:transform_v10_v11") .routeId("projectX.route.transformation.transform." + identification) .setBody().xpath("/s:Envelope/s:Body/*[1]", soapNS) .to("xslt:xsl/BankX/Bank_" + identification + ".xsl") .bean(transformerBean, "transform_v10_v11")...

public class BankTransformerBean extends AbstractTransformerBean {

@SuppressWarnings({ "rawtypes" }) public String transform_v10_v11(@Body String body) throws JDOMException, IOException { Element message = parse(body); message.removeNamespaceDeclaration(nsXBANK_v1_0); message.removeNamespaceDeclaration(nsYBANK_v1_0); message.addNamespaceDeclaration(nsXBANKv1_1);

.... return toString(message); } @SuppressWarnings({ "rawtypes" }) public String transform_v11_v10(@Body String body) throws JDOMException, IOException {




from(“direct:transform_v10_v11“) .routeId("projectX.route.transformation.transform.v10_v11“) .setBody().xpath("/s:Envelope/s:Body/*[1]", soapNS) .to("xslt:xsl/BankX/Bank_v10_v11.xsl") .bean(XBankTransformerBean, "transform_v10_v11") .setBody().simple(TransformationConstants.soapStart +"$ {in.body}"+TransformationConstants.soapEnd) .process(new ContentPrinter("v10-v11“)) .inOut(“http://localhost:8380/routingservice/proxy/BPMNSystemSpecEP?“+ „bridgeEndpoint=true“) .to("direct:response_v11_v10“);








from(“direct:transform_v10_v11“) .routeId("projectX.route.transformation.transform.v10_v11“) .setBody().xpath("/s:Envelope/s:Body/*[1]", soapNS) .to("xslt:xsl/BankX/Bank_v10_v11.xsl") .bean(XBankTransformerBean, "transform_v10_v11") .setBody().simple(TransformationConstants.soapStart +"$ {in.body}"+TransformationConstants.soapEnd) .process(new ContentPrinter("v10-v11“)) .inOut(“http://localhost:8380/routingservice/proxy/BPMNSystemSpecEP?“+ „bridgeEndpoint=true“) .to("direct:response_v11_v10“);








from("direct:response_v11_v10“) .setBody().xpath("/s:Envelope/s:Body/*[1]", soapNS) .to("xslt:xsl/BankX/Bank_v11_v10.xsl") .bean(transformerBean, "transform_v11_v10") .setBody().simple(TransformationConstants.soapStartTixBank +"${in.body}" +TransformationConstants.soapEnd);



RoutePipe

Flexibility through Filters

Pipeoutboundfilterinbound

Filters are exchangeable, reusable and easily testable





Should I always use an EAI-Framework?



Should I always use an EAI-Framework?

It depends!



Further tips considering EAI




small building blocks





no shared mutable state






use immutable DTOs






use immutable DTOs

=> increased scalability






use immutable DTOs

=> increased scalability

advanced: see “SEDA” & “actor model”


http://matt-welsh.blogspot.com/2010/07/retrospective-on-seda.html

http://matt-welsh.blogspot.com/2010/07/retrospective-on-seda.html

http://adit.io/posts/2013-05-15-Locks,-Actors,-And-STM-In-Pictures.html

http://adit.io/posts/2013-05-15-Locks,-Actors,-And-STM-In-Pictures.html



Alexander Heusingfeld, @goldstift

[email protected]

Martin Huber, @waterback

[email protected]

http://www.innoq.com/de/talks

Vielen Dank!


http://twitter.com/goldstift

http://twitter.com/goldstift

mailto:[email protected]

mailto:[email protected]

http://twitter.com/waterback

http://twitter.com/waterback

mailto:[email protected]?subject=

mailto:[email protected]?subject=



Documents

Flexible EAI-Lösungen mit Glass sh@WebServlet(urlPatterns = {"/order/import"}) public class ImporterServlet extends HttpServlet {@Inject OrderBean bean; @Inject CsvDataParser parser;