What good is an Information stream?

Information flows in Enterprise software architectures present applications with an opportunity and a problem. The opportunity, that is all too often ignored, is that observing these streams in transit can be a source of operational business intelligence. Aggregating, analyzing, interpreting and presenting intelligence from information flows can provide deep insights into the operations of business processes. The problem is one of efficiency and effectiveness; introspecting flows without introducing undue latency and at the same time being capable of performing sophisticated processing on those flows.

 
Ipedo’s XIP addresses a subset of the problem; that concerned with processing XML document flows. Since XML is a popular format for serializing information, a number of applications are found producing and consuming XML flows. XIP provides a construct named Feeds for processing streams of XML documents efficiently. Feeds are composed of one or more Stages, each of which performs a specific type of operation on the stream of XML documents. A number of stages can be chained together to achieve desired processing of an XML document flow.

Here is a screenshot of a feed definition. This feed operates on a stream of ACORD (Insurance industry standard) XML documents. It is composed of three stages - an XQuery stage which checks for the presence of a specific element, and if absent adds in the element with pre-defined default content; an XSLT transformation stage; and an aggregate index (more on aggregate indexes later) stage that keeps track of aggregates that apply to the entire flow.

To create a feed, you start by defining the stages that make up the feed. Each stage is identified by a name, and can be one of several kinds, as seen in the next screenshot.

• XML Rules can be used for semantic/business rule validation
• XSLT transformations can make structural changes to the document
• XQuery can be used to perform both transformations and queries that span the input document and a variety of data sources available to the XIP platform
• The Java DOM Filter can be used for custom processing coded in Java
• Compound Aggregate Indexes (CAI) can be used to keep running aggregates (counts, sum, average etc.) of values found in the XML document stream.

What follows are illustrations of how stages are defined. Here is an XQuery stage which accesses the input XML document to the stage using the input() function and can then use standard XQuery syntax in composing queries that can not only transform that input, but also enhance it on the basis of information queried from any external data source (web services, relational databases, flat files, custom java applications, you name it). These constructs make it possible to extend the processing power of feeds in virtually limitless ways.

Another example is a CAI (Compound Aggregate Index) stage that maintains indexes on aggregates computed on a flow of documents. For instance, you can keep track of the count of documents of a given transaction type, or you can keep a running total of order values for a given customer. These indexes can feed operational intelligence dash boards that will provide real time business monitoring capabilities.

The Feeds feature is interesting to anyone considering adding value to information flows by monitoring them, applying syntactic or semantic validation to those flow units, enhancing the quality of the data by filling in missing information or transforming that flow to match a target applications needs. The possibilities are endless.

Comments

[chat sohbet]

thanks four you

[sohbet]

All these pictures are beautiful, I’m from Ishkashim, Badakhshan and all these pictures make me miss home even more, good job guys, next time take me with you!

[ed hardy clothing]

I agree with you on Twitter. I resisted it for months, refusing to listen to reports of its usefulness. I couldn't have been more wrong. It is such a smooth, simple, streamlined informational sharing tool, I love that we are able to be curators of so much valuable knowledge and information shared at remarkable speed.
http://www.ed-hardy.cc/ed-hardy-clothing.html ed hardy clothing
http://www.4unj.com nfl jerseys

[antep baklava sipariş]

thanks four you

[coach handbags]

In your blog I feel your enthusiasm for life. Thank you for sharing ! I learned a lot! May the joy and happiness around you today and always.By the way，Do you like coach handbags？ It will make your life different!

[jordan 1 flight low]

we should work be such a significant of human satisfaction.A good share of the answer rest in the kind of pride that
is stimulated by the job, by the activity of accomplishing.Do you think so?

[Electronic Cigarette]

I love that we are able to be curators of so much valuable knowledge and information shared at remarkable speed.

[MBT Shoes]

Nice, provocative post and very interesting Blog. Hope it will always be alive!

[Abercrombie and Fitch]

I thought I would leave my first comment. I don't know what to say except that I have enjoyed reading.

[Jordan Shoes]

I thought I would leave my first comment. I wish had something like this when I started using. I will keep visiting this blog very often.

[Miles]

I wish I could find such informative sites more often. I regularly spend much time on lust looking for some worthy sites when I can find something to read. Your site is surely one of them. I wish you futher success. My site – search engine on rapidshare files ( http://filecraft.com ). Hope to be useful for someone

[chaussures puma]

I like this artical

[sohbet]

thanks fro this article ver useful

[sohbet odalari]

very nice article

[çet]

ver nice post thanks you

[chat siteleri]

thanks you

[chat odalari]

thanks for the info..

[sohbet et]

very nice article thanks admin

[alex]

The enterprise architecture methodologies, SOA, and composite application architectures make it possible to create highly configurable applications that are integrated at the platform level. However, because the application architectures make dynamic configuration and run-time configuration possible, the post-deployment http://paraorkut9.org/ management of enterprise applications is a very complex activity. This document describes the nature of enterprise applications from one management point of view, and it describes the issues and challenges that need to be considered when designing an enterprise application management framework.

[leiqiong]

I came to your article from another article and am really interested in this learning about this. , I feel strongly about information and love learning more on this. If possible, as you gain expertise, It is extremely helpful for me. would you mind updating your blog with more information?
http://www.jerseysonline.co

[Red Bull Hats]

I gave my site a few examples below. If you appreciate my comments in you enter.

[abercrombie]

A well researched posts, I'll link to it from my site thank you!

[abercrombie]

A well researched posts, I'll link to it from my site thank you!

[escapada rural]

I enjoyed reading it. I need to read more on this topic...I admiring time and effort you put in your blog, because it is obviously one great place where I can find lot of useful info.

[sad poems]

Really valuable written content. the information that you shown is amazing and many prominently i liked the way you provided things here.