Closing the Big Data Loop

It has been two weeks since TUCON 2012, the TIBCO user conference held annually in Las Vegas, Nevada. TIBCO is well-known as an integration company but used the event to demonstrate its broad platform approach to the biggest challenges of today, like digital customer experience, loyalty, and the topic of this article, Big Data.

The TIBCO CTO, Matt Quinn spoke about the patterns hiding within the rapidly increasing amounts of data flowing across the enterprise. Quinn made an important distinction between data at rest, information sitting in databases or flat files waiting to be queried, and data in motion, which includes streaming data and data stored in-memory (also known as cache).

Quinn made the point that it takes analytics like those offered within TIBCO’s Spotfire product to be able to see what would be invisible to people trying to keep up with the increasing deluge of information. To Quinn, the smart enterprise finds patterns in historical and machine data (log files that up until recently weren’t mined for patterns) that provide insight that can be applied to data that’s coming at today’s “full speed.” [Read more...]

The Power of Patterns – Part 3

Check out The Power of Patterns and The Power of Patterns – Part 2 before reading on to discover the third and final type.

Patterns of Events

Based on our experiences and skills, there are other patterns that we deal with naturally every day. As complex sequences of events unfold around us, we are able to reach conclusions about likely outcomes. For instance, this might be something as simple as when we are driving and see the lights ahead turn to green (an event), a large vehicle having difficulty accelerating up the hill (a series of events), while there are still 15 cars ahead of us and we know the green light time is usually 45 seconds (let’s call these type 3 patterns). Since we know the chances are we won’t make it through the green light, we are mentally prepared to slow down, rather than accelerate.

Now imagine the more complex situation of an electrical generation and distribution grid supplying power to millions of households and businesses. Events are being generated at every point in the network, from the household meter readings happening every 5 minutes or less; substations and transformers each recording and transmitting their current operating situations (load, temperature, etc.); power stations and wind turbine farms generating and sharing their current workloads. That’s, of course, not the end of it… numerous external factors are being monitored: current and projected weather conditions or a local sports team playing at 8pm and the #1 TV program showing at 9pm. [Read more...]

How to Leverage Branding Techniques and Technology for Competitive Advantage

Part 2 of 2 ( go to part 1)

How do brands navigate the treacherous, democratized, new customer relations landscape to provide a genuine representation of their experience? The answer is part organizational mindset and part technological enablement.

Part Operational Mindset

First, an organization must be highly aware internally with active internal communication. Making this more difficult, modern business has become truly global with major growth markets in Asia, Latin America, Eastern Europe, and Africa, as well as in mainstays like the U.S. and Western Europe. Town hall meetings simply will not cut it anymore. [Read more...]

Big Data vs. Event Processing

Database pundit Curt Monash made a brief mention of event processing (/event stream processing) in his discussion on “big data terminology”, presumably as a response to the discussion he started with Forrester’s Brian Hopkins where Brian (very reasonably IMHO) defined “big data” as: “techniques and technologies that make handling data at extreme scale economical.”

With “extreme scale” being defined mainly by the metrics of volume and “velocity” – with the latter being the obvious area of interest from an event processing perspective, as stated by Curt: “Low-volume/high-velocity problems are commonly referred to as ‘event processing’ and/or ‘streaming.’”

[Read more...]