Data Visualization- The Medium is the Message

March 2, 2012

Marshall McLuhan‘s enigmatic phrase – medium is the message-  from the sixties gives him credit for predicting the World Wide Web 30 years ago.  He could have just as well have been talking about Data Visualisation for Business Analytics. While information management technology has grown at a blistering pace, the human ability to process and comprehend numerical data has not.

Visualization opens up the channel of communication between the technologists who create the data and the business people who act upon it.  Data visualization tools, such as mashups, executive dashboards, KPI and performance scorecards and other data visualization technology, are becoming more popular and necessary to deal with mind numbing charts and exponential data growth.

However, the C-Suite has heard about the promise of dashboards and interactive scorecard for a few decades now and is typically dissatisfied with what they get from IT and the speed at which they get it. The big difference is that visualization technologies have finally advanced to a level where they can give actionable intelligence to the right people at the right time at the right place.

Lets take for instance an a mobile BI solution using a tool such as an Apple iPad. This gives the business executive the ability to manipulate the data with the ease of reading an e-book.  The visualization library that you can draw upon to create an interactive experience on the iPad includes:

Bi24 data visualisation

There are three critical business requirements addressed by such a solution. These are:

1) Ease of Use:Pictures and graphs are easier to read than numbers and more insightful than words on a page. The picture of the water levels from the recent tsunami shown in this posting can communicate more information than any seismic data chart.

2) Interactivity – Business users want the ability to change parameters and do their own queries but are loath to get on a keyboard to do write a query and would rather not go through discussion cycle an IT manager to look at data in a different way.

3) Mobility – Any time any place access is a fundamental need of the modern business environment. The wide-scale adoption smartphones and tablets provides an ideal platform to carry out this requirement.

We predict that mobile BI using visualized data which is easy to manipulate will be a giant step in aligning IT with business in 2011. A picture transcends language barriers and communication challenges across organizational silos more effectively than any form of numerical data.

There are those who argue that the emphasis on visualization (simplicity) minimizes the advanced technology that is a bulk of the work in information management. All the work that goes on in processing data is of no value if it cannot support a better business decision. The visualized data is all that matters. The tip of the iceberg is the iceberg.

Thanks to Shirish Netke


Ten changes to Business Intelligence in 2012 (some of which Bi24 already delivers)

November 18, 2011

 

  1. It’s going to be all about getting things done!
  2. Standards and enterprise-grade platforms will continue to be important, but individual BI tools with the functionality to show a single version of the truth will trump standards.
  3. Enterprises will learn to live with multiple BI tools.
  4. Business Intelligence will continue to move away from the IT team and into the hands of the business user.
  5. Self Service BI will bring decision making to the desktop and will become the name of the game.
  6. Mobile BI will go mainstream. Tomorrows decisions will need to be made when and where they need to be made, not “when I get back to the office”.
  7. Cloud BI will continue to chip away at on-premises BI, but it’s still a long road ahead.
  8. BI-specific DBMSes (in-memory, others) will go mainstream.
  9. Big data will start to move out of silos and into enterprise IT. IT will start to learn how to live with it.
  10. BI users will start demanding and vendors will start delivering Bi tools that integrate with email and collaboration platforms. Just integrating BI with Excel is no longer enough.

The true value of business data

August 15, 2011

Some say that data is the new Oil, and I guess if we look at the value of data rather than the sustainability and availability of data then there may be some truth in this. But not everyone does see the value of data, some will see it as nothing more than a costly problem rather than as a valuable resource.

It’s estimated that enterprise data is going to grow at 10% per month or 650% over 5 years and that over 10 billion devices will be connected to the internet creating data by 2015. Amazingly globally every 2 Days we create as much Information as we did between the dawn of civilisation and 2003, and every minute of every day 24hours worth of video is uploaded to YouTube.

Perhaps what’s even more amazing is that 43% of businesses do nothing with this growing resource other than run reports on how their business performed last week/month/year. The problem is only going to get worse with over 15 petabytes of new information being created every day. For those who use social media the “share” and “RT” buttons encourage us to share posts, links, videos, images and documents creating copies of copies of copies – just like the Gemino spell in Harry Potter and The Deathly Hallows.

So if 43% of companies do nothing with data what about the 57% that do? Reports suggest that these companies are 4.5 times more likely to outperform their lower performing counterparts and the evidence is clear to those that look into it. The biggest employer in Europe, The NHS, used BI to track the spread of Flu during the National Flu Pandemic creating over 1.5 billion records in a 16 week period. Tesco’s, Coca Cola, oil companies and McDonalds all use Business Intelligence tools to gain a clearer insight into the data within their business and use that data to make informed and timely business decisions that distinguish them from the competition. Whilst the argument for using the ever increasing amounts of data for our competitive advantage doesn’t come across to much resistance the subject of data quality is beginning to generate more airtime and momentum.

Many companies just don’t have the time, resource or knowledge to look at the quality of their data and who can blame them, it’s a highly competitive space we are in, budgets are stripped of fat, head counts are slimmed down to the core and it’s all hands on deck for the primary function of the business. Interestingly the smallest amount of bad data can have sizable ramifications to the business, its customers, reputation and bottom line. Thomas C. Redman explains in his book “Data Driven” that if your data is 100% accurate and one customer order requires a dozen pieces of data then the cost is £1.00. 100 orders the cost is £100.

One Hundred orders each requiring 12 pieces of data means 1,200 pieces of data are needed. An error rate of 1 percent means there are 12 errors. Chances are high that 11 or 12 of the 100 orders will be affected. If 88 good orders costs £1 (totalling £88) then 12 bad orders will cost £10 (totalling £120) and doubling the cost of sale.

Business Intelligence solutions easily identify these areas of weakness providing companies with the opportunity to reduce their bad data and exposure, all that’s left then is to address the access rights of this data.

Perhaps instead of data being the new oil we should refer to it as being the new gold, increasingly valuable and readily available to the masses.


OLAP’s Only Half The Story

July 4, 2011

Before I start, I’d like to make it absolutely clear that I think OLAP was a great technology and innovation, and when I first got introduced to it, I was blown away.

Although OLAP had been around a while, the first time I really started to become familiar with it was around the turn of the Century.

This makes me sound old but also shows how long OLAP has been around.

Coming from a relational background and spoon-fed on Oracle, Informix, DB2, Sybase and SQL Server I was firmly in the world of “Structured Query Language”.

I found great joy (and success) in learning how to do clever, unfathomable stuff joining as many tables as I could together in one go and exploring the limits of what was possible from one database supplier to another.

However, SQL was and is slow to retrieve data AND SQL is difficult and often a step to far for non-techies to understand and become proficient in.

When I saw OLAP and how easy it was to build a cube it came as a bit of a revelation. Why hadn’t I used this before? Why doesn’t everyone use it?

Well…

It works well because it’s working over pre-aggregated data.

“OK so there is MOLAP, ROLAP and HOLAP, all different variants of OLAP that either pre-aggregate, partially pre-aggregate or don’t aggregate at the expense of reduced performance… so if you want it to be fast it’s OLAP all the way.”

Building a cube takes time and over large data sets andfor really big cubes, can take hours. It’s this pre-aggregation that give you performance so that’s the trade-off.

OLAP only gives you half the story.

You can only see the data in an aggregated form and can’t drill through to the transactional data quickly as you have to go from the world of OLAP back to the world of SQL as soon as you go from a number to the raw data.

OLAP gives you flexibility through hierarchical dimensions and multiple measures but this is down to the programmer, the person who builds and maintains the cubes often hasn’t a clue what the business really needs and is trying to come up with structures that satisfy the many as opposed to YOU.

Move over OLAP and move over SQL.

There is a new way of doing things. A way that gives the business user access to the information they need that is quicker than OLAP, destroys the performance and flexibility of SQL and can be used by non-techies.

BI has been around for decades. There are so many products that do more or less the same thing in more or less identical ways.

Lipstick on a pig is a good description for modern day BI. At the end of day it’s still a pig.

A new layer of make up to provide a thin veneer over a fossilised architecture that is based on outdated ideas.

Search technology has been designed for speed. Designed for ease of use and designed for the non-techy (and it can be made to run real time…) and the 21st Century.

It’s about time someone thought about “Re-inventing Business Intelligence” by starting with a fresh way of thinking. By embracing the latest in search, social media, networking, web and phone.

When it comes to BI, move over OLAP and SQL, your time is up!

Richard Lewis


Follow

Get every new post delivered to your Inbox.

Join 497 other followers