Currently set to No Index

Big Data #11: What Big Data Doesn’t Do

Big Data was one the biggest hypes in 2012 and more or less continuing its glory today. Many corporations rushed to embrace it hoping that it will solve the long-standing business problems and make the corporations more competitive. This enthusiasm inevitably brought heightened expectations, which would never materialize given the correct effort.

First and foremost, big data won’t solve your business problems. In fact no computer system will solve them. Given that the right questions are asked and right amount of thought, planning and execution goes into answering them, you can see what your problems are. Your skilled employees will use the data, analyze it, discuss it, come up with solutions, iterate, repeat and then solve these problems, not your big data analytics software.

Big data will not improve the quality of your data. If you do not have quality data, you cannot expect the system to bring you quality analyses. With carefully designed forms, which has predefined input lengths and validation rules you get pretty much clean data, which is not the case with big data. When you have data coming from various sources such as -say – social media and sales figures then you will definitely have a headache if you do not clean it up.

RELATED:   Are You Paying Too Much for Web Hosting?

Similarly, it will not organize or structure your existing data nor it will help you manage it. According to IDG figures, about 90% of the enterprise data is unstructured, and is growing exponentially. If your company does not have policies for organizing, using and retaining the data, further introducing big data will be a mess at best.

Furthermore, introducing big data will create more noise to your existing data, as much as up to 90-95% (my experience). It is the 5-10% of the data that you should expect to make a real difference in your analytics. Do not assume that with big data you will have less to deal with.

Without doubt big data will have an impact in your data center. Big data systems differ from the traditional transaction and data warehousing systems. Given the required bandwidth to receive the big data and the large compute clusters at the very least you will have to rethink about storage, cooling and hardware in your data center.

RELATED:   Big Data #2: Planning for the Big Data Analytics

These changes in the data center will not solve your IT department’s problems either. Since there is a change in the data center, you cannot expect your system and network administrators to have the data management and analysis skills without any training. Nor you cannot expect them to work business-as-usual with the specialized big data hardware. Infrastructure monitoring and configuration, server management skills will have to be rethought of and proper training has to be organized for your existing IT team.

Big data will not eliminate your legacy systems nor decrease their value. In fact they will make them even more valuable because they are the systems that are providing critical business data. A state of the art big data system will not replace your – say – existing CRM system. Given the right thought and the methods, your big data system use the values from your CRM system.

RELATED:   Trending Tweets You May Have Missed

And finally, your big data systems will not give you the correct answers in every analysis. In fact many of the results you receive will be inconclusive. Think about the genome sequencing and weather forecasting as two examples where years of stored (and presumably clean) data are constantly analyzed, rethought of and reanalyzed. And there is no exact answer yet. Your big data investment may not be that “big” but there is tolerance for inconclusiveness. This will also have an impact on the ROI considerations (personally I recommend using big data processing utilization as an ROI metric).

As I have always emphasized, the management has to communicate clearly. In case of big data it is about the investment – what is expected of it, what it can do and what it cannot. Otherwise the expectations and the deliverables are not likely to match.

Image credit: news-sap.com

whg_banner.new.10k

How-to Start a Blog – Review of the Best 10 Blogging Platforms
How-to Start a Blog – Review of the Best 10 Blogging Platforms

If you want to start a blog as fast as possible, then you need to consider choosing a blogging platform. Thankfully, there are some excellent free and paid blogging platforms...

How Referral Marketing Can Benefit Web Hosts
How Referral Marketing Can Benefit Web Hosts

Even if the niche of web hosts are fully loaded with a lot of companies they are still one of the easiest to promote because you could write your own...

Broken Links: How to Find, Fix, and Benefit from Broken Links
Broken Links: How to Find, Fix, and Benefit from Broken Links

Links are what holds the web together. Essentially, the web is named as such because of the ability for pages and sites to link to other sources and relevant information....

Brand Value & the Most Powerful Brands (with Infographic)
Brand Value & the Most Powerful Brands (with Infographic)

Brand value – everyone wants it, however, only few are able to achieve it. The subject of “brand value” holds a significant position amongst marketers, executives, and entrepreneurs. Let’s discuss...

Reasons why your business should shift to Cloud hosting
Reasons why your business should shift to Cloud hosting

Cloud hosting has been on the rise since its inception. The improvement to your website performance and business efficiency that comes with Cloud hosting is almost tangible.

Why We Love the IT Support Career?
Why We Love the IT Support Career?

In almost all of my posts I was talking about the stressful side of the IT – the long hours, end user issues, migrations, midnight calls and the like. But...

IT Manager: Ways To Show Your Appreciation To Your Team
IT Manager: Ways To Show Your Appreciation To Your Team

Surely your team struggled hard and made things happen. You cannot say “this is what you get paid for” and just leave – you cannot keep your IT staff that...

Feeling Insecure In Your Current Job Position?
Feeling Insecure In Your Current Job Position?

Job security is one of our primary concerns. We everyday we live with the question of whether or not we will be working the next day. Loyalty is not the...

Leave a Reply

Your email address will not be published. Required fields are marked *