Join our Waitlist for Expert Advice!

4 Lessons for Every Entrepreneur Creating Big Data Solutions Big Data is dazzling but it doesn't automatically shed light on real problems.

By Bill Schmarzo Edited by Dan Bova

Opinions expressed by Entrepreneur contributors are their own.

I recently taught an MBA course at the University of San Francisco titled the "Big Data MBA." In working with the students to apply Big Data concepts and techniques to their use cases, I came away with a few observations that could be applied by any entrepreneur.

1. Understand the customer's problem.

To ensure that your solution adds value, start by conducting extensive primary and secondary research on both the problem and the value of the solution. To understand your targeted customers, develop personas early in the process that serve as the "face of the customer." Document the types of questions they ask and decisions they make. Then use the resulting insight to identify and prioritize data sources that you could be capturing about your customers, products and operations based upon business value and ease of implementation.

Related: How Small Businesses Can Embrace Big Data

2. Understand how your product fits in the customer's environment.

Companies have big investments in their data and technology environments. They will not be easily persuaded to toss out that investment. Instead, figure out how your solution can leverage or extend your targeted customers' existing data and technology investments. Data, analytics, reports, dashboards tools and even SQL are strategic organizational assets. Explore ways to extend or free up those assets with new big data technologies, products and capabilities. By adding $1 now, they can free up or add $10 of value to their existing investments, such as Business Intelligence and data warehousing. That's always a winning strategy!

Related: Big Data Isn't Just For Big Businesses Anymore

3. Build upon open source and cloud technologies.

There is a compelling suite of open source technologies, many supported by the Apache Foundation, that are free, scalable and that allow organizations to quickly develop and get products to market. These technologies include:

  • Hadoop, a programming framework that supports the processing of large data sets in a distributed computing environment.
  • Spark, an in-memory open-source cluster-computing framework that provides performance up to 100 times faster for in-memory analysis and applications.
  • YARN, which enables multiple data processing engines on top of Hadoop such as interactive SQL, real-time streaming, and advanced analytics, along with the traditional MapReduce batch processing.
  • Mahout, a suite of scalable machine learning algorithms focused primarily of collaborative filtering, clustering and classification.
  • HBase, a column-oriented database management system that runs on top of HDFS; very useful for sparse data sets, which are common in many big data use cases.
  • Hive, an open-source data warehouse system for querying and analyzing large datasets stored in Hadoop files.
  • R, a free software programming language and software environment for statistical computing and graphics.

The entrepreneur should stand on the shoulders of those who have already built solutions to create your unique and compelling differentiation. Leverage open sources products and the cloud for your development environment. Light your hair on fire to get initial prototypes out to market as quickly as possible. Heavily instrument your product so that you have details about how customers are trying to use your product. Learn and evolve quickly. Speed is everything, with customer service a close second.

4. Provide a compelling, short payback ROI.

Help organizations find new ways to monetize their data and analytic assets. Focus on the business stakeholders by providing products and solutions that help them optimize their key business processes. To accomplish this, develop an initial ROI for your product and use it as compelling evidence for your customers to test, try and buy your product. Empowering front-line employees to deliver new services to customers is a great way to monetize your data and analytic assets and drive that ROI. If you don't know how you product makes your targeted customers money, then don't expect them to figure it out on their own.

It's very encouraging to see MBA students empowered to be bold and brave in creating new business opportunities. And as I told my MBA class, the days of the MBA and business leaders delegating data and analytic decisions to IT are over. Business leaders (and MBA students) need to start owning these new sources of monetization, and the time is now.

Related: Hire Better Talent With a Big-Data Scientist

Bill Schmarzo

Chief Technology Officer, EMC Global Services

Bill Schmarzo is the chief technology officer for EMC Global Services' Enterprise Information Management & Analytics service line. Nicknamed the "dean of big data,'' he is responsible for setting strategy for EMC's big data consulting business. He created the Business Benefits Analysis methodology and has served on the faculty of The Data Warehouse Institute. Schmarzo is the author of Big Data: Understanding How Data Powers Big Business.

Want to be an Entrepreneur Leadership Network contributor? Apply now to join.

Business News

A Billionaire Founder Admits He Had 'Horrible Habits' — Then He Started a Morning Routine That 'Transformed' His Life

Kind Snacks founder Daniel Lubetzky used to go to sleep at 2 a.m. and skip his morning workout.

Starting a Business

I Quit My Corporate Job to Start a Business. Here's How I Went From Having $35,000 Credit Card Debt to Making $4 Million.

Courtney Allen, founder and CEO of presentation design agency 16x9, "recklessly" left corporate life behind in 2015 to pursue entrepreneurship.

Business Ideas

63 Small Business Ideas to Start in 2024

We put together a list of the best, most profitable small business ideas for entrepreneurs to pursue in 2024.

Business News

You Have One Month Left to Buy a House, According to Barbara Corcoran. Here's Why.

"If you are planning on waiting a year and seeing where interest rates go, you are out of your mind," Corcoran said.

Business News

Google's CEO Says AI Is Now Responsible for 25% of 'All New Code' Created at the Company

Google CEO Sundar Pichai said engineers are moving faster because of AI.