Читать книгу Fail Fast, Learn Faster - Randy Bean - Страница 11

1 A Little History of Big Data

Оглавление

“Those who fail to learn from history are doomed to repeat it.”

—George Santayana

There was of course a time when data was not the craze, in vogue, and all the rage. For many years I would go to cocktail parties and could not admit to working with data and analytics without driving most people away in boredom. I often diverted the subject to discussion of travel, food, sports, the world financial markets, art, or anything else that had more popular appeal. This all changed with the 2003 release of the book and subsequent movie, Moneyball, starring Brad Pitt.1 When asked what line of work I was in, I could now proclaim, “I do Moneyball for Business!” It was like I was the new Brad Pitt. I now enjoyed being at the center of conversation. It was at this juncture that I realized that data and analytics had become fashionable.

We live in a time when data is in the ascendancy. It was not always this way, though. Before there was a Google, before terms like Big Data came into vogue, and before jobs like data scientist and chief data officer became sought-after positions, data and analytics were considered a niche area, relegated to back office practitioners in market research, statistical analysis, and actuarial groups. The processing of electronically maintained data was referred to by the quaint moniker of electronic data processing (EDP).

For the better part of a generation, even as data progressively entered the mainstream and became more prevalent, and as firms wrestled with how to wring insight and benefit out of the accumulating hoards of new data that was being captured and maintained electronically, data and analytics remained largely a backwater for all but a few leading-edge innovators. The technology community progressed through an evolution of terms used to describe fresh capabilities that would enable business executives to derive insight and value from their data assets – decision support systems (DSSs), executive information systems (EISs), and, ultimately, database marketing, which evolved into customer relationship management (CRM) and business intelligence (BI). Interest in data was on the rise.

When the term “Big Data” first came into common usage around 2011, my initial reaction was, “Well, isn't this pretty much what I have been doing for the past few decades?” The truth of this was both yes and no. Yes, because organizations are still striving to learn, gain insights, and make better decisions based on data, as they had been for decades. No, because the volumes and varieties of data that could now be made readily available for analysis had proliferated, greater computing power had increased the velocity and timeliness by which information can be put into the hands of business decision-makers, and new technology approaches and modern data architectures had hastened these efforts in a way that was never previously possible. These advances represented the critical difference that would characterize and differentiate the Big Data Era from all that preceded it.

In his book Only Humans Need Apply: Winners and Losers in the Age of Smart Machines, author and professor Tom Davenport identifies Four Eras of Information, dating from 1975.2 Confirming the speed with which these eras are progressing, Davenport notes that the third and fourth Eras of Information have been spawned just within the past few years. These eras have been driven by the rise of Big Data. As a result, the accelerating proliferation of data has fueled a growing prominence of data within the corporate enterprise.

The term Big Data can and does imply many things, depending upon the eye of the beholder – the term has been used to refer to “lots” of data, new types of data, and data of different varieties, sizes, and structures. I have often noted that it does not matter a whit that the term Big Data, and the term artificial intelligence (AI) as well, may be used or misused with great technical imprecision. What matters is that Big Data and AI have managed to capture the imaginations and attention of senior business decision-makers at the board and C-suite levels, and as a result, organizations have made significant commitments to elevating these activities and giving them business primacy – through centers of excellence, Big Data and AI labs, and moonshot initiatives.

Love it or hate it, Big Data is a descriptive term that caught on. Why? I think that much of the reason has had to do with the word “Big” and everything that this term implies – Big Impact, Big Changes, Big Time, Big Deal. Big connotes size and greatness. People like big things and big events. Bigness is attractive. People like to say that something big is happening. Big Data is a grand concept that implies something vast, significant, potentially revolutionary, and is a compelling metaphor for an age of transformation, disruption, and change – the Age of Big Data and AI. Big Data is a term that managed to capture the zeitgeist.

Much of the credit for bringing Big Data to the forefront of business and public attention and into general awareness deservedly goes to a set of industry influencers who first widely employed and coined the term Big Data. In a May 2011 special research report, “Big Data: The Next Frontier for Innovation, Competition, and Productivity,” the management consulting firm McKinsey put forth the argument that “Big data will become a key basis of competition, underpinning new waves of productivity growth, innovation, and consumer surplus.”3 The McKinsey report continued, “The amount of data in our world has been exploding. Leaders in every sector will have to grapple with the implications of big data, not just a few data-oriented managers. The increasing volume and detail of information captured by enterprises, the rise of multimedia, social media, and the Internet of Things will fuel exponential growth in data for the foreseeable future.”

Common usage of the term “Big Data” can be traced to the McKinsey report and similar reports from IBM that were published around this time. The McKinsey report was prescient in its observation that “Leaders in every sector will have to grapple with the implications of big data, not just a few data-oriented managers.” To me, this was the distinguishing insight. From this point forward, data would no longer be the purview of “a few data-oriented managers” but rather would become the purview of “leaders in every sector.” Data would be open to the masses. Call this the democratization of data. The McKinsey report went on to characterize the dawning era of Big Data as heralding “new waves of productivity growth, innovation, and consumer surplus.” Big Data, like the Internet before it, was destined to change the world. Notably, the McKinsey report did include one important caveat, or small print disclaimer, that the great promises and grand benefits of Big Data would transform business “as long as the right policies and enablers are in place.”

The term Big Data has served to popularize data in a way that decades of data work had never previously achieved, by making it simple, accessible, understood, and big and important. The sudden ascension of Big Data led to my own two-year stint as a Wall Street Journal guest columnist during 2014–2015, writing monthly columns on Big Data and its industry-transforming power and potential. The attentions of Fortune 1000 companies were now engaged at the highest level, compelling the interest of the corporate executive committee and board of directors. This was the moment that leading global corporations embraced data as a critical business asset, and recognized that to compete in the twenty-first century they must possess a data strategy and data leadership.

The advent of Big Data was met by an enthusiastic embrace by the venture capital, private equity, and global investment communities as well. By November 2011, the prominent venture capital firm Accel Partners, an early investor in Facebook, had announced the launch of a “$100M Fund to Invest in Disruptive Big Data Companies.” Accel partner Ping Li noted, “this Big Data wave will usher in a new era of multi-billion software companies that solve existing problems differently or new problems previously unthinkable.”4 Accel also announced the launch of a Big Data conference to “network and drive deeper discussion on technology trends in the space.”

Fail Fast, Learn Faster

Подняться наверх