Читать книгу The Informed Company - Dave Fowler - Страница 21

STAGE 1 SOURCE aka Siloed Data

Source Stage Overview

Modern businesses, even modest sized ones, generate heaps of data that comes in several flavors—product information, customer information, app performance, marketing expenditures, and more. A new business can work with data from production databases, product APIs, and financials directly from their sources.

Over time, as sources accumulate more data, the number of data channels grows as well. It becomes even more challenging to manage data across separate sources.

This section is about helping you work with sources. We talk about what sources are and what we can do with them. From there, we survey the tools commonly used to connect and investigate sources; for each example, we offer quick but tested thoughts on how these tools can be used by your team. We complete our discussion on sources by encouraging best practices on how to work with data during the source stage. We advocate for source replicas and streamlined data intelligence tools.

This stage is ideal for new companies or teams with minimal data needs. It is inexpensive and relatively easy to tool, implement, and maintain. While it is exciting to build out a sophisticated data stack, it is not necessary before circumstances require it. Over-engineering is a costly mistake. However, the methods discussed in Chapters 1, 2, and 3 set the stage for your future data lake and data warehouse that arise as the scale and diversity of your source data proliferate.