Data Services is the Answer! Yes, but...
In our last post, we talked about using a data warehouse strategy as one of the ways to break down data silos across multiple departments and systems. Building a data warehouse is a traditional way to tackle the data silo problem. However, successful projects take serious organizational commitment and months of development time. With data moving faster than ever and business teams increasingly looking for the ability to rapidly experiment with analytics, the wait time for a data warehouse often leads business teams to move on before the warehouse can even be deployed. As a result, business and IT teams are looking for other ways to unify data across disparate data sources.Benefits of Data Services vs. Data Warehouse Approach
No moving data

Free advice: Make sure the data services layer in your solution natively supports (no drivers to install) unstructured and semi-structured formats from NoSQL and REST-API sources so you can avoid the need to transform your data and shoehorn into back into a relational structured. Even if you are only using structured data today that may not be the case tomorrow as most new data that is interesting to explore is semi-structured or unstructured.
Experimentation and agility

Free advice: Ask yourself how difficult it is to add a field, a table, a new data source into your existing analytics architecture. If the answer is, "I'd rather have a root canal" then you might have a problem. Your data services layer should resolve this problem, not contribute to it. Be sure you're not adding barriers to experimentation by forcing conformance to a relational structure when you have semi-structured or unstructured data sources in your stack.
Reduced cost of ownership
All things considered, the data architecture when using a data services layer should be less complex than that of a data warehouse simply because you are not moving data and no pre-defined schemas are used. With reduced complexity comes a reduction in costs to build and maintain the architecture as you need fewer resources to develop the data pipeline and the cost to make changes is relatively low.
Free advice: I can't emphasize enough that simplification goes out the window as soon as you start transforming unstructured data back into a relational structure so this benefit assumes native integration with no use of drivers, etc. Building the integration may sound difficult but there are tools out there that have already solved the native integration problem. We are one of them but there are others.
In our humble opinion, the need to move, flatten, transform and apply structure to unstructured data should be a thing of the past. We are evidence that there is an emerging wave of new analytics tools that are leading the way to the future of data analytics where business self-service, experimentation, and data agility thrive. Come catch the wave with us! Sign up for a free trial here
0 comments:
Post a Comment
Please share your thoughts. If you have a question, please reference our docs section at https://docs.knowi.com.