The emergence and evolution of data lake products have provided organizations with new approaches to storing and analyzing large volumes of data to generate business insight. Although some organizations have adopted data lakes as direct replacements for data warehouses, almost three-quarters of organizations use both, and in most cases those environments co-exist rather than being used independently of each other.
More than one-half of organizations use their data lake to store data from three or more operational data sources, and more than one-half store data using two or more file formats. More than two-thirds are running two or more analytics workloads on their data lakes, and almost 9 in ten expect multiple business departments and functions to benefit from their data lake environments. Benefits enjoyed by those already in production with data lakes include improving communication and knowledge sharing, gaining competitive advantage, and addressing digital transformation priorities.
"Our Data Lakes Dynamic Insights research illustrates that the data lake is delivering on its promise of enabling organizations to economically store and process large volumes of raw data from multiple operational applications in a variety of formats to be queried by multiple business departments for a variety of analytic workloads," said Matt Aslett, VP and Research Director, Ventana Research. "The research also highlights that data lakes continue to evolve. The DIY phase of adoption is over and that while the use of proprietary products will continue to grow data lakes users are shifting rapidly to open standards and open formats."
Challenges associated with data lakes remain, including governance and security as well as accessing and preparing data, but almost all data lake adopters use or plan to use additional technologies to help manage and govern their data lake environments, including data catalogs. With these additional capabilities, and evolving core functionality, data lakes are now an integral part of a modern data architecture, providing a key role in business transformation and modernization projects as organizations transition to being more data driven.
Almost all data lake adopters (97%) use or plan to use additional technologies to help manage and govern their data lake environments. The most popular, used by almost one-half (45%) of organizations, is the data catalog, followed by open-source data management projects and custom code and scripts (both 39%), data governance products (29%) and data management products (28%). More than one-half (51%) of organizations use two or more of these categories of products.
If you are interested in learning more about this dynamic insights research, in partnership with Dremio, you can view a summary of the report here. For information on how to use this research in your organization, or to purchase a copy of the research report, please click here.
About Ventana Research
Ventana Research is the most authoritative and respected market research and advisory services firm. We provide insight and expert guidance on mainstream and disruptive technologies through a unique set of research-based offerings including benchmark research and technology evaluation assessments, education workshops and our research and advisory services, Ventana On-Demand. Our unparalleled understanding of the role of technology in optimizing business processes and performance and our best practices guidance are rooted in our rigorous research-based benchmarking of people, processes, information and technology across business and IT functions in every industry. This benchmark research plus our market coverage and in-depth knowledge of hundreds of technology providers means we can deliver education and expertise to our clients to increase the value they derive from technology investments while reducing time, cost and risk.
Ventana Research provides the most comprehensive analyst and research coverage in the industry; business and IT professionals worldwide are members of our community and benefit from Ventana Research’s insights, as do highly regarded media and association partners around the globe. Our views and analyses are distributed daily through blogs and social media channels including Twitter, Facebook and LinkedIn. To learn how Ventana Research advances the maturity of organizations’ use of information and technology through benchmark research, education and advisory services, visit www.ventanaresearch.com.
Media: Interviews available upon request.
Media Contact: marketing@ventanaresearch.com
Tweet this: News: @VentanaResearch publishes dynamic insights research on data lakes, in partnership with @Dremio. Download a summary of the report here: https://bit.ly/3A4PjEv #DataLake #DataWarehouse #CloudTech #TechVendor #MarketResearch #DynamicInsights