Market Perspectives

AWS is Exemplary in DataOps Buyers Guide

Written by ISG Software Research | Nov 8, 2023 1:00:00 PM

We are happy to share some insights about AWS drawn from our latest market research, Ventana Research Buyers Guide: DataOps, which assesses how well vendors’ offerings meet buyers’ requirements.  

We recently published four Ventana Research 2023 DataOps Buyers Guides, an assessment of technology vendors and products that provide individual and combined DataOps, data observability, data orchestration and data pipeline platform support.  

At Ventana Research, we continue to believe that, for most use-cases, there is a clear choice for DataOps platforms for any use in your organization. We developed four technology assessments and buyers guides to focus on overall DataOps requirements as well as specific data observability, data orchestration and data pipeline platform use-cases. 

In all of our Buyers Guides, we utilize a structured research methodology called the Value Index that includes evaluation categories designed to reflect real-world criteria incorporated in a request for proposal (RFP) and vendor selection process for DataOps. We evaluated AWS and 17 other vendors in seven categories, five relevant to the product (adaptability, capability, manageability, reliability and usability) and two related to the vendor (TCO/ROI and vendor validation).  

In the overall DataOps Buyers Guide, our analysis classified AWS as Exemplary, receiving an overall grade of B- with 58.8% performance. AWS’ best grouped results came in Customer Experience at 86.0% with an A- grade due in part to its A- in both Validation and TCO/ROI. In Product Experience, AWS received C++ grade at 54.1% performance due to its 44.6% performance in Capability. AWS was designated a Leader in Customer Experience and Reliability. AWS did not participate in the RFI process. 

AWS’ C++ grade in Product Experience was impacted by its C+ in Capability where it could add data observability functionality and enhance data pipeline development. Customer Experience was impacted slightly by its A- grade in Validation where it could reiterate the investments it is making in enhancing customer experience and continue to develop strong and quantified customer use cases 

AWS performed best in Customer Experience where it was a Leader, notably in TCO/ROI, receiving an A- grade in both, due to its business case documentation, strategic value, tools and costs. In Product Experience, it did well with a C++. AWS was a Leader in Reliability with A- grade due to its commitment to technology architecture and operations and scalability. 

In the Data Orchestration Buyers Guide, our analysis classified AWS as Exemplary, receiving an overall grade of B+ with a 71.8% performance. AWS’ best grouped results came in Customer Experience at 86.0% performance and an A- grade due in part to receiving an A- in both TCO/ROI and Validation. In Product Experience, AWS received a B grade with a 68.0% performance due to its 85.6% performance in Reliability. AWS was designated a Leader in Customer Experience and Reliability. AWS did not participate in the RFI process. 

AWS’ B grade in Product Experience was impacted by its C++ in Usability where it could improve accessibility and intelligence. Customer Experience was impacted by its A- grade in Validation where it could improve references and case studies, as well as information related to sales and onboarding.  

AWS performed best in Customer Experience with an A- grade, notably in TCO/ROI where it received an A- due to its articulation of strategic value and documentation and tools to help customers calculate costs. In Reliability, scalability, performance and continuity are strengths. AWS’ focus on configuration and APIs led to its B+ grade in Adaptability. 

In the Data Pipelines Buyers Guide, our analysis classified AWS as Exemplary, receiving an overall grade of B+ with a 69.6% performance. AWS’ best grouped results came in Customer Experience with a 86.0% performance and A- grade due in part to its A- in both TCO/ROI and Validation. In Product Experience, AWS received a B with a 65.2% performance due to its 85.6% performance in Reliability. AWS was designated a Leader in Customer Experience and Reliability. AWS did not participate in the RFI process. 

AWS’ B grade in Product Experience was impacted by its B- in Capability where it could enhance pipeline testing and deployment. Customer Experience was impacted by its A- grade in Validation where it could provide more in-depth information in relation to sales and onboarding as well as references and case studies.  

AWS performed best in Customer Experience with an A- grade, notably in TCO/ROI where it received an A- due to its documentation and tools to facilitate the understanding of costs and strategic value. In Reliability, performance, scalability and continuity were strengths. AWS’ privacy and security focus led to its B++ in Manageability. 

AWS did not meet the inclusion criteria for the Data Observability Buyers Guide and thus was not included.  

This assessment was based on Amazon Managed Workflows for Apache Airflow, Version 2.5.1, released January 2023; AWS Glue, Version 4.0, released January 2023.  

This research-based guide is the most comprehensive assessment of the value of DataOps software in the industry. Technology buyers can learn more about how to use our Buyers Guide by clicking here and included vendors that wish to learn more can click here. Click below to read the individual reports: 

DataOps Buyers Guide 

Data Observability Buyers Guide 

Data Orchestration Buyers Guide 

Data Pipelines Buyers Guide