I previously explained that data observability software has become a critical component of data-driven decision-making. Data observability addresses one of the most significant impediments to generating value from data by providing an environment for monitoring the quality and reliability of data on a continual basis. Maintaining quality and trust is a perennial data management challenge, the importance of which has come into sharper focus in recent years thanks to the rise of artificial...
Read More
Topics:
AI,
data operations,
Machine Learning Operations,
Analytics and Data
The adoption of cloud environments for analytic workloads has been a key feature of the data platforms sector in recent years. For two-thirds (66%) of participants in ISG’s Data Lake Dynamic Insights Research, the primary data platform used for analytics is cloud based. Many enterprises adopted cloud-based analytic data platforms with a view to improving operational efficiencies by reducing the need for upfront investment in physical infrastructure as well as the ability to scale cloud services...
Read More
Topics:
data operations,
Data Platforms,
Analytics and Data
I previously wrote about the importance of open table formats to the evolution of data lakes into data lakehouses. The concept of the data lake was initially proposed as a single environment where data could be combined from multiple sources to be stored and processed to enable analysis by multiple users for multiple purposes.
Read More
Topics:
Data Platforms,
Analytics & Data,
Streaming Data & Events
Although the terms data fabric and data mesh are often used interchangeably, I previously explained that they are distinct but complementary. Data fabric refers to technology products that can be used to integrate, manage and govern data across distributed environments, supporting the cultural and organizational data ownership and access goals of data mesh. Data fabric and data mesh are also both related to logical data management, which is the approach of providing virtualized access to data...
Read More
Topics:
Data Intelligence,
Analytics and Data
As I noted in the 2024 Buyers Guide for Operational Data Platforms, intelligent applications powered by artificial intelligence have impacted the requirements for operational data platforms. These applications, infused with contextually relevant recommendations, predictions and forecasting, are driven by machine learning and generative AI.
Read More
Topics:
Data Platforms,
Analytics & Data
As I recently noted, the term “data intelligence” has been used by multiple providers across analytics and data for several years and is becoming more widespread as software providers respond to the need to provide enterprises with a holistic view of data production and consumption. I assert that through 2027, three-quarters of enterprises will be engaged in data intelligence initiatives to increase trust in their data by leveraging metadata to understand how, when and where data is used in...
Read More
Topics:
Data Intelligence,
Analytics and Data
I previously wrote about data mesh as a cultural and organizational approach to distributed data processing. Data mesh has four key principles—domain-oriented ownership, data as a product, self-serve data infrastructure and federated governance—each of which is being widely adopted. I assert that by 2027, more than 6 in 10 enterprises will adopt technologies to facilitate the delivery of data as a product as they adapt their cultural and organizational approaches to data ownership in the...
Read More
Topics:
data operations,
Analytics and Data
As I explained in our recent Buyers Guide for Data Platforms, the popularization of generative artificial intelligence (GenAI) has had a significant impact on the requirements for data platforms in the last 18 months. While there is an ongoing need for data platforms to support data warehousing workloads involving analytic reports and dashboards, there is increasing demand for analytic data platform providers to add dedicated functionality for data engineering, including the development,...
Read More
Topics:
Analytics,
natural language processing,
Data Platforms,
AI and Machine Learning,
Generative AI,
Model Building and Large Language Models,
Machine Learning Operations
The final of the men’s 100 meters at the Paris Olympics this summer was a reminder that being successful requires not just being fast but performing at the right time. Being fast is obviously a prerequisite for participating in an Olympic 100-meter final, and all the competitors finished the race in under 10 seconds, with just 0.12 seconds separating the first man from the last. While all the athletes were fast, what separated the winner of the gold medal—USA’s Noah Lyles—was execution. He was ...
Read More
Topics:
Analytics & Data,
Streaming Data & Events
Enterprises face a bewildering level of choice in relation to data platforms, as evidenced by the number of software providers and products assessed in our recent Data Platforms Buyers Guide. There are numerous data platform providers and products to choose from, but also a diverse array of functional and architectural options. Is the workload primarily operational or analytic? Will it be deployed on-premises or in the cloud? Should it be distributed or centralized? Data warehouse or data...
Read More
Topics:
Data Platforms,
AI and Machine Learning,
Data Intelligence,
Analytics and Data