IBM Journey to AI blog

JANUARY 5, 2023

The first generation of data architectures represented by enterprise data warehouse and business intelligence platforms were characterized by thousands of ETL jobs, tables, and reports that only a small group of specialized data engineers understood, resulting in an under-realized positive impact on the business.

Data Quality 130

Data Quality Metadata ETL Big Data 130

IBM Journey to AI blog

JANUARY 18, 2023

Data platform architecture has an interesting history. A read-optimized platform that can integrate data from multiple applications emerged. In another decade, the internet and mobile started the generate data of unforeseen volume, variety and velocity. It required a different data platform solution.

Data Platform 130

Data Platform ETL Metadata Data Discovery 130

The MLOps Blog

JANUARY 26, 2024

A feature store is a data platform that supports the creation and use of feature data throughout the lifecycle of an ML model, from creating features that can be reused across many models to model training to model inference (making predictions). It can also transform incoming data on the fly. What is a feature store?

Machine Learning 73

Machine Learning Metadata ML Python 73

IBM Journey to AI blog

JULY 17, 2023

foundation models to help users discover, augment, and enrich data with natural language. Watsonx.data is built on 3 core integrated components: multiple query engines, a catalog that keeps track of metadata, and storage and relational data sources which the query engines directly access.

Machine Learning 168

Machine Learning AI AI Automation 168

The MLOps Blog

MAY 31, 2023

You may also like Building a Machine Learning Platform [Definitive Guide] Consideration for data platform Setting up the Data Platform in the right way is key to the success of an ML Platform. In the following sections, we will discuss best practices while setting up a Data Platform for Retail.

ML 59

ML Algorithm Data Drift Data Platform 59

Artificial Corner

JUNE 6, 2023

Cloud-based data storage solutions, such as Amazon S3 (Simple Storage Service) and Google Cloud Storage, provide highly durable and scalable repositories for storing large volumes of data. Delta Lake provides ACID transactions, scalable metadata handling, and unifies streaming and batch data processing. Morgan Kaufmann.

Data Mining 52

Data Mining Big Data ETL Machine Learning 52

The MLOps Blog

AUGUST 3, 2023

Stefan is a software engineer, data scientist, and has been doing work as an ML engineer. He also ran the data platform in his previous company and is also co-creator of open-source framework, Hamilton. As you’ve been running the ML data platform team, how do you do that? Stefan: Yeah. Thanks for having me.

ML 52

ML Data Scientist Software Engineer Machine Learning 52