IBM Journey to AI blog

AUGUST 12, 2024

Driven by significant advancements in computing technology, everything from mobile phones to smart appliances to mass transit systems generate and digest data, creating a big data landscape that forward-thinking enterprises can leverage to drive innovation. However, the big data landscape is just that.

Big Data 278

Big Data DevOps Automation Machine Learning 278

ODSC - Open Data Science

JULY 19, 2023

Model Observability: To be effective at monitoring and identifying model and data drift there needs to be a way to capture and analyze the data, especially from the production system. We have implemented Azure Data Explorer (ADX) as a platform to ingest and analyze data. is modified to push the data into ADX.

Machine Learning 52

Machine Learning Data Drift Data Science ML Engineer 52

The MLOps Blog

JUNE 27, 2023

Databricks Databricks is a cloud-native platform for big data processing, machine learning, and analytics built using the Data Lakehouse architecture. Delta Lake Delta Lake is an open-source storage layer that provides reliability, ACID transactions, and data versioning for big data processing frameworks such as Apache Spark.

Metadata 134

Metadata Machine Learning Data Scientist Data Quality 134

AWS Machine Learning Blog

AUGUST 29, 2023

The proposed architecture for the batch inference pipeline uses Amazon SageMaker Model Monitor for data quality checks, while using custom Amazon SageMaker Processing steps for model quality check. Model approval After a newly trained model is registered in the model registry, the responsible data scientist receives a notification.

Data Scientist 85

Data Scientist Data Quality Python ML 85