AWS Machine Learning Blog

FEBRUARY 28, 2024

Structured Query Language (SQL) is a complex language that requires an understanding of databases and metadata. The solution in this post aims to bring enterprise analytics operations to the next level by shortening the path to your data using natural language. Today, generative AI can enable people without SQL knowledge.

Metadata 111

Metadata LLM Generative AI NLP 111

AWS Machine Learning Blog

DECEMBER 13, 2023

ML operations, known as MLOps, focus on streamlining, automating, and monitoring ML models throughout their lifecycle. Data scientists, ML engineers, IT staff, and DevOps teams must work together to operationalize models from research to deployment and maintenance.

ML 100

ML Automation Metadata Software Development 100

AWS Machine Learning Blog

OCTOBER 20, 2023

Data scientists search and pull features from the central feature store catalog, build models through experiments, and select the best model for promotion. Data scientists create and share new features into the central feature store catalog for reuse.

ML 101

ML Data Scientist ML Engineer Data Science 101

The MLOps Blog

JANUARY 23, 2023

Came to ML from software. Founded neptune.ai , a modular MLOps component for ML metadata store , aka “experiment tracker + model registry”. Most of our customers are doing ML/MLOps at a reasonable scale, NOT at the hyperscale of big-tech FAANG companies. . – How about the ML engineer? Let me explain.

DevOps 59

DevOps Metadata Software Engineer Data Scientist 59

The MLOps Blog

JUNE 27, 2023

With built-in components and integration with Google Cloud services, Vertex AI simplifies the end-to-end machine learning process, making it easier for data science teams to build and deploy models at scale. Metaflow Metaflow helps data scientists and machine learning engineers build, manage, and deploy data science projects.

Machine Learning 134

Machine Learning Metadata Data Quality Data Scientist 134

The MLOps Blog

OCTOBER 3, 2023

So I was able to get from growth hacking to data analytics, then data analytics to data science, and then data science to MLOps. I switched from analytics to data science, then to machine learning, then to data engineering, then to MLOps. How do I get this model in production?

ML 52

ML Data Scientist Machine Learning Data Science 52

Viso.ai

MARCH 29, 2024

MLflow is an open-source platform designed to manage the entire machine learning lifecycle, making it easier for ML Engineers, Data Scientists, Software Developers, and everyone involved in the process. MLOps aims to automate and operationalize ML models, enabling smoother transitions to production and deployment.

Machine Learning 52

Machine Learning ML Automation Data Scientist 52

AWS Machine Learning Blog

MARCH 1, 2023

Solution overview The ML solution for LTV forecasting is composed of four components: the training dataset ETL pipeline, MLOps pipeline, inference dataset ETL pipeline, and ML batch inference. ML engineers no longer need to manage this training metadata separately.

Automation 87

Automation ETL Data Drift ML 87

AWS Machine Learning Blog

AUGUST 31, 2023

Model cards are intended to be a single source of truth for business and technical metadata about the model that can reliably be used for auditing and documentation purposes. Depending on your governance requirements, Data Science & Dev accounts can be merged into a single AWS account.

ML 91

ML Data Scientist Machine Learning Automation 91

AWS Machine Learning Blog

AUGUST 31, 2023

Model cards are intended to be a single source of truth for business and technical metadata about the model that can reliably be used for auditing and documentation purposes. Depending on your governance requirements, Data Science & Dev accounts can be merged into a single AWS account.

ML 52

ML Data Scientist Machine Learning Automation 52

The MLOps Blog

AUGUST 3, 2023

This is Piotr Niedźwiedź and Aurimas Griciūnas from neptune.ai , and you’re listening to ML Platform Podcast. Stefan is a software engineer, data scientist, and has been doing work as an ML engineer. As you’ve been running the ML data platform team, how do you do that? Stefan: Yeah.

ML 52

ML Data Scientist Software Engineer Machine Learning 52

AWS Machine Learning Blog

JUNE 14, 2023

SageMaker Projects helps organizations set up and standardize environments for automating different steps involved in an ML lifecycle. Although notebooks are helpful for model building and experimentation, a team of data scientists and ML engineers sharing code need a more scalable way to maintain code consistency and strict version control.

ML 77

ML Automation Data Scientist DevOps 77

AWS Machine Learning Blog

APRIL 19, 2024

environment: HF_MODEL_ID: databricks/dolly-v2-7b HF_TASK: text-generation apiVersion: sagemaker.services.k8s.aws/v1alpha1 kind: Model metadata: name: flan-t5-xxl spec: modelName: flan-t5-xxl executionRoleARN: containers: - image: 763104351884.dkr.ecr.us-east-1.amazonaws.com/huggingface-pytorch-tgi-inference:2.0.1-tgi0.9.3-gpu-py39-cu118-ubuntu20.04

Metadata 96

Metadata LLM Software Development Machine Learning 96

The MLOps Blog

MAY 9, 2023

One of the most prevalent complaints we hear from ML engineers in the community is how costly and error-prone it is to manually go through the ML workflow of building and deploying models. Building end-to-end machine learning pipelines lets ML engineers build once, rerun, and reuse many times. Kale v0.7.0.

ML 98

ML Machine Learning Metadata Automation 98

The MLOps Blog

MARCH 21, 2023

From gathering and processing data to building models through experiments, deploying the best ones, and managing them at scale for continuous value in production—it’s a lot. As the number of ML-powered apps and services grows, it gets overwhelming for data scientists and ML engineers to build and deploy models at scale.

Machine Learning 69

Machine Learning Data Scientist ML Metadata 69

AWS Machine Learning Blog

JANUARY 13, 2023

Enabling such a secure, compliant environment in the cloud within minutes relieves data scientists from the burden of handling cloud infrastructure, networking requirements, and security standards measures, to focus instead on the data science problem. The following diagram illustrates this architecture. Model deployment.

ML 75

ML Data Scientist Machine Learning Metadata 75