AWS Machine Learning Blog

FEBRUARY 12, 2025

Machine learning (ML) engineers must make trade-offs and prioritize the most important factors for their specific use case and business requirements. Responsible AI Implementing responsible AI practices is crucial for maintaining ethical and safe deployment of RAG systems.

Auto-classification 83

Auto-classification Metadata Generative AI Machine Learning 83

AWS Machine Learning Blog

NOVEMBER 29, 2023

Since launching in June 2023, the AWS Generative AI Innovation Center team of strategists, data scientists, machine learning (ML) engineers, and solutions architects have worked with hundreds of customers worldwide, and helped them ideate, prioritize, and build bespoke solutions that harness the power of generative AI.

Generative AI 104

Generative AI Prompt Engineering Prompt Engineer Machine Learning 104

AWS Machine Learning Blog

DECEMBER 9, 2024

MLflow , a popular open-source tool, helps data scientists organize, track, and analyze ML and generative AI experiments, making it easier to reproduce and compare results. Amazon SageMaker with MLflow is a capability in SageMaker that enables users to create, manage, analyze, and compare their ML experiments seamlessly.

ML 90

ML Data Scientist Machine Learning Software Engineer 90

AWS Machine Learning Blog

JUNE 19, 2024

About the Authors Rushabh Lokhande is a Senior Data & ML Engineer with AWS Professional Services Analytics Practice. He helps customers implement big data, machine learning, analytics solutions, and generative AI solutions. Outside of work, he enjoys spending time with family, reading, running, and playing golf.

ML Engineer 99

ML Engineer Generative AI Big Data ML 99

Towards AI

JANUARY 6, 2025

AI engineering professional certificate by IBM AI engineering professional certificate from IBM targets fundamentals of machine learning, deep learning, programming, computer vision, NLP, etc. You shall build competence in NLP solutions, programming languages, responsible AI principles, etc.

Artificial Intelligence 105

Artificial Intelligence Artificial Intelligence Computer Vision Deep Learning 105

AWS Machine Learning Blog

MAY 9, 2024

Governance Establish governance that enables the organization to scale value delivery from AI/ML initiatives while managing risk, compliance, and security. Additionally, pay special attention to the changing nature of the risk and cost that is associated with the development as well as the scaling of AI.

ML 128

ML Generative AI AI AI 128

AWS Machine Learning Blog

OCTOBER 2, 2024

It’s a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like Anthropic, Cohere, Meta, Mistral AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

Generative AI 119

Generative AI Data Ingestion AI AI 119

ODSC - Open Data Science

FEBRUARY 25, 2025

Topics Include: Agentic AI DesignPatterns LLMs & RAG forAgents Agent Architectures &Chaining Evaluating AI Agent Performance Building with LangChain and LlamaIndex Real-World Applications of Autonomous Agents Who Should Attend: Data Scientists, Developers, AI Architects, and ML Engineers seeking to build cutting-edge autonomous systems.

Data Scientist 52

Data Scientist Machine Learning Large Language Models ML Engineer 52

AWS Machine Learning Blog

MARCH 14, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon via a single API, along with a broad set of capabilities you need to build generative AI applications with security, privacy, and responsible AI.

Generative AI 124

Generative AI LLM AI AI 124

AWS Machine Learning Blog

NOVEMBER 14, 2024

Use case and model governance plays a crucial role in implementing responsible AI and helps with the reliability, fairness, compliance, and risk management of ML models across use cases in the organization. It helps prevent biases, manage risks, protect against misuse, and maintain transparency.

ML 93

ML Machine Learning Auto-complete Auto-classification 93

AWS Machine Learning Blog

NOVEMBER 30, 2023

It also integrates with Machine Learning and Operation (MLOps) workflows in Amazon SageMaker to automate and scale the ML lifecycle. FMEval provides the ability to perform evaluations for both LLM model endpoints or the endpoint for a generative AI service as a whole. What is FMEval? In his spare time, he loves traveling and writing.

Large Language Models 109

Large Language Models Algorithm LLM Responsible AI 109

AWS Machine Learning Blog

AUGUST 4, 2023

SageMaker Projects provides a straightforward way to set up and standardize the development environment for data scientists and ML engineers to build and deploy ML models on SageMaker. With her customer-first approach, Mani helps strategic customers shape their AI/ML strategy, fuel innovation, and accelerate their AI/ML journey.

Data Scientist 88

Data Scientist ML ETL Data Platform 88

AWS Machine Learning Blog

FEBRUARY 12, 2025

About the authors Daniel Zagyva is a Senior ML Engineer at AWS Professional Services. His experience extends across different areas, including natural language processing, generative AI and machine learning operations. Laurens van der Maas is a Machine Learning Engineer at AWS Professional Services.

LLM 77

LLM ML Natural Language Processing Machine Learning 77

AWS Machine Learning Blog

OCTOBER 15, 2024

Bria’s commitment to responsible AI and the robust security framework of SageMaker provide enterprises with the full package for data privacy, regulatory compliance, and responsible AI models for commercial use. About the Authors Bar Fingerman is the Head of AI/ML Engineering at Bria.

Generative AI 81

Generative AI ML Python Responsible AI 81

The MLOps Blog

JUNE 27, 2023

Collaborative workflows : Dataset storage and versioning tools should support collaborative workflows, allowing multiple users to access and contribute to datasets simultaneously, ensuring efficient collaboration among ML engineers, data scientists, and other stakeholders.

Machine Learning 134

Machine Learning Metadata Data Scientist Data Quality 134

AWS Machine Learning Blog

MAY 13, 2024

This is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading artificial intelligence (AI) companies like AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon through a single API. He has two graduate degrees in physics and a doctorate in engineering.

Generative AI 128

Generative AI Prompt Engineering Prompt Engineer LLM 128

ODSC - Open Data Science

JULY 19, 2023

Machine Learning Operations (MLOps) can significantly accelerate how data scientists and ML engineers meet organizational needs. A well-implemented MLOps process not only expedites the transition from testing to production but also offers ownership, lineage, and historical data about ML artifacts used within the team.

Machine Learning 52

Machine Learning Data Drift Data Science Data Scientist 52

AWS Machine Learning Blog

AUGUST 1, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading artificial intelligence (AI) companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API.

Generative AI 121

Generative AI Machine Learning Artificial Intelligence Artificial Intelligence 121

AWS Machine Learning Blog

FEBRUARY 12, 2024

The Ranking team at Booking.com learned that migrating to the cloud and SageMaker has proved beneficial, and that adapting machine learning operations (MLOps) practices allows their ML engineers and scientists to focus on their craft and increase development velocity. Daniel Zagyva is a Data Scientist at AWS Professional Services.

ML 131

ML Explainability Machine Learning Deep Learning 131

ODSC - Open Data Science

JANUARY 10, 2024

In this talk, you’ll explore the need for adopting responsible AI principles when developing and deploying large language models (LLMs) and other generative AI models, and provide a roadmap for thinking about responsible AI for generative AI in practice through real-world LLM use cases.

Large Language Models 52

Large Language Models Deep Learning LLM Data Science 52

Pickl AI

JULY 14, 2023

Researchers began addressing the need for Explainable AI (XAI) to make AI systems more understandable and interpretable. Ethical considerations, such as bias mitigation, privacy protection, and responsible AI deployment, gained prominence. The average salary of a ML Engineer per annum is $125,087.

Neural Network 52

Neural Network Software Engineer Artificial Intelligence Artificial Intelligence 52

Viso.ai

FEBRUARY 12, 2024

By understanding what goes under the hood with Explainable AI, data teams are better equipped to improve and maintain model performance, and reliability. Error Detection and Debugging: A major challenge ML engineers face is debugging complex models with millions of parameters.

Explainable AI 52

Explainable AI Explainability Deep Learning Neural Network 52

AWS Machine Learning Blog

JANUARY 26, 2024

Being aware of risks fosters transparency and trust in generative AI applications, encourages increased observability, helps to meet compliance requirements, and facilitates informed decision-making by leaders. Learn more about our commitment to Responsible AI and additional responsible AI resources to help our customers.

Generative AI 137

Generative AI ML LLM AI 137

Unite.AI

FEBRUARY 22, 2024

In the rapidly evolving realm of modern technology, the concept of ‘ Responsible AI ’ has surfaced to address and mitigate the issues arising from AI hallucinations , misuse and malicious human intent. Bias and Fairness : Ensuring Ethicality in AI Responsible AI demands fairness and impartiality.

Responsible AI 279

Responsible AI Explainability AI AI 279

The MLOps Blog

MARCH 21, 2023

As the number of ML-powered apps and services grows, it gets overwhelming for data scientists and ML engineers to build and deploy models at scale. In this comprehensive guide, we’ll explore everything you need to know about machine learning platforms, including: Components that make up an ML platform.

Machine Learning 69

Machine Learning Data Scientist ML Metadata 69

AWS Machine Learning Blog

NOVEMBER 29, 2023

An evaluation is a task used to measure the quality and responsibility of output of an LLM or generative AI service. Furthermore, evaluating LLMs can also help mitigating security risks, particularly in the context of prompt data tampering.

LLM 105

LLM Data Scientist Algorithm Generative AI 105

AWS Machine Learning Blog

SEPTEMBER 12, 2024

We all need to be able to unlock generative AI’s full potential while mitigating its risks. It should be easy to implement safeguards for your generative AI applications, customized to your requirements and responsible AI policies. Guardrails can help block specific words or topics.

Generative AI 92

Generative AI AI AI ML 92

AWS Machine Learning Blog

DECEMBER 17, 2024

Amazon SageMaker helps data scientists and machine learning (ML) engineers build FMs from scratch, evaluate and customize FMs with advanced techniques, and deploy FMs with fine-grain controls for generative AI use cases that have stringent requirements on accuracy, latency, and cost.

LLM 94

LLM Prompt Engineer Prompt Engineering Generative AI 94

AWS Machine Learning Blog

DECEMBER 4, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) along with a broad set of capabilities to build generative AI applications, simplifying development with security, privacy, and responsible AI.

Metadata 114

Metadata Generative AI Categorization Data Scientist 114

AWS Machine Learning Blog

OCTOBER 11, 2024

Isaac Privitera is a Principal Data Scientist with the AWS Generative AI Innovation Center, where he develops bespoke generative AI-based solutions to address customers’ business problems. His primary focus lies in building responsible AI systems, using techniques such as RAG, multi-agent systems, and model fine-tuning.

Metadata 102

Metadata Generative AI LLM Data Ingestion 102

AWS Machine Learning Blog

DECEMBER 2, 2024

This dramatic improvement in loading speed opens up new possibilities for responsive AI systems, potentially enabling faster scaling and more dynamic applications that can adapt quickly to changing demands. During our performance testing we were able to load the llama-3.1-70B 70B model on an ml.p4d.24xlarge

Large Language Models 103

Large Language Models Auto-complete Machine Learning LLM 103

AWS Machine Learning Blog

NOVEMBER 18, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

LLM 99

LLM Generative AI Data Science Data Scientist 99