AWS Machine Learning Blog

OCTOBER 22, 2024

Amazon SageMaker is a cloud-based machine learning (ML) platform within the AWS ecosystem that offers developers a seamless and convenient way to build, train, and deploy ML models. He focuses on architecting and implementing large-scale generative AI and classic ML pipeline solutions.

ML Engineer 109

ML Engineer Data Scientist Machine Learning ML 109

AWS Machine Learning Blog

APRIL 2, 2025

The goal of this blog post is to show you how a large language model (LLM) can be used to perform tasks that require multi-step dynamic reasoning and execution. Fig 1: Simple execution flow solution overview In a more complex scheme, you can add multiple layers of validation and provide relevant APIs to increase the success rate of the LLM.

Large Language Models 102

Large Language Models LLM Machine Learning Big Data 102

BAIR

MARCH 11, 2024

Currently, I am working on Large Language Model (LLM) based autonomous agents. I have previously worked on sequence models for DNA and RNA, and benchmarks for evaluating the interpretability and fairness of ML models across domains. Specifically, I work on methods that algorithmically generates diverse training environments (i.e.,

Robotics 337

Robotics Natural Language Processing Machine Learning Deep Learning 337

Towards AI

NOVEMBER 8, 2024

Edited Photo by Taylor Vick on Unsplash In ML engineering, data quality isn’t just critical — it’s foundational. Yet, this perspective often gets sidelined and there was never a consensus in the ML community about it. Because of how ML practitioners were initially trained. That early obsession with algorithms was vital.

LLM 126

LLM ML Engineer Data Quality Data Scientist 126

AWS Machine Learning Blog

MARCH 18, 2025

This transcription then serves as the input for a powerful LLM, which draws upon its vast knowledge base to provide personalized, context-aware responses tailored to your specific situation. LLM integration The preprocessed text is fed into a powerful LLM tailored for the healthcare and life sciences (HCLS) domain.

LLM 109

LLM NLP Data Integration AI 109

AWS Machine Learning Blog

DECEMBER 2, 2024

This enhancement allows customers running high-throughput production workloads to handle sudden traffic spikes more efficiently, providing more predictable scaling behavior and minimal impact on end-user latency across their ML infrastructure, regardless of the chosen inference framework.

Generative AI 99

Generative AI Machine Learning Large Language Models ML Engineer 99

AWS Machine Learning Blog

OCTOBER 16, 2024

Amazon SageMaker supports geospatial machine learning (ML) capabilities, allowing data scientists and ML engineers to build, train, and deploy ML models using geospatial data. SageMaker Processing provisions cluster resources for you to run city-, country-, or continent-scale geospatial ML workloads.

Machine Learning 108

Machine Learning ML Data Scientist Robotics 108

AWS Machine Learning Blog

JULY 24, 2024

Large language models (LLMs) have achieved remarkable success in various natural language processing (NLP) tasks, but they may not always generalize well to specific domains or tasks. You may need to customize an LLM to adapt to your unique use case, improving its performance on your specific dataset or task.

LLM 127

LLM ML Generative AI Machine Learning 127

AWS Machine Learning Blog

MAY 9, 2024

The rapid advancements in artificial intelligence and machine learning (AI/ML) have made these technologies a transformative force across industries. An effective approach that addresses a wide range of observed issues is the establishment of an AI/ML center of excellence (CoE). What is an AI/ML CoE?

ML 130

ML Generative AI AI AI 130

ODSC - Open Data Science

APRIL 2, 2025

Whether an engineer is cleaning a dataset, building a recommendation engine, or troubleshooting LLM behavior, these cognitive skills form the bedrock of effective AI development. Engineers who can visualize data, explain outputs, and align their work with business objectives are consistently more valuable to theirteams.

Prompt Engineering 52

Prompt Engineering Prompt Engineer Large Language Models ML Engineer 52

Marktechpost

JUNE 14, 2024

Recently, Yandex has introduced a new solution: YaFSDP, an open-source tool that promises to revolutionize LLM training by significantly reducing GPU resource consumption and training time. ML engineers can leverage this tool to enhance the efficiency of their LLM training processes. Check out the GitHub Page.

LLM 120

LLM AI Tools Large Language Models ML Engineer 120

AWS Machine Learning Blog

FEBRUARY 11, 2025

Get started with SageMaker JumpStart SageMaker JumpStart is a machine learning (ML) hub that can help accelerate your ML journey. Marc Karp is an ML Architect with the Amazon SageMaker Service team. He focuses on helping customers design, deploy, and manage ML workloads at scale.

ML 81

ML Machine Learning Python Computer Vision 81

AWS Machine Learning Blog

APRIL 7, 2025

This post explores how Amazon SageMaker AI with MLflow can help you as a developer and a machine learning (ML) practitioner efficiently experiment, evaluate generative AI agent performance, and optimize their applications for production readiness. You can follow this example by running the code in the same aws-samples GitHub repository.

Generative AI 64

Generative AI AI AI LLM 64

Marktechpost

DECEMBER 1, 2024

It supports multiple LLM providers, making it compatible with a wide array of hosted and local models, including OpenAI’s models, Anthropic’s Claude, and Google Gemini. This combination of technical depth and usability lowers the barrier for data scientists and ML engineers to generate synthetic data efficiently.

Python 90

Python LLM Data Scarcity Data Scientist 90

Snorkel AI

MARCH 20, 2025

GenAI evaluation with SME-evaluator agreement AI/ML engineers develop specialized evaluators with ground truth. Lets consider an LLM-as-a-Judge (LLMAJ) which checks to see if an AI assistant has repeated itself. Its far more likely that the AI/ML engineer needs to go back and continue iterating on the prompt.

ML Engineer 52

ML Engineer Automation Prompt Engineer Prompt Engineering 52

ODSC - Open Data Science

APRIL 1, 2025

Building Multimodal AI Agents: Agentic RAG with Image, Text, and Audio Inputs Suman Debnath, Principal AI/ML Advocate at Amazon Web Services Discover the transformative potential of Multimodal Agentic RAG systems that integrate image, audio, and text to power intelligent, real-world applications.

Neural Network 52

Neural Network LLM Software Engineer AI 52

Marktechpost

JANUARY 8, 2025

This innovative system employs large language models (LLMs) to streamline key stages of research, including literature review, experimentation, and report writing. Dont Forget to join our 60k+ ML SubReddit. Agent Laboratory comprises a pipeline of specialized agents tailored to specific research tasks.

LLM 92

LLM Large Language Models Automation ML Engineer 92

ODSC - Open Data Science

MARCH 10, 2025

Building Multimodal AI Agents: Agentic RAG with Vision-Language Models Suman Debnath, Principal AI/ML Advocate at Amazon WebServices Building a truly intelligent AI assistant requires overcoming the limitations of native Retrieval-Augmented Generation (RAG) models, especially when handling diverse data types like text, tables, and images.

Data Scientist 52

Data Scientist Data Science LLM Machine Learning 52

Towards AI

JANUARY 30, 2024

The Top Secret Behind Effective LLM Training in 2024 Large-scale unsupervised language models (LMs) have shown remarkable capabilities in understanding and generating human-like text. ML Engineers(LLM), Tech Enthusiasts, VCs, etc. Anybody previously acquainted with ML terms should be able to follow along.

Explainability 111

Explainability ML Engineer LLM ML 111

Marktechpost

MAY 30, 2024

Introduction to AI and Machine Learning on Google Cloud This course introduces Google Cloud’s AI and ML offerings for predictive and generative projects, covering technologies, products, and tools across the data-to-AI lifecycle. It includes labs on feature engineering with BigQuery ML, Keras, and TensorFlow.

Artificial Intelligence 131

Artificial Intelligence Artificial Intelligence BERT Computer Vision 131

AWS Machine Learning Blog

APRIL 19, 2024

About the Authors Rajesh Ramchander is a Principal ML Engineer in Professional Services at AWS. He helps customers at various stages in their AI/ML and GenAI journey, from those that are just getting started all the way to those that are leading their business with an AI-first strategy.

Metadata 122

Metadata LLM Software Development Machine Learning 122

Bugra Akyildiz

JULY 20, 2024

Libraries STORM(Synthesis of Topic Outlines through Retrieval and Multi-perspective Question Asking) is a LLM system that writes Wikipedia-like articles from scratch based on Internet search. local-gemma provides an easy way to run Gemma-2 locally directly from your CLI (or via a Python library) and fast. Hardware: Trained on H100 GPUs

ML Engineer 52

ML Engineer ML Neural Network Algorithm 52

Towards AI

FEBRUARY 18, 2025

AI agents, on the other hand, hold a lot of promise but are still constrained by the reliability of LLM reasoning. From an engineering perspective, the core challenge for both lies in improving accuracy and reliability to meet real-world business requirements. They also inspired a bunch of new potentials for ML engineers.

ML Engineer 100

ML Engineer LLM Data Quality Algorithm 100

Flipboard

JUNE 20, 2023

Machine learning (ML) engineers have traditionally focused on striking a balance between model training and deployment cost vs. performance. This is important because training ML models and then using the trained models to make predictions (inference) can be highly energy-intensive tasks.

Machine Learning 123

Machine Learning BERT Deep Learning ML Engineer 123

AWS Machine Learning Blog

FEBRUARY 26, 2024

Our proposed architecture provides a scalable and customizable solution for online LLM monitoring, enabling teams to tailor your monitoring solution to your specific use cases and requirements. We suggest that each module take incoming inference requests to the LLM, passing prompt and completion (response) pairs to metric compute modules.

Large Language Models 135

Large Language Models LLM Big Data Machine Learning 135

AWS Machine Learning Blog

MARCH 14, 2024

We formulated a text-to-SQL approach where by a user’s natural language query is converted to a SQL statement using an LLM. This data is again provided to an LLM, which is asked to answer the user’s query given the data. The relevant information is then provided to the LLM for final response generation.

Generative AI 126

Generative AI LLM AI AI 126

Snorkel AI

MARCH 18, 2025

However, when evaluations provide deep insights into the behavior of GenAI applications, AI/ML engineers can quickly identify what improvements are needed and correctly determine the best way to implement them resulting in a much faster, and far more efficient, GenAI development process.

ML Engineer 52

ML Engineer LLM AI AI 52

Unite.AI

FEBRUARY 28, 2024

Attackers may attempt to fine-tune surrogate models using queries to the target LLM to reverse-engineer its knowledge. Adversaries can also attempt to breach cloud environments hosting LLMs to sabotage operations or exfiltrate data. Stolen models also create additional attack surface for adversaries to mount further attacks.

Large Language Models 162

Large Language Models Machine Learning LLM Neural Network 162

AWS Machine Learning Blog

MARCH 13, 2024

The LLM analysis provides a violation result (Y or N) and explains the rationale behind the model’s decision regarding policy violation. The audio moderation workflow activates the LLM’s policy evaluation only when the toxicity analysis exceeds a set threshold. LLMs, in contrast, offer a high degree of flexibility.

Natural Language Processing 132

Natural Language Processing LLM Prompt Engineer Prompt Engineering 132

AWS Machine Learning Blog

MAY 13, 2024

In part 1 of this blog series, we discussed how a large language model (LLM) available on Amazon SageMaker JumpStart can be fine-tuned for the task of radiology report impression generation. We also explore the utility of the RAG prompt engineering technique as it applies to the task of summarization.

Generative AI 130

Generative AI Prompt Engineer Prompt Engineering LLM 130

The MLOps Blog

JULY 4, 2024

They enable efficient context retrieval or dynamic few-shot prompting to improve the factual accuracy of LLM-generated responses. Use re-ranking or contextual compression techniques to ensure only the most relevant information is provided to the LLM, improving response accuracy and reducing cost.

LLM 64

LLM Large Language Models Machine Learning Explainability 64

AWS Machine Learning Blog

AUGUST 22, 2024

You can use Amazon SageMaker Model Building Pipelines to collaborate between multiple AI/ML teams. SageMaker Pipelines You can use SageMaker Pipelines to define and orchestrate the various steps involved in the ML lifecycle, such as data preprocessing, model training, evaluation, and deployment. We use Python to do this.

Generative AI 122

Generative AI Metadata Python ML 122

Snorkel AI

OCTOBER 27, 2023

Snorkel AI held its Enterprise LLM Virtual Summit on October 26, 2023, drawing an engaged crowd of more than 1,000 attendees across three hours and eight sessions that featured 11 speakers. How to fine-tune and customize LLMs Hoang Tran, ML Engineer at Snorkel AI, outlined how he saw LLMs creating value in enterprise environments.

LLM 69

LLM Data Scientist Machine Learning Large Language Models 69

AWS Machine Learning Blog

JANUARY 10, 2024

Specialist Data Engineering at Merck, and Prabakaran Mathaiyan, Sr. ML Engineer at Tiger Analytics. The large machine learning (ML) model development lifecycle requires a scalable model release process similar to that of software development. The input to the training pipeline is the features dataset.

ML 124

ML Machine Learning Data Scientist ETL 124

Marktechpost

OCTOBER 11, 2023

The team started with a collection of 15 ML engineering projects spanning various fields, with experiments that are quick and cheap to run. At a high level, they simply ask the LLMs to take the next action, using a prompt that is automatically produced based on the available information about the task and previous steps.

Machine Learning 104

Machine Learning AI Research AI Researcher Convolutional Neural Networks 104

Towards AI

MAY 30, 2024

Building LLMs for Production: Enhancing LLM Abilities and Reliability with Prompting, Fine-Tuning, and RAG” is now available on Amazon! The application topics include prompting, RAG, agents, fine-tuning, and deployment — all essential topics in an AI Engineer’s toolkit.” The defacto manual for AI Engineering.

Prompt Engineer 108

Prompt Engineer Prompt Engineering LLM NLP 108

AWS Machine Learning Blog

SEPTEMBER 1, 2023

Furthermore, we deep dive on the most common generative AI use case of text-to-text applications and LLM operations (LLMOps), a subset of FMOps. The ML consumers are other business stakeholders who use the inference results (predictions) to drive decisions. The following figure illustrates the topics we discuss.

Generative AI 125

Generative AI Prompt Engineer Prompt Engineering ML 125