Large Language Models, LLM and ML Engineer - Artificial Intelligence Zone

Track LLM model evaluation using Amazon SageMaker managed MLflow and FMEval

AWS Machine Learning Blog

JANUARY 28, 2025

Evaluating large language models (LLMs) is crucial as LLM-based systems become increasingly powerful and relevant in our society. Rigorous testing allows us to understand an LLMs capabilities, limitations, and potential biases, and provide actionable feedback to identify and mitigate risk.

LLM

LLM Large Language Models ML Algorithm

The Vulnerabilities and Security Threats Facing Large Language Models

Unite.AI

FEBRUARY 28, 2024

Large language models (LLMs) like GPT-4, DALL-E have captivated the public imagination and demonstrated immense potential across a variety of applications. In this post, we will explore the attack vectors threat actors could leverage to compromise LLMs and propose countermeasures to bolster their security.

Large Language Models

Large Language Models Machine Learning LLM Neural Network

Top Large Language Models LLMs Courses

Marktechpost

JULY 25, 2024

Large Language Models (LLMs) have revolutionized AI with their ability to understand and generate human-like text. Learning about LLMs is essential to harness their potential for solving complex language tasks and staying ahead in the evolving AI landscape.

Large Language Models

Large Language Models Prompt Engineer Prompt Engineering Chatbots

Webinars

AI for Paralegals: Everything You Need to Know (and How to Use It Safely)

The Intersection of AI and Sales: Personalization Without Compromise

How to Achieve High-Accuracy Results When Using LLMs

Beyond the Buzz: How to Turn Marketing Trends into Revenue-Driving Strategies

MORE WEBINARS

Techniques and approaches for monitoring large language models on AWS

AWS Machine Learning Blog

FEBRUARY 26, 2024

Large Language Models (LLMs) have revolutionized the field of natural language processing (NLP), improving tasks such as language translation, text summarization, and sentiment analysis. Monitoring the performance and behavior of LLMs is a critical task for ensuring their safety and effectiveness.

Large Language Models

Large Language Models LLM Big Data Machine Learning

LLM continuous self-instruct fine-tuning framework powered by a compound AI system on Amazon SageMaker

AWS Machine Learning Blog

FEBRUARY 21, 2025

Fine-tuning a pre-trained large language model (LLM) allows users to customize the model to perform better on domain-specific tasks or align more closely with human preferences. Continuous fine-tuning also enables models to integrate human feedback, address errors, and tailor to real-world applications.

LLM

LLM AI AI Data Scientist

Achieve ~2x speed-up in LLM inference with Medusa-1 on Amazon SageMaker AI

AWS Machine Learning Blog

FEBRUARY 12, 2025

Large language models (LLMs) have revolutionized the field of natural language processing with their ability to understand and generate humanlike text. Researchers developed Medusa , a framework to speed up LLM inference by adding extra heads to predict multiple tokens simultaneously.

LLM

LLM ML Natural Language Processing Machine Learning

Yandex Introduces YaFSDP: An Open-Source AI Tool that Promises to Revolutionize LLM Training by Cutting GPU Usage by 20%

Marktechpost

JUNE 14, 2024

Developing large language models requires substantial investments in time and GPU resources, translating directly into high costs. The larger the model, the more pronounced these challenges become. ML engineers can leverage this tool to enhance the efficiency of their LLM training processes.

LLM

LLM AI Tools Large Language Models ML Engineer

LLM experimentation at scale using Amazon SageMaker Pipelines and MLflow

AWS Machine Learning Blog

JULY 24, 2024

Large language models (LLMs) have achieved remarkable success in various natural language processing (NLP) tasks, but they may not always generalize well to specific domains or tasks. You may need to customize an LLM to adapt to your unique use case, improving its performance on your specific dataset or task.

LLM

LLM ML Generative AI Machine Learning

12 Can’t-Miss Hands-on Training & Workshops Coming to ODSC East 2025

ODSC - Open Data Science

MARCH 10, 2025

Beyond Benchmarks: Evaluating AI Agents, Multimodal Systems, and Generative AI in the RealWorld Sinan Ozdemir, AI & LLM Expert | Author | Founder + CTO at LoopGenius As AI systems advance into autonomous agents, multimodal models, and RAG workflows, traditional evaluation methods often fall short.

Data Scientist

Data Scientist Data Science LLM Machine Learning

Stacklock Releases Promptwright: A Python Library for Synthetic Dataset Generation Using an LLM (Local or Hosted)

Marktechpost

DECEMBER 1, 2024

Simplified Synthetic Data Generation Designed to generate synthetic datasets using either local large language models (LLMs) or hosted models (OpenAI, Anthropic, Google Gemini, etc.), Its compatibility with multiple LLM providers, configurability, and ease of use make it a valuable addition to the AI toolkit.

Python

Python LLM Data Scarcity Data Scientist

Meet xTuring: An Open-Source Tool That Allows You to Create Your Own Large Language Model (LLMs) With Only Three Lines of Code

Flipboard

JULY 17, 2023

The practical implementation of a Large Language Model (LLM) for a bespoke application is currently difficult for the majority of individuals. It takes a lot of time and expertise to create an LLM that can generate content with high accuracy and speed for specialized domains or, perhaps, to imitate a writing style.

Large Language Models

Large Language Models LLM ML Engineer ML

Top Artificial Intelligence AI Courses from Google

Marktechpost

MAY 30, 2024

Introduction to AI and Machine Learning on Google Cloud This course introduces Google Cloud’s AI and ML offerings for predictive and generative projects, covering technologies, products, and tools across the data-to-AI lifecycle. It also includes guidance on using Google Tools to develop your own Generative AI applications.

Artificial Intelligence

Artificial Intelligence Artificial Intelligence BERT Computer Vision

DeepSeek in My Engineer’s Eyes

Towards AI

FEBRUARY 18, 2025

AI agents, on the other hand, hold a lot of promise but are still constrained by the reliability of LLM reasoning. From an engineering perspective, the core challenge for both lies in improving accuracy and reliability to meet real-world business requirements. Because of its lack of reasoning capability, it is a pretty dumb solution.

ML Engineer

ML Engineer LLM Data Quality Algorithm

Key Takeaways From Week 4 of the AI Builders Summit — Building AI

ODSC - Open Data Science

FEBRUARY 13, 2025

With hundreds of people tuning in virtually from all around the world, our world-class instructors showed how to build, evaluate, and make the most out of large language models. She walked through deploying a DeepSeek model on self-hosted Nvidia GPUs to perform Reddit trend analysis. and OpenAIs O3 Mini.

Large Language Models

Large Language Models AI AI Automation

Building LLM Applications With Vector Databases

The MLOps Blog

JULY 4, 2024

They enable efficient context retrieval or dynamic few-shot prompting to improve the factual accuracy of LLM-generated responses. Use re-ranking or contextual compression techniques to ensure only the most relevant information is provided to the LLM, improving response accuracy and reducing cost.

LLM

LLM Large Language Models Machine Learning Explainability

AI Engineer’s Toolkit

Towards AI

MAY 30, 2024

Building LLMs for Production: Enhancing LLM Abilities and Reliability with Prompting, Fine-Tuning, and RAG” is now available on Amazon! The application topics include prompting, RAG, agents, fine-tuning, and deployment — all essential topics in an AI Engineer’s toolkit.” The defacto manual for AI Engineering.

Prompt Engineering

Prompt Engineering Prompt Engineer LLM NLP

Excited To Bring You the E-book Version of “Building LLMs for Production”

Towards AI

JUNE 18, 2024

About Building LLMs for Production Generative AI and LLMs are transforming industries with their ability to understand and generate human-like text and images. However, building reliable and scalable LLM applications requires a lot of extra work and a deep understanding of various techniques and frameworks.

Large Language Models

Large Language Models Prompt Engineering Prompt Engineer LLM

The journey of PGA TOUR’s generative AI virtual assistant, from concept to development to prototype

AWS Machine Learning Blog

MARCH 14, 2024

Recent improvements in Generative AI based large language models (LLMs) have enabled their use in a variety of applications surrounding information retrieval. We formulated a text-to-SQL approach where by a user’s natural language query is converted to a SQL statement using an LLM.

Generative AI

Generative AI LLM AI AI

Evaluation of generative AI techniques for clinical report summarization

AWS Machine Learning Blog

MAY 13, 2024

In part 1 of this blog series, we discussed how a large language model (LLM) available on Amazon SageMaker JumpStart can be fine-tuned for the task of radiology report impression generation. Prompt structure Prompts can specify the desired output format, provide prior knowledge, or guide the LLM through a complex task.

Generative AI

Generative AI Prompt Engineering Prompt Engineer LLM

Enterprise LLM Summit highlights the importance of data development

Snorkel AI

OCTOBER 27, 2023

Snorkel AI held its Enterprise LLM Virtual Summit on October 26, 2023, drawing an engaged crowd of more than 1,000 attendees across three hours and eight sessions that featured 11 speakers. But Ali and Paroma focussed heavily on the need for specialized models for different verticals or sub-verticals. Book a demo today.

LLM

LLM Data Scientist Machine Learning Large Language Models

Vitech uses Amazon Bedrock to revolutionize information access with AI-powered chatbot

AWS Machine Learning Blog

MAY 30, 2024

Hosting large language models Vitech explored the option of hosting Large Language Models (LLMs) models using Amazon Sagemaker. Vitech needed a fully managed and secure experience to host LLMs and eliminate the undifferentiated heavy lifting associated with hosting 3P models.

Chatbots

Chatbots Prompt Engineering Prompt Engineer Large Language Models

Researchers from Stanford University Propose MLAgentBench: A Suite of Machine Learning Tasks for Benchmarking AI Research Agents

Marktechpost

OCTOBER 11, 2023

The team started with a collection of 15 ML engineering projects spanning various fields, with experiments that are quick and cheap to run. At a high level, they simply ask the LLMs to take the next action, using a prompt that is automatically produced based on the available information about the task and previous steps.

Machine Learning

Machine Learning AI Researcher AI Research Convolutional Neural Networks

Create an HCLS document summarization application with Falcon using Amazon SageMaker JumpStart

AWS Machine Learning Blog

OCTOBER 4, 2023

With unique data formats and strict regulatory requirements, customers are looking for choices to select the most performant and cost-effective model, as well as the ability to perform necessary customization (fine-tuning) to fit their business use case. You can see your deployed JumpStart models on the Launched JumpStart assets page.

LLM

LLM Large Language Models ML Data Scientist

Moderate audio and text chats using AWS AI services and LLMs

AWS Machine Learning Blog

MARCH 13, 2024

By orchestrating toxicity classification with large language models (LLMs) using generative AI, we offer a solution that balances simplicity, latency, cost, and flexibility to satisfy various requirements. LLMs, in contrast, offer a high degree of flexibility.

Natural Language Processing

Natural Language Processing LLM Prompt Engineering Prompt Engineer

Reduce energy consumption of your machine learning workloads by up to 90% with AWS purpose-built accelerators

Flipboard

JUNE 20, 2023

Machine learning (ML) engineers have traditionally focused on striking a balance between model training and deployment cost vs. performance. This is important because training ML models and then using the trained models to make predictions (inference) can be highly energy-intensive tasks.

Machine Learning

Machine Learning BERT Deep Learning ML Engineer

Build a robust text-to-SQL solution generating complex queries, self-correcting, and querying diverse data sources

AWS Machine Learning Blog

FEBRUARY 28, 2024

The solution in this post aims to bring enterprise analytics operations to the next level by shortening the path to your data using natural language. With the emergence of large language models (LLMs), NLP-based SQL generation has undergone a significant transformation. on Amazon Bedrock as our LLM.

Metadata

Metadata Generative AI LLM NLP

Enterprise LLM Summit highlights the importance of data development

Snorkel AI

OCTOBER 27, 2023

Snorkel AI held its Enterprise LLM Virtual Summit on October 26, 2023, drawing an engaged crowd of more than 1,000 attendees across three hours and eight sessions that featured 11 speakers. But Ali and Paroma focussed heavily on the need for specialized models for different verticals or sub-verticals. Book a demo today.

LLM

LLM Data Scientist Machine Learning Large Language Models

Exploring Generative AI in conversational experiences: An Introduction with Amazon Lex, Langchain, and SageMaker Jumpstart

AWS Machine Learning Blog

JUNE 8, 2023

However, businesses can meet this challenge while providing personalized and efficient customer service with the advancements in generative artificial intelligence (generative AI) powered by large language models (LLMs). However, unlike task-oriented bots, these bots use LLMs for text analysis and content generation.

Generative AI

Generative AI LLM Machine Learning Large Language Models

Build an Amazon SageMaker Model Registry approval and promotion workflow with human intervention

AWS Machine Learning Blog

JANUARY 10, 2024

Specialist Data Engineering at Merck, and Prabakaran Mathaiyan, Sr. ML Engineer at Tiger Analytics. The large machine learning (ML) model development lifecycle requires a scalable model release process similar to that of software development. This post is co-written with Jayadeep Pabbisetty, Sr.

ML

ML Machine Learning Data Scientist ETL

Introducing the Topic Tracks for ODSC East 2025: Spotlight on Gen AI, AI Agents, LLMs, & More

ODSC - Open Data Science

FEBRUARY 25, 2025

Topics Include: Agentic AI DesignPatterns LLMs & RAG forAgents Agent Architectures &Chaining Evaluating AI Agent Performance Building with LangChain and LlamaIndex Real-World Applications of Autonomous Agents Who Should Attend: Data Scientists, Developers, AI Architects, and ML Engineers seeking to build cutting-edge autonomous systems.

Data Scientist

Data Scientist Machine Learning Large Language Models ML Engineer

Enterprise LLM Summit highlights the importance of data development

Snorkel AI

OCTOBER 27, 2023

Snorkel AI held its Enterprise LLM Virtual Summit on October 26, 2023, drawing an engaged crowd of more than 1,000 attendees across three hours and eight sessions that featured 11 speakers. But Ali and Paroma focussed heavily on the need for specialized models for different verticals or sub-verticals. Book a demo today.

LLM

LLM Data Scientist Machine Learning Large Language Models

Fine tune a generative AI application for Amazon Bedrock using Amazon SageMaker Pipeline decorators

AWS Machine Learning Blog

AUGUST 22, 2024

The solution in this post shows how you can take Python code that was written to preprocess, fine-tune, and test a large language model (LLM) using Amazon Bedrock APIs and convert it into a SageMaker pipeline to improve ML operational efficiency. We use Python to do this.

Generative AI

Generative AI Metadata Python ML

Achieve operational excellence with well-architected generative AI solutions using Amazon Bedrock

AWS Machine Learning Blog

OCTOBER 2, 2024

You can achieve this in several ways: Enterprises can use AWS services like Amazon SageMaker Model Monitor and Amazon Bedrock Guardrails, or Amazon Comprehend to monitor model behavior, detect drifts, and make sure generative AI solutions are performing as expected (or better) and adhering to organizational policies.

Generative AI

Generative AI Data Ingestion AI AI

Automate fine-tuning of Llama 3.x models with the new visual designer for Amazon SageMaker Pipelines

AWS Machine Learning Blog

OCTOBER 22, 2024

It accelerates your generative AI journey from prototype to production because you don’t need to learn about specialized workflow frameworks to automate model development or notebook execution at scale. Create a complete AI/ML pipeline for fine-tuning an LLM using drag-and-drop functionality.

Automation

Automation LLM DevOps Python

New – Code Editor, based on Code-OSS VS Code Open Source now available in Amazon SageMaker Studio

AWS Machine Learning Blog

NOVEMBER 30, 2023

Solution overview In the following sections, we share how you can develop an example ML project with Code Editor on Amazon SageMaker Studio. We will deploy a Mistral-7B large language model (LLM) model into an Amazon SageMaker real-time endpoint using a built-in container from HuggingFace.

Machine Learning

Machine Learning ML LLM Software Engineer

Automate Amazon SageMaker Pipelines DAG creation

AWS Machine Learning Blog

FEBRUARY 29, 2024

Configuration files (YAML and JSON) allow ML practitioners to specify undifferentiated code for orchestrating training pipelines using declarative syntax. The following are the key benefits of this solution: Automation – The entire ML workflow, from data preprocessing to model registry, is orchestrated with no manual intervention.

Automation

Automation Python Machine Learning ML

Import a fine-tuned Meta Llama 3 model for SQL query generation on Amazon Bedrock

AWS Machine Learning Blog

AUGUST 1, 2024

This is the first in a series of posts about model customization scenarios that can be imported into Amazon Bedrock to simplify the process of building scalable and secure generative AI applications. Using the Amazon Bedrock Text Playground You can test the model using the Amazon Bedrock Text Playground.

Generative AI

Generative AI Machine Learning Artificial Intelligence Artificial Intelligence

Choose Your Weapon: Survival Strategies for Depressed AI Consultants

Towards AI

SEPTEMBER 22, 2023

They were familiar with the processes of topic modeling and sentiment analysis; they knew all the libraries they used; and they felt like conductors in a symphony. However, with the advent of LLM, everything has changed. LLMs seem to rule them all, and interestingly, no one knows how LLMs work. Everyone was happy.

Prompt Engineer

Prompt Engineer Prompt Engineering ML ML Engineer

Announcing the First Sessions for ODSC East 2024

ODSC - Open Data Science

JANUARY 10, 2024

The AI Paradigm Shift: Under the Hood of a Large Language Models Valentina Alto | Azure Specialist — Data and Artificial Intelligence | Microsoft Develop an understanding of Generative AI and Large Language Models, including the architecture behind them, their functioning, and how to leverage their unique conversational capabilities.

Large Language Models

Large Language Models Deep Learning LLM Data Science

Unlocking the Potential of LLMs: From MLOps to LLMOps

Heartbeat

OCTOBER 5, 2023

Unsurprisingly, Machine Learning (ML) has seen remarkable progress, revolutionizing industries and how we interact with technology. The emergence of Large Language Models (LLMs) like OpenAI's GPT , Meta's Llama , and Google's BERT has ushered in a new era in this field.

Large Language Models

Large Language Models DevOps Machine Learning Prompt Engineering

10 Can’t-Miss ODSC East 2025 Sessions to Teach You About LLMs and AI Agents

ODSC - Open Data Science

FEBRUARY 21, 2025

Evals for Supercharging Your AIAgents Aditya Palnitkar | Staff Software Engineer |Meta Testing and monitoring LLMs are often overlookedbut theyre critical to improving performance and development speed. Learn how to modularize tasks, implement unit tests, and refine your models with an iterative process.

Software Engineer

Software Engineer Data Scientist LLM Neural Network

? Guest Post: How to Build the Right Team for Generative AI*

TheSequence

JANUARY 19, 2024

Generative AI and Large Language Models (LLMs) are new to most companies. If you are an engineering leader building Gen AI applications, it can be hard to know what skills and types of people are needed. At the same time, the capabilities of AI models have grown.

Prompt Engineer

Prompt Engineer Prompt Engineering Generative AI Large Language Models

MLOps Landscape in 2023: Top Tools and Platforms

The MLOps Blog

JUNE 27, 2023

Collaborative workflows : Dataset storage and versioning tools should support collaborative workflows, allowing multiple users to access and contribute to datasets simultaneously, ensuring efficient collaboration among ML engineers, data scientists, and other stakeholders. LLM training configurations.

Machine Learning

Machine Learning Metadata Data Scientist Data Quality

The Future of Data-Centric AI Day 2: Snorkel Flow and Beyond

Snorkel AI

JUNE 9, 2023

Snorkel Co-Founder and CEO Alex Ratner kicked off the day’s events by giving attendees a peek into Snorkel’s new Foundation Model Data Platform, which includes solutions to develop and adapt large language models and foundation models. To that end, Snorkel will soon debut Snorkel GenFlow and Snorkel Foundry.

Large Language Models

Large Language Models Data Scientist Machine Learning Computer Vision

Track LLM model evaluation using Amazon SageMaker managed MLflow and FMEval

The Vulnerabilities and Security Threats Facing Large Language Models

Webinars

Trending Sources

Top Large Language Models LLMs Courses

Webinars

Techniques and approaches for monitoring large language models on AWS

LLM continuous self-instruct fine-tuning framework powered by a compound AI system on Amazon SageMaker

Achieve ~2x speed-up in LLM inference with Medusa-1 on Amazon SageMaker AI

Yandex Introduces YaFSDP: An Open-Source AI Tool that Promises to Revolutionize LLM Training by Cutting GPU Usage by 20%

LLM experimentation at scale using Amazon SageMaker Pipelines and MLflow

12 Can’t-Miss Hands-on Training & Workshops Coming to ODSC East 2025

Stacklock Releases Promptwright: A Python Library for Synthetic Dataset Generation Using an LLM (Local or Hosted)

Meet xTuring: An Open-Source Tool That Allows You to Create Your Own Large Language Model (LLMs) With Only Three Lines of Code

Top Artificial Intelligence AI Courses from Google

DeepSeek in My Engineer’s Eyes

Key Takeaways From Week 4 of the AI Builders Summit — Building AI

Building LLM Applications With Vector Databases

AI Engineer’s Toolkit

Excited To Bring You the E-book Version of “Building LLMs for Production”

The journey of PGA TOUR’s generative AI virtual assistant, from concept to development to prototype

Evaluation of generative AI techniques for clinical report summarization

Enterprise LLM Summit highlights the importance of data development

Vitech uses Amazon Bedrock to revolutionize information access with AI-powered chatbot

Researchers from Stanford University Propose MLAgentBench: A Suite of Machine Learning Tasks for Benchmarking AI Research Agents

Create an HCLS document summarization application with Falcon using Amazon SageMaker JumpStart

Moderate audio and text chats using AWS AI services and LLMs

Reduce energy consumption of your machine learning workloads by up to 90% with AWS purpose-built accelerators

Build a robust text-to-SQL solution generating complex queries, self-correcting, and querying diverse data sources

Enterprise LLM Summit highlights the importance of data development

Exploring Generative AI in conversational experiences: An Introduction with Amazon Lex, Langchain, and SageMaker Jumpstart

Build an Amazon SageMaker Model Registry approval and promotion workflow with human intervention

Introducing the Topic Tracks for ODSC East 2025: Spotlight on Gen AI, AI Agents, LLMs, & More

Enterprise LLM Summit highlights the importance of data development

Fine tune a generative AI application for Amazon Bedrock using Amazon SageMaker Pipeline decorators

Achieve operational excellence with well-architected generative AI solutions using Amazon Bedrock

Automate fine-tuning of Llama 3.x models with the new visual designer for Amazon SageMaker Pipelines

New – Code Editor, based on Code-OSS VS Code Open Source now available in Amazon SageMaker Studio

Automate Amazon SageMaker Pipelines DAG creation

Import a fine-tuned Meta Llama 3 model for SQL query generation on Amazon Bedrock

Choose Your Weapon: Survival Strategies for Depressed AI Consultants

Announcing the First Sessions for ODSC East 2024

Unlocking the Potential of LLMs: From MLOps to LLMOps

10 Can’t-Miss ODSC East 2025 Sessions to Teach You About LLMs and AI Agents

? Guest Post: How to Build the Right Team for Generative AI*

MLOps Landscape in 2023: Top Tools and Platforms

The Future of Data-Centric AI Day 2: Snorkel Flow and Beyond

Stay Connected