ODSC - Open Data Science

FEBRUARY 13, 2025

The AI agent classified and summarized GenAI-related content from Reddit, using a structured pipeline with utility functions for API interactions, web scraping, and LLM-based reasoning. He also demonstrated workflow automation using Koo.ai, highlighting how AI-driven knowledge extraction can enhance research dissemination.

Large Language Models 52

Large Language Models AI AI Automation 52

AWS Machine Learning Blog

FEBRUARY 11, 2025

Clean up To clean up the model and endpoint, use the following code: predictor.delete_model() predictor.delete_endpoint() Conclusion In this post, we explored how SageMaker JumpStart empowers data scientists and ML engineers to discover, access, and run a wide range of pre-trained FMs for inference, including the Falcon 3 family of models.

ML 78

ML Machine Learning Python Computer Vision 78

AWS Machine Learning Blog

OCTOBER 22, 2024

It accelerates your generative AI journey from prototype to production because you don’t need to learn about specialized workflow frameworks to automate model development or notebook execution at scale. Create a complete AI/ML pipeline for fine-tuning an LLM using drag-and-drop functionality.

Automation 79

Automation LLM DevOps Python 79

AWS Machine Learning Blog

FEBRUARY 12, 2025

Machine learning (ML) engineers must make trade-offs and prioritize the most important factors for their specific use case and business requirements. Along with protecting against toxicity and harmful content, it can also be used for Automated Reasoning checks , which helps you protect against hallucinations.

Auto-classification 79

Auto-classification Metadata Generative AI Machine Learning 79

Unite.AI

FEBRUARY 28, 2024

Attackers may attempt to fine-tune surrogate models using queries to the target LLM to reverse-engineer its knowledge. Adversaries can also attempt to breach cloud environments hosting LLMs to sabotage operations or exfiltrate data. Stolen models also create additional attack surface for adversaries to mount further attacks.

Large Language Models 157

Large Language Models Machine Learning LLM Neural Network 157

AWS Machine Learning Blog

MARCH 14, 2024

We formulated a text-to-SQL approach where by a user’s natural language query is converted to a SQL statement using an LLM. This data is again provided to an LLM, which is asked to answer the user’s query given the data. The relevant information is then provided to the LLM for final response generation.

Generative AI 118

Generative AI LLM AI AI 118

TheSequence

JULY 21, 2024

Sergio Ferragut, Principal Developer Advocate at Tecton, will show how to enhance collaboration, automate feature materialization, and support diverse data types. He will also cover how these frameworks automate production-ready pipelines, speeding up AI projects and making AI-powered applications more intelligent.

ML Engineer 75

ML Engineer Automation LLM OpenAI 75

AWS Machine Learning Blog

SEPTEMBER 1, 2023

Furthermore, we deep dive on the most common generative AI use case of text-to-text applications and LLM operations (LLMOps), a subset of FMOps. MLOps engineers are responsible for providing a secure environment for data scientists and ML engineers to productionize the ML use cases.

Generative AI 120

Generative AI Prompt Engineering Prompt Engineer ML 120

Towards AI

JUNE 18, 2024

About Building LLMs for Production Generative AI and LLMs are transforming industries with their ability to understand and generate human-like text and images. However, building reliable and scalable LLM applications requires a lot of extra work and a deep understanding of various techniques and frameworks.

Large Language Models 79

Large Language Models Prompt Engineering Prompt Engineer LLM 79

AWS Machine Learning Blog

JANUARY 10, 2024

Specialist Data Engineering at Merck, and Prabakaran Mathaiyan, Sr. ML Engineer at Tiger Analytics. The large machine learning (ML) model development lifecycle requires a scalable model release process similar to that of software development. This post is co-written with Jayadeep Pabbisetty, Sr.

ML 116

ML Machine Learning Data Scientist ETL 116

AWS Machine Learning Blog

MAY 30, 2024

Instead, Vitech opted for Retrieval Augmented Generation (RAG), in which the LLM can use vector embeddings to perform a semantic search and provide a more relevant answer to users when interacting with the chatbot. Prompt engineering Prompt engineering is crucial for the knowledge retrieval system.

Chatbots 120

Chatbots Prompt Engineering Prompt Engineer Large Language Models 120

AWS Machine Learning Blog

OCTOBER 2, 2024

This allows you to create rules that invoke specific actions when certain events occur, enhancing the automation and responsiveness of your observability setup (for more details, see Monitor Amazon Bedrock ). The job could be automated based on a ground truth, or you could use humans to bring in expertise on the matter.

Generative AI 113

Generative AI Data Ingestion AI AI 113

Snorkel AI

MARCH 20, 2025

However, if we can capture SME domain knowledge in the form of well-defined acceptance criteria, and scale it via automated, specialized evaluators, we can accelerate evaluation exponentially from several weeks or more to a few hours or less. Lets consider an LLM-as-a-Judge (LLMAJ) which checks to see if an AI assistant has repeated itself.

ML Engineer 59

ML Engineer Automation Prompt Engineering Prompt Engineer 59

AWS Machine Learning Blog

AUGUST 22, 2024

The solution in this post shows how you can take Python code that was written to preprocess, fine-tune, and test a large language model (LLM) using Amazon Bedrock APIs and convert it into a SageMaker pipeline to improve ML operational efficiency. Add @step decorated functions to convert the Python code to a SageMaker pipeline.

Generative AI 114

Generative AI Metadata Python ML 114

Flipboard

JULY 17, 2023

The practical implementation of a Large Language Model (LLM) for a bespoke application is currently difficult for the majority of individuals. It takes a lot of time and expertise to create an LLM that can generate content with high accuracy and speed for specialized domains or, perhaps, to imitate a writing style.

Large Language Models 65

Large Language Models LLM ML Engineer ML 65

O'Reilly Media

MARCH 18, 2025

The efficiencies were double-edged: Automating one process might overwhelm downstream processes that were still done by hand. Bringing AI into a company means you have new roles to fill (data scientist, ML engineer) as well as new knowledge to backfill in existing roles (product, ops). So what is software dev-flavored AI?

Software Development 52

Software Development Python Data Scientist AI 52

TheSequence

MAY 21, 2023

🔎 ML Research RL for Open Ended LLM Conversations Google Research published a paper detailing dynamic planning, a reinforcement learning(RL) based technique to guide open ended conversations. Self-Aligned LLM IBM Research published a paper introducing Dromedary, a self-aligned LLM trained with minimum user supervision.

Generative AI 64

Generative AI ML Engineer ETL LLM 64

The MLOps Blog

JUNE 27, 2023

This includes features for hyperparameter tuning, automated model selection, and visualization of model metrics. They should also offer version control capabilities to manage the changes and revisions of ML artifacts, ensuring reproducibility and facilitating effective teamwork.

Machine Learning 134

Machine Learning Metadata Data Scientist Data Quality 134

AWS Machine Learning Blog

APRIL 29, 2024

In 2024, however, organizations are using large language models (LLMs), which require relatively little focus on NLP, shifting research and development from modeling to the infrastructure needed to support LLM workflows. This often means the method of using a third-party LLM API won’t do for security, control, and scale reasons.

ML 116

ML Python Data Scientist Machine Learning 116

ODSC - Open Data Science

FEBRUARY 25, 2025

Generative AI TrackBuild the Future with GenAI Generative AI has captured the worlds attention with tools like ChatGPT, DALL-E, and Stable Diffusion revolutionizing how we create content and automate tasks. AI Engineering TrackBuild Scalable AISystems Learn how to bridge the gap between AI development and software engineering.

Data Scientist 52

Data Scientist Machine Learning Large Language Models ML Engineer 52

AWS Machine Learning Blog

NOVEMBER 30, 2023

Amazon SageMaker Clarify now provides AWS customers with foundation model (FM) evaluations, a set of capabilities designed to evaluate and compare model quality and responsibility metrics for any LLM, in minutes. FMEval helps in measuring evaluation dimensions such as accuracy, robustness, bias, toxicity, and factual knowledge for any LLM.

Large Language Models 103

Large Language Models Algorithm LLM Responsible AI 103

AWS Machine Learning Blog

OCTOBER 19, 2023

Customers increasingly want to use deep learning approaches such as large language models (LLMs) to automate the extraction of data and insights. For many industries, data that is useful for machine learning (ML) may contain personally identifiable information (PII).

Machine Learning 104

Machine Learning Python ML Automation 104

AWS Machine Learning Blog

AUGUST 16, 2023

The introduction of generative AI provides another opportunity for Thomson Reuters to work with customers and once again advance how they do their work, helping professionals draw insights and automate workflows, enabling them to focus their time where it matters most.

Large Language Models 85

Large Language Models Machine Learning Generative AI ML 85

TheSequence

NOVEMBER 12, 2023

📌 ML Engineering Event: Join Meta, PepsiCo, RiotGames, Uber & more at apply(ops) apply(ops) is in two days! SAVE MY SPOT 🔎 ML Research LLM Pruning Microsoft Research published a research paper proposing LoRAShear, a technique for pruning and recovering knowledge in LLMs. million in funding.

OpenAI 64

OpenAI Generative AI ML Prompt Engineering 64

TheSequence

JANUARY 19, 2024

You probably don’t need ML engineers In the last two years, the technical sophistication needed to build with AI has dropped dramatically. ML engineers used to be crucial to AI projects because you needed to train custom models from scratch. At the same time, the capabilities of AI models have grown.

Prompt Engineer 59

Prompt Engineer Prompt Engineering Generative AI Large Language Models 59

Chatbots Life

MAY 16, 2023

Services : AI Solution Development, ML Engineering, Data Science Consulting, NLP, AI Model Development, AI Strategic Consulting, Computer Vision. Generative AI integration service : proposes to train Generative AI on clients data and add new features to products.

Generative AI 92

Generative AI Chatbots Conversational AI Software Development 92

The MLOps Blog

JANUARY 30, 2025

TL;DR Finding an optimal set of hyperparameters is essential for efficient and effective training of Large Language Models (LLMs). The key LLM hyperparameters influence the model size, learning rate, learning behavior, and token generation process. Hyperparameters set and tuned during pre-training influence the total size of an LLM.

LLM 64

LLM Machine Learning Large Language Models Deep Learning 64

Heartbeat

OCTOBER 5, 2023

Automation is critical, with techniques like pre-trained models, active learning, or weak supervision methods. Feature Engineering and Model Experimentation MLOps: Involves improving ML performance through experiments and feature engineering.

Large Language Models 52

Large Language Models DevOps Machine Learning Prompt Engineering 52

AWS Machine Learning Blog

MAY 9, 2024

Lifecycle management Within the AI/ML CoE, the emphasis on scalability, availability, reliability, performance, and resilience is fundamental to the success and adaptability of AI/ML initiatives. This includes implementation of industry best practice measures and industry frameworks, such as NIST , OWASP-LLM , OWASP-ML , MITRE Atlas.

ML 123

ML Generative AI AI AI 123

ODSC - Open Data Science

JANUARY 3, 2025

By the end of the session, attendees will know how to transform unstructured data into reliable, queryable formats, optimize LLM outputs for cost-effective analysis, and apply structured data to answer natural-language queries. Cloning NotebookLM with Open Weights Models Niels Bantilan, Chief ML Engineer atUnion.AI

LLM 40

LLM AI AI Prompt Engineering 40

Snorkel AI

OCTOBER 12, 2023

We hope that you will enjoy watching the videos and learning more about the impact of LLMs on the world. Closing Keynote: LLMOps: Making LLM Applications Production-Grade Large language models are fluent text generators, but they struggle at generating factual, correct content. Register now.

Data Scientist 64

Data Scientist ML Computer Vision AI 64

AWS Machine Learning Blog

AUGUST 1, 2023

Artificial intelligence (AI) and machine learning (ML) models have shown great promise in addressing these challenges. By automating the summarization process, doctors can quickly gain access to relevant information, allowing them to focus on patient care and make more informed decisions. No ML engineering experience required.

ML 83

ML Large Language Models NLP Machine Learning 83

Snorkel AI

OCTOBER 12, 2023

We hope that you will enjoy watching the videos and learning more about the impact of LLMs on the world. Closing Keynote: LLMOps: Making LLM Applications Production-Grade Large language models are fluent text generators, but they struggle at generating factual, correct content. Register now.

Data Scientist 59

Data Scientist ML Computer Vision AI 59

Snorkel AI

JUNE 9, 2023

Snorkel Foundry will allow customers to programmatically curate unstructured data to pre-train an LLM for a specific domain. These models will help automate manual processes and improve insurance companies’ abilities to find the right buyers for the right products.

Large Language Models 52

Large Language Models Data Scientist Machine Learning Computer Vision 52

Snorkel AI

JUNE 9, 2023

Snorkel Foundry will allow customers to programmatically curate unstructured data to pre-train an LLM for a specific domain. These models will help automate manual processes and improve insurance companies’ abilities to find the right buyers for the right products.

Large Language Models 52

Large Language Models Data Scientist Machine Learning Computer Vision 52

Snorkel AI

OCTOBER 12, 2023

We hope that you will enjoy watching the videos and learning more about the impact of LLMs on the world. Closing Keynote: LLMOps: Making LLM Applications Production-Grade Large language models are fluent text generators, but they struggle at generating factual, correct content.

Data Scientist 52

Data Scientist NLP ML Computer Vision 52

BAIR

MARCH 11, 2024

Currently, I am working on Large Language Model (LLM) based autonomous agents. Alexandre Bayen, Fangyu focuses on the application of optimization methods to multi-agent robotic systems, particularly in the planning and control of automated vehicles.

Robotics 337

Robotics Natural Language Processing Machine Learning Deep Learning 337