ODSC - Open Data Science

MARCH 20, 2025

Sessions: Keynotes: Eric Xing, PhD, Professor at CMU and President of MBZUAI: Toward Public and Reproducible Foundation Models Beyond Lingual Intelligence Book Signings: Sinan Ozdemir: Quick Start Guide to Large LanguageModels Matt Harrison: Effective Pandas: Patterns for Data Manipulation Workshops: Adaptive RAG Systems with Knowledge Graphs: Building (..)

Data Science 52

Data Science LLM NLP Machine Learning 52

AWS Machine Learning Blog

FEBRUARY 12, 2025

For a demonstration on how you can use a RAG evaluation framework in Amazon Bedrock to compute RAG quality metrics, refer to New RAG evaluation and LLM-as-a-judge capabilities in Amazon Bedrock. Responsible AI Implementing responsible AI practices is crucial for maintaining ethical and safe deployment of RAG systems.

Auto-classification 82

Auto-classification Metadata Generative AI Machine Learning 82

AWS Machine Learning Blog

JANUARY 4, 2024

You can use supervised fine-tuning based on your LLM to improve the effectiveness of text-to-SQL. Prompt engineering – The model is trained to complete prompts designed to prompt the target SQL syntax. This prompt engineering allows you to develop the capability without needing to do fine-tuning.

Prompt Engineering 137

Prompt Engineering Prompt Engineer Generative AI LLM 137

AWS Machine Learning Blog

OCTOBER 16, 2024

His current area of research includes LLM evaluation and data generation. With over 15 years of experience, he supports customers globally in leveraging AI and ML for innovative solutions and building ML platforms on AWS. Li Erran Li is the applied science manager at humain-in-the-loop services, AWS AI, Amazon.

Machine Learning 104

Machine Learning ML Data Scientist Robotics 104

ODSC - Open Data Science

SEPTEMBER 12, 2024

Must-Use Data Visualization Datasets, AI Frameworks for Software Engineering, DynGAN, and 50% Off ODSC West 12 Must-Use Datasets for Data Visualization in 2024 Need to practice making sense of your data? Learn how to ensure AI benefits people and aligns with ethical standards across various industries.

Software Engineer 40

Software Engineer Data Science Machine Learning AI 40

AWS Machine Learning Blog

MARCH 5, 2025

To scale ground truth generation and curation, you can apply a risk-based approach in conjunction with a prompt-based strategy using LLMs. Its important to note that LLM-generated ground truth isnt a substitute for use case SME involvement. To convert the source document excerpt into ground truth, we provide a base LLM prompt template.

Generative AI 76

Generative AI LLM AI AI 76

AWS Machine Learning Blog

DECEMBER 9, 2024

Find more details in the blogpost LLM experimentation with MLFlow. He holds a PhD in Telecommunications Engineering and has experience in software engineering. He specializes in responsible AI, driven by a passion to develop ethically sound and transparent AI solutions.

ML 88

ML Data Scientist Machine Learning Software Engineer 88

ODSC - Open Data Science

SEPTEMBER 17, 2024

Fine Tuning Strategies for Language Models and Large Language Models Kevin Noel | AI Lead at Uzabase Speeda | Uzabase Japan-US Language Models (LM) and Large Language Models (LLM) have proven to have applications across many industries. This talk provides a comprehensive framework for securing LLM applications.

LLM 52

LLM Large Language Models Metadata Data Science 52

AWS Machine Learning Blog

MARCH 4, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies, such as AI21 Labs, Anthropic, Cohere, Meta, Stability AI, and Amazon via a single API, along with a broad set of capabilities you need to build generative AI applications with security, privacy, and responsible AI.

NLP 121

NLP Prompt Engineer Prompt Engineering LLM 121

TheSequence

MAY 29, 2023

In this post Toloka showcases Human-in-the-Loop using StarCoder, a code LLM, as an example. This successful implementation demonstrates how responsible AI and high-performing models can align. The risks of harmful results do not align with the principles of Responsible AI.

LLM 52

LLM Responsible AI Natural Language Processing BERT 52

AWS Machine Learning Blog

AUGUST 9, 2024

RAG enables LLMs to generate more relevant, accurate, and contextual responses by cross-referencing an organization’s internal knowledge base or specific domains, without the need to retrain the model. The question and context are combined and fed as a prompt to the LLM.

Data Ingestion 123

Data Ingestion Metadata LLM Generative AI 123

AWS Machine Learning Blog

JUNE 25, 2024

As customers look to operationalize these new generative AI applications, they also need prescriptive, out-of-the-box ways to monitor the health and performance of these applications. For example, you can write a Logs Insights query to calculate the token usage of the various applications and users calling the large language model (LLM).

DevOps 116

DevOps Machine Learning LLM Software Engineer 116

AWS Machine Learning Blog

SEPTEMBER 28, 2023

This means companies need loose coupling between app clients (model consumers) and model inference endpoints, which ensures easy switch among large language model (LLM), vision, or multi-modal endpoints if needed. When the user makes a request using the AI Gateway, it’s routed to Amazon Cognito to determine access for the client.

Generative AI 116

Generative AI Metadata Large Language Models AI 116

AWS Machine Learning Blog

MARCH 27, 2024

In software engineering, there is a direct correlation between team performance and building robust, stable applications. Using machine learning, AMI zAdviser monitors mainframe build, test and deploy functions across DevOps tool chains and then offers AI-led recommendations for continuous improvement.

DevOps 109

DevOps Generative AI Automation Software Development 109

ODSC - Open Data Science

FEBRUARY 25, 2025

Whats Next in AI TrackExplore the Cutting-Edge Stay ahead of the curve with insights into the future of AI. AI Engineering TrackBuild Scalable AISystems Learn how to bridge the gap between AI development and software engineering.

Data Scientist 52

Data Scientist Machine Learning Large Language Models ML Engineer 52

AWS Machine Learning Blog

JULY 25, 2024

Conversational AI agents also encompass multiple layers, from Retrieval Augmented Generation (RAG) to function-calling mechanisms that interact with external knowledge sources and tools. Although existing large language model (LLM) benchmarks like MT-bench evaluate model capabilities, they lack the ability to validate the application layers.

Conversational AI 127

Conversational AI Machine Learning AI AI 127

ODSC - Open Data Science

OCTOBER 25, 2024

These organizations and others will be showcasing their latest products and services that can help you implement AI in your organization or improve your processes that are already in progress. Learn more about the AI Insight Talks below.

Data Scientist 52

Data Scientist Software Engineer Machine Learning Automation 52

John Snow Labs

SEPTEMBER 26, 2023

to be precise) of data scientists and engineers plan to deploy Large Language Model (LLM) applications into production in the next 12 months or “as soon as possible.” of data science teams have implemented LLM applications currently in use by their own or client companies. Additionally, the data indicates that 8.3%

NLP 52

NLP Large Language Models Data Scientist LLM 52

The MLOps Blog

JUNE 27, 2023

This article by Samhita Alla, a software engineer and tech evangelist at Union.ai, provides a simplified walkthrough of the applications of Flyte in MLOps. LLM training configurations. Guardrails: – Does pydantic-style validation of LLM outputs. Check out the documentation to get started.

Machine Learning 134

Machine Learning Metadata Data Scientist Data Quality 134

Snorkel AI

MARCH 2, 2023

Ali Arsanjani, director of cloud partner engineering at Google Cloud , presented a talk entitled “Challenges and Ethics of DLM and LLM Adoption in the Enterprise” at Snorkel AI’s recent Foundation Model Virtual Summit. Below follows a transcript of his talk, lightly edited for readability.

Large Language Models 52

Large Language Models Prompt Engineer Prompt Engineering Neural Network 52

Snorkel AI

MARCH 2, 2023

Ali Arsanjani, director of cloud partner engineering at Google Cloud , presented a talk entitled “Challenges and Ethics of DLM and LLM Adoption in the Enterprise” at Snorkel AI’s recent Foundation Model Virtual Summit. Below follows a transcript of his talk, lightly edited for readability.

Large Language Models 52

Large Language Models Prompt Engineer Prompt Engineering Neural Network 52

AWS Machine Learning Blog

SEPTEMBER 20, 2024

As you build and refine your web search agent with Amazon Bedrock, keep these factors in mind to provide a robust, scalable, and responsible AI system. Expanding the solution With this post, you’ve taken the first step towards revolutionizing your applications with Amazon Bedrock Agents and the power of agentic workflows with LLMs.

Generative AI 104

Generative AI Python Chatbots AI 104

TheSequence

JUNE 19, 2024

I am a Principal Software Engineer at Microsoft, where I have worked on various AI projects and have been a core contributor in the development of Microsoft Copilot. While my colleagues recognize me as a diligent engineer, but only a few have had the opportunity to witness my prowess as a skier. All the way to AGI?

Software Engineer 49

Software Engineer Automation LLM Responsible AI 49

Flipboard

DECEMBER 3, 2024

This solution is also deployed by using the AWS Cloud Development Kit (AWS CDK), which is an open-source software development framework that defines cloud infrastructure in modern programming languages and provisions it through AWS CloudFormation. Domain-scoped agents enable code reuse across multiple agents.

Generative AI 149

Generative AI Metadata Machine Learning Natural Language Processing 149

ODSC - Open Data Science

MARCH 18, 2025

With a PhD, a law degree, and a Harvard fellowship, Rajiv is not only a technical leader but also a dynamic communicatorhis viral AI insights on @rajistics have amassed over 10 millionviews. Dr. Andre Franca, CTO ofErgodic Andre is the co-founder and CTO of Ergodic, pioneering AI powered by world models for smarter decision-making.

Data Science 64

Data Science Machine Learning Software Engineer Data Scientist 64

AWS Machine Learning Blog

SEPTEMBER 9, 2024

Amazon Bedrock is a fully managed service that offers a choice of high-performing foundation models (FMs) from leading AI companies like AI21 Labs, Anthropic, Cohere, Meta, Mistral AI, Stability AI, and Amazon through a single API, along with a broad set of capabilities to build generative AI applications with security, privacy, and responsible AI.

Software Architect 113

Software Architect Generative AI AI AI 113

Towards AI

NOVEMBER 16, 2023

In this episode, they discussed the democratization of AI, advancements in AI-assisted coding, and the ethics of innovation. Paige also discussed the need for responsible AI development, the importance of careful product design around LLMs, the role of a product manager within AI research teams, and much more.

Large Language Models 111

Large Language Models AI AI Software Engineer 111

AWS Machine Learning Blog

DECEMBER 19, 2024

In this blog post, we provide an introduction to preparing your own dataset for LLM training. Whether your goal is to fine-tune a pre-trained modIn this blog post, we provide an introduction to preparing your own dataset for LLM training. Generally, for training an LLM, there are a variety of approaches that you can take.

LLM 92

LLM Machine Learning Natural Language Processing ML 92

AWS Machine Learning Blog

DECEMBER 4, 2024

RAG is the process of optimizing the output of a large language model (LLM) so it references an authoritative knowledge base outside of its training data sources before generating a response. Bhaskar Pratap is a Senior Software Engineer with the Amazon SageMaker team.

Generative AI 93

Generative AI Software Engineer Large Language Models Machine Learning 93

AWS Machine Learning Blog

NOVEMBER 25, 2024

Moreover, well-designed prompts serve to steer the model towards the specific task at hand, ensuring that the LLM focuses on the most relevant information and produces outputs aligned with the desired outcome. The context-aware nature of the LLM, combined with careful prompt engineering, resulted in more natural and accurate translations.

Prompt Engineer 95

Prompt Engineer Prompt Engineering Metadata Generative AI 95

AI News

FEBRUARY 24, 2025

” “Meta and other ‘open’ LLM providers might go this route to keep their competitive advantage: more openness about the models, but preventing competitors from using them,” Sobrier warned. Response: Set and enforce guardrails to ensure safe and secure model adoption.

Big Data 301

Big Data AI AI AI Modeling 301