Remove Big Data Architect Remove Deep Learning Remove Python
article thumbnail

Super charge your LLMs with RAG at scale using AWS Glue for Apache Spark

AWS Machine Learning Blog

Large language models (LLMs) are very large deep-learning models that are pre-trained on vast amounts of data. These functions will be used inside a Spark Python user-defined function (UDF) in later cells. About the Authors Noritaka Sekiyama is a Principal Big Data Architect on the AWS Glue team.

LLM 111