Remove AI Architect Remove LLM Remove Metadata
article thumbnail

Learn how to build and deploy tool-using LLM agents using AWS SageMaker JumpStart Foundation Models

AWS Machine Learning Blog

Large language model (LLM) agents are programs that extend the capabilities of standalone LLMs with 1) access to external tools (APIs, functions, webhooks, plugins, and so on), and 2) the ability to plan and execute tasks in a self-directed fashion. We conclude the post with items to consider before deploying LLM agents to production.

LLM 127
article thumbnail

Create a Generative AI Gateway to allow secure and compliant consumption of foundation models

AWS Machine Learning Blog

This means companies need loose coupling between app clients (model consumers) and model inference endpoints, which ensures easy switch among large language model (LLM), vision, or multi-modal endpoints if needed. This table will hold the endpoint, metadata, and configuration parameters for the model.