Create a Generative AI Gateway to allow secure and compliant consumption of foundation models
AWS Machine Learning Blog
SEPTEMBER 28, 2023
For example: The state-of-the-art (SOTA) of models, architectures, and best practices are constantly changing. This means companies need loose coupling between app clients (model consumers) and model inference endpoints, which ensures easy switch among large language model (LLM), vision, or multi-modal endpoints if needed.
116 
Let's personalize your content