O'Reilly Media
MARCH 25, 2025
Essentially, what we did here was: Build Deploy (to only a handful of internal stakeholders) Log, monitor, and observe Evaluate and error analysis Iterate Now it didnt involve rolling out to external users; it didnt involve frameworks; it didnt even involve a robust eval harness yet, and the system changes involved only prompt engineering.
The MLOps Blog
JUNE 27, 2023
W&B (Weights & Biases) W&B is a machine learning platform for your data science teams to track experiments, version and iterate on datasets, evaluate model performance, reproduce models, visualize results, spot regressions, and share findings with colleagues. Detect data drift. Identify issues with data quality.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
The MLOps Blog
MARCH 12, 2024
Tools range from data platforms to vector databases, embedding providers, fine-tuning platforms, prompt engineering, evaluation tools, orchestration frameworks, observability platforms, and LLM API gateways. Monitoring Monitor model performance for data drift and model degradation, often using automated monitoring tools.
The MLOps Blog
AUGUST 3, 2023
We have someone from Adobe using it to help manage some prompt engineering work that they’re doing, for example. We have someone precisely using it more for feature engineering, but using it within a Flask app. Piotr: Sounds like something with data, right? Data drift.
Topbots
JUNE 29, 2023
While you will absolutely need to go for this approach if you want to use Text2SQL on many different databases, keep in mind that it requires considerable prompt engineering effort. Adaptability over time To use Text2SQL in a durable way, you need to adapt to data drift, i.
Expert insights. Personalized for you.
69 
Let's personalize your content