Exam 10 - Databricks Certified Generative AI Engineer Associate
Test your knowledge (with 45+ questions and unlimited attempts!) on Evaluation and Monitoring: Select an LLM choice (size and architecture) based on a set of quantitative evaluation metrics, select key metrics to monitor for a specific LLM deployment scenario, evaluate model performance in a RAG application using MLflow, use inference logging to assess deployed RAG application performance, use Databricks features to control LLM costs for RAG applications, use inference tables and Agent Monitoring to track a live LLM endpoint, identify evaluation judges that require ground truth, compare the evaluation and monitoring phases of the Gen AI application life cycle.
This course includes.
Curriculum & lectures.
+ Exam 8 lectures
Taught by people who ship.
Alex Kropf
Alex Kropf is Mammoth Club's CLO, public speaker, consultant, IT author and Senior Software Developer. Alex has produced 1,000+ best-selling courses, books and workshops for Mammoth Club, Course Pro and our clients since 2016.
Ready to start building?
Test your knowledge (with 45+ questions and unlimited attempts!) on Evaluation and Monitoring: Select an LLM choice (size and architecture) based on a set of quantitative evaluation metrics, select key metrics to monitor for a specific LLM deployment scenario, evaluate model performance in a RAG application using MLflow, use inference logging to assess deployed RAG application performance, use Databricks features to control LLM costs for RAG applications, use inference tables and Agent Monitoring to track a live LLM endpoint, identify evaluation judges that require ground truth, compare the evaluation and monitoring phases of the Gen AI application life cycle.