All Posts

  • Published on
    Learn how to implement code-based grading for AI-generated code evaluation. This guide covers syntax validation for Python, JSON, and regex, combining code and model graders, and using objective metrics to measure prompt engineering progress.
  • Published on
    Learn how to implement grading systems for prompt evaluation workflows. This comprehensive guide covers code graders, model graders, and human graders, with detailed examples of building LLM-as-judge systems that provide objective quality scores and actionable feedback.
  • Published on
    Learn how to build the core evaluation pipeline for prompt testing. This guide covers the three essential functions—run_prompt, run_test_case, and run_eval—that process test cases through Claude and collect structured results for analysis.