evaluation AI Tools

The LLM Evaluation Framework

arxiv paper

a generative AI evaluation and observability platform

LiveCodeBench is a holistic and contamination-free evaluation benchmark of LLMs for code that continuously collects new problems over time. Particularly, LiveCodeBench also focuses on broader code-related capabilities, such as self-repair, code execution, and test output prediction, beyond mere code generation.

research on evaluation of LLMs conducted by Microsoft Research and other collaborated institutes. (Updated at: 2023/10)

no-code batch compute platform for LLM evaluation and tuning workloads