evaluating AI Tools

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Hugging Face paper page on a benchmark to evaluate LLMs agents

Methods, Best Practices & Tools | Lakera – Protecting AI teams that disrupt the world

talk by Princeton professor Arvind Narayanan