AI Tool Rankings

vectara/hallucination-leaderboard

#1502

"leaderboard Comparing LLM Performance at Producing Hallucinations when Summarizing Short Documents"

LLM Evaluation at Scale – Airtrain

#1503

no-code batch compute platform for LLM evaluation and tuning workloads

PrevPage 76 of 113Next

#1505

openai/evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Open SourceBest for: Chatbots

Evaluating LLMs is a minefield

#1508

talk by Princeton professor Arvind Narayanan

#1509

Indico LLM Leaderboard

Indico Data runs a monthly benchmarking exercise across providers (LLama, Azure OpenAI, Google, AWS Bedrock, and Indico trained discriminative standard language models RoBERTa and DeBERTa), datasets (e.g. cord and CUAD), and capabilities (text classification, key information extraction, and generative summarization).

#1510

LLM Rankings

a leaderboard that compares LLMs for all prompts.

#1511

LLM Use Case Leaderboard

a leaderboard that features LLM use cases.

#1512

LMExamQA

a leaderboard that benchmarks foundation models with Language-Model-as-an-Examiner.

#1513

The Pile

a leaderboard of The Pile benchmark.

#1514

Lunary

Open-source platform for LLM chatbots and agents: observability, prompt management, testing & more

Open SourceBest for: Chatbots

#1515

Eden AI

provides a unique API connected to the AI engines

#1516

LLM App

LLM App is a Python library that helps you build real-time AI-powered data pipelines with few lines of code.

#1517

Keywords AI

The enterprise-grade software to build, monitor, and improve your AI application. Keywords AI is a full-stack LLM engineering platform for developers and PMs.

#1518

Marvin

AI engineering framework for building natural language interfaces

#1519

Instructor

library for structured LLM extraction in Python

#1520

One AI

an NLP-as-a-service platform