中文

Tool directory

Model Evaluation

Entries come from homepage discovery and independent official checks, and only tools with a verified official page are listed. Full category coverage, pagination and hands-on task testing are still being added.

13 Tools

Verified: sources and terms checkedCandidateCandidate: not fully verifiedSorted by verification status, then name; no paid ranking

ArenaOfficial source checked

Arena, formerly LMArena / Chatbot Arena, is a model-output comparison and evaluation platform with preference voting, agent-category performance and cost views, and a Code Arena development mode.

Category: Model Evaluation

C-EvalOfficial source checked

A comprehensive Chinese benchmark for foundation models. The official README describes 13,948 multiple-choice questions across 52 subjects and four difficulty levels.

Category: Model Evaluation

Category icon

CMMLUOfficial source checked

A Chinese multitask language-understanding benchmark covering 67 subjects for analysis of knowledge, reasoning and China-specific contexts.

Category: Model Evaluation

Category icon

DataifyOfficial source checked

Dataify is an AI data-services platform. Its official site describes datasets for training, evaluation and RAG, webpage/search/video data APIs and network resources, primarily supplying data for models and applications.

Category: AI Models

FlagEvalOfficial source checked

FlagEval is an evaluation toolkit and open platform for large models. Its public project covers foundation models, training and fine-tuning algorithms, with language, vision, audio and multimodal evaluation directions.

Category: Model Evaluation

HELMOfficial source checked

Stanford CRFM’s open-source holistic model-evaluation framework, unifying datasets, model interfaces and multiple metrics. Its README states that it entered maintenance mode on 2026-06-01.

Category: Model Evaluation

MMBenchOfficial source checked

An OpenCompass Community multimodal-understanding benchmark using multiple-choice questions and fine-grained ability dimensions to analyze vision-language models, with Chinese and English data and evaluation-tool links.

Category: Model Evaluation

Category icon

MMLUOfficial source checked

The original benchmark and code repository for Measuring Massive Multitask Language Understanding, using multidisciplinary tests to analyze model knowledge and understanding. Its paper appeared at ICLR 2021.

Category: Model Evaluation

Category icon

Open LLM LeaderboardOfficial source checked

Open LLM Leaderboard is a Hugging Face Space published by the open-llm-leaderboard organization, described as an interactive leaderboard of open-source language models across tests such as IFEval, BBH, MATH, GPQA, MUSR and MMLU-PRO.

Category: Model Evaluation

Category icon

OpenCompassOfficial source checked

OpenCompass is a model evaluation platform with language and multimodal leaderboards, benchmark resources, and documentation.

Category: Model Evaluation

PubMedQAOfficial source checked

A biomedical research question-answering dataset requiring yes, no or maybe answers based on paper abstracts. The website marks its leaderboard’s last update as 2024-04-28.

Category: Model Evaluation

Category icon

SuperCLUEOfficial source checked

A Chinese large-model evaluation entry presenting open-ended multi-turn, objective-question and battle-style evaluation directions. The readable page still contains July 2023 leaderboards.

Category: Model Evaluation

Category icon

讯飞星辰MaaSOfficial source checked

The public primary description positions iFLYTEK Xingchen MaaS as a developer-facing model fine-tuning service, covering data processing, model optimization, evaluation and deployment/hosting. This review did not run those console workflows.

Category: AI Models

Category icon