Statistics for topic benchmark

LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA

Ohayou(おはよう), HTTP load generator, inspired by rakyll/hey with tui animation.

A command-line benchmarking tool

VPS融合怪服务器测评脚本(VPS Fusion Monster Server Test Script)(尽量做最全能测试服务器的脚本)

[ICLR 2024] SWE-Bench: Can Language Models Resolve Real-world Github Issues?

LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA

Benchmark for generative image models

Website Fetch Benchmark Tools

M3DBench introduces a comprehensive 3D instruction-following dataset with support for interleaved multi-modal prompts. Furthermore, M3DBench provides a new benchmark to assess large models across 3D v...

A benchmark for spaced repetition schedulers/algorithms

Ohayou(おはよう), HTTP load generator, inspired by rakyll/hey with tui animation.

A command-line benchmarking tool

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

[ICLR 2024] SWE-Bench: Can Language Models Resolve Real-world Github Issues?

Powerful .NET library for benchmarking

LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA

VPS融合怪服务器测评脚本-GO重构版本

Code for "FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models (ACL 2024)"

Trajectopy - Trajectory Evaluation in Python

[ECCV 2024] Official PyTorch Implementation of "How Many Unicorns Are in This Image? A Safety Evaluation Benchmark for Vision LLMs"

This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient LLM GPU selections and cost-effective AI models. LLM provider p...

LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA

Ohayou(おはよう), HTTP load generator, inspired by rakyll/hey with tui animation.

A command-line benchmarking tool

This project collects GPU benchmarks from various cloud providers and compares them to fixed per token costs. Use our tool for efficient LLM GPU selections and cost-effective AI models. LLM provider p...

The fastest and most memory efficient lattice Boltzmann CFD software, running on all GPUs via OpenCL. Free for non-commercial use.

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA

RAID is the largest and most challenging benchmark for machine-generated text detectors. (ACL 2024)

VPS融合怪服务器测评脚本-GO重构版本

Trajectopy - Trajectory Evaluation in Python

Benchmark for LLM Reasoning & Understanding with Challenging Tasks from Real Users.

[ICLR 2024] SWE-Bench: Can Language Models Resolve Real-world Github Issues?

Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM

OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

⚡FlashRAG: A Python Toolkit for Efficient RAG Research

📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥

A command-line benchmarking tool

A series of large language models developed by Baichuan Intelligent Technology

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

VPS融合怪服务器测评脚本(VPS Fusion Monster Server Test Script)(尽量做最全能测试服务器的脚本)

A unified evaluation framework for large language models

Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM

[ICLR 2024] SWE-Bench: Can Language Models Resolve Real-world Github Issues?

Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718

Official code repository of CBGBench: Fill in the Blank of Protein-Molecule Complex Binding Graph

A universal load testing framework for Rust, with real-time tui support.