Search Results - RepositoryStats

InternLM InternLM

482

6.8k

apache-2.0

58

Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).

gpt llm rlhf chatbot chinese long-context fine-tuning-llm flash-attention pretrained-models large-language-model

Created 2023-07-06

245 commits to main branch, last one about a month ago

LongLoRA dvlab-research

283

2.7k

apache-2.0

13

Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)

llm lora long-context fine-tuning-llm large-language-models

Created 2023-09-21

173 commits to main branch, last one 7 months ago

LongWriter THUDM

161

1.6k

apache-2.0

18

[ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs

llm long-text fine-tuning long-context

Created 2024-08-12

31 commits to main branch, last one 5 months ago

LongBench THUDM

79

830

mit

8

LongBench v2 and LongBench (ACL 2024)

llm longtext benchmark long-context

Created 2023-07-29

79 commits to main branch, last one 2 months ago

ringattention haoliuhl

53

697

apache-2.0

6

Large Context Attention

long-context transformers memory-efficient large-language-models

Created 2023-06-01

56 commits to main branch, last one 2 months ago

MEGABYTE-pytorch lucidrains

55

640

mit

10

Implementation of MEGABYTE, Predicting Million-byte Sequences with Multiscale Transformers, in Pytorch

long-context transformers deep-learning attention-mechanisms learned-tokenization artificial-intelligence

Created 2023-05-15

36 commits to main branch, last one 3 months ago

ring-attention-pytorch lucidrains

30

509

mit

11

Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch

long-context attention-mechanism efficient-attention distributed-attention

Created 2024-02-14

221 commits to main branch, last one 5 months ago

LongCite THUDM

33

486

apache-2.0

12

LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QA

llm benchmark fine-tuning long-context citation-generation

Created 2024-08-31

55 commits to main branch, last one 3 months ago

kvpress NVIDIA

32

447

apache-2.0

13

LLM KV cache compression made easy

llm python pytorch kv-cache inference long-context transformers kv-cache-compression large-language-models

Created 2024-11-06

33 commits to main branch, last one 17 days ago

recurrent-memory-transformer-pytorch lucidrains

16

406

mit

13

Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch

memory recurrence long-context transformers deep-learning attention-mechanisms artificial-intelligence

Created 2023-04-24

71 commits to main branch, last one 2 months ago

InfLLM thunlp

34

348

mit

16

The code of our paper "InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory"

llm long-context training-free large-language-models

Created 2024-03-03

41 commits to main branch, last one 11 months ago

InfiniteBench OpenBMB

26

315

mit

8

Codes for the paper "∞Bench: Extending Long Context Evaluation Beyond 100K Tokens": https://arxiv.org/abs/2402.13718

benchmark long-context large-language-models

Created 2023-11-22

76 commits to main branch, last one 6 months ago

infini-transformer dingo-actual

23

287

mit

5

PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" (https://arxiv.org/abs/2404.07143)

pytorch long-context transformers deep-learning infini-attention mixture-of-depths attention-mechanism

Created 2024-04-15

81 commits to main branch, last one 11 months ago

Long-VITA VITA-MLLM

29

267

other

15

✨✨Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracy

mllm long-context vision-language-model

Created 2024-12-14

46 commits to main branch, last one 17 days ago

LongAlign THUDM

20

249

apache-2.0

8

[EMNLP 2024] LongAlign: A Recipe for Long Context Alignment of LLMs

llm longtext alignment long-context

Created 2024-01-27

46 commits to main branch, last one 3 months ago

TriForce Infini-AI-Lab

17

245

unknown

2

[COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

llm inference efficiency acceleration long-context llm-inference speculative-decoding

Created 2024-04-04

17 commits to main branch, last one 7 months ago

awesome-llm-plaza metame-ai

13

191

mit

14

awesome llm plaza: daily tracking all sorts of awesome topics of llm, e.g. llm for coding, robotics, reasoning, multimod etc.

llm awesome awesome-rlhf long-context llm-application awesome-code-llm awesome-llm-plaza awesome-llm-agents awesome-llm-prompt awesome-llm-security awesome-multimod-llm awesome-robotics-llm awesome-llm-reasoning

Created 2023-11-12

251 commits to main branch, last one 8 days ago

LooGLE bigai-nlco

7

181

mit

3

ACL 2024 | LooGLE: Long Context Evaluation for Long-Context Language Models

llm acl2024 long-context large-language-models

Created 2023-11-02

26 commits to main branch, last one 6 months ago

Retrieval_Head nightdessert

18

180

unknown

2

open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality

long-context large-language-models

Created 2024-04-18

23 commits to main branch, last one 8 months ago

LongQLoRA yangjianxin1

15

164

unknown

2

LongQLoRA: Extent Context Length of LLMs Efficiently

llm lora qlora longlora long-context

Created 2023-10-22

25 commits to master branch, last one about a year ago

ShadowKV bytedance

9

155

apache-2.0

3

ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference

low-rank research cpu-offload long-context llm-inference high-throughput sparse-attention

Created 2024-10-22

13 commits to main branch, last one 5 months ago

LM-Infinite Glaciohound

13

139

mit

4

Implementation of NAACL 2024 Outstanding Paper "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"

long-context language-model model-diagnostics

Created 2023-05-31

19 commits to main branch, last one 6 months ago

lloco jeffreysijuntan

9

116

mit

3

The official repo for "LLoCo: Learning Long Contexts Offline"

llm pytorch finetune long-context context-compression

Created 2024-04-12

4 commits to main branch, last one 9 months ago

MM-NIAH OpenGVLab

5

114

unknown

2

[NeurIPS 2024] Needle In A Multimodal Haystack (MM-NIAH): A comprehensive benchmark designed to systematically evaluate the capability of existing MLLMs to comprehend long multimodal documents.

benchmark long-context vision-language-model multimodal-large-language-models

Created 2024-06-05

53 commits to main branch, last one 4 months ago

infini-transformer-pytorch lucidrains

4

110

mit

2

Implementation of Infini-Transformer in Pytorch

memory long-context transformers deep-learning attention-mechanism artificial-intelligence

Created 2024-05-01

47 commits to main branch, last one 3 months ago

LongRAG QingFei1

14

101

unknown

6

[EMNLP 2024] LongRAG: A Dual-perspective Retrieval-Augmented Generation Paradigm for Long-Context Question Answering

llm rag long-context

Created 2024-10-03

4 commits to main branch, last one 2 months ago

perceiver-ar-pytorch lucidrains

4

87

mit

4

Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver architecture, in Pytorch

transformer long-context deep-learning attention-mechanism artficial-intelligence

Created 2022-06-18

20 commits to main branch, last one 2 years ago

Counting-Stars nick7nlp

2

82

mit

3

Counting-Stars (★)

long-context evaluation-metrics large-language-model

Created 2024-03-13

192 commits to main branch, last one 7 months ago

VideoLLaMB bigai-nlco

2

67

unknown

3

Official Repository of VideoLLaMB: Long Video Understanding with Recurrent Memory Bridges

long-context video-language-pretraining video-language-understanding

Created 2024-08-19

14 commits to master branch, last one about a month ago

WritingBench X-PLUG

6

56

apache-2.0

0

WritingBench: A Comprehensive Benchmark for Generative Writing

ai llm nlp writing benchmark long-text huggingface long-context text-generation evaluation-framework

Created 2025-03-10

13 commits to main branch, last one 17 days ago