Search Results - RepositoryStats

Qwen QwenLM

1.2k

14.9k

apache-2.0

110

The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.

llm chinese flash-attention pretrained-models large-language-models natural-language-processing

Created 2023-08-03

499 commits to main branch, last one 9 days ago

Chinese-LLaMA-Alpaca-2 ymcui

577

7.1k

apache-2.0

78

中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

64k llm nlp rlhf yarn llama alpaca llama2 alpaca2 llama-2 alpaca-2 flash-attention large-language-models

Created 2023-07-18

264 commits to main branch, last one 2 months ago

InternLM InternLM

463

6.6k

apache-2.0

59

Official release of InternLM2.5 base and chat models. 1M context support

gpt llm rlhf chatbot chinese long-context fine-tuning-llm flash-attention pretrained-models large-language-model

Created 2023-07-06

235 commits to main branch, last one about a month ago

Awesome-LLM-Inference DefTruth

206

3.0k

gpl-3.0

102

📖A curated list of Awesome LLM/VLM Inference Papers with codes, such as FlashAttention, PagedAttention, Parallelism, etc. 🎉🎉

llm llms sora vllm deepseek open-sora awesome-llm tensorrt-llm llm-inference flash-attention paged-attention flash-attention-2 flash-attention-3

Created 2023-08-27

428 commits to main branch, last one 13 days ago

flashinfer flashinfer-ai

160

1.6k

apache-2.0

21

FlashInfer: Kernel Library for LLM Serving

gpu jit cuda pytorch llm-inference flash-attention large-large-models

Created 2023-07-22

863 commits to main branch, last one a day ago

InternEvo InternLM

54

317

apache-2.0

10

InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.

910b gemma llava zero3 llama3 pytorch internlm internlm2 multi-modal llm-training llm-framework ring-attention flash-attention deepspeed-ulysses tensor-parallelism transformers-models pipeline-parallelism sequence-parallelism

Created 2024-01-16

493 commits to develop branch, last one 4 days ago

Inf-CLIP DAMO-NLP-SG

9

214

apache-2.0

6

The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss". A super memory-efficiency CLIP training scheme.

clip ring-attention flash-attention memory-efficient infinite-batch-size contrastive-learning

Created 2024-10-16

29 commits to main branch, last one about a month ago

gdGPT CoinCheung

8

91

apache-2.0

1

Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.

llm nlp bloom llama2 pytorch pipeline deepspeed chatglm3-6b baichuan2-7b mixtral-8x7b full-finetune flash-attention model-parallization

Created 2023-06-24

27 commits to master branch, last one 10 months ago

flashattention2-custom-mask alexzhang13

8

86

apache-2.0

5

Triton implementation of FlashAttention2 that adds Custom Masks.

triton attention triton-lang cuda-kernels deep-learning flash-attention flash-attention-2 attention-mechanism

Created 2024-07-20

18 commits to main branch, last one 4 months ago

flash_attention_inference Bruce-Lee-LY

3

32

bsd-3-clause

1

Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.

gpu llm mha cuda nvidia cutlass inference tensor-core flash-attention flash-attention-2 large-language-model multi-head-attention

Created 2023-08-16

1 commits to master branch, last one 3 months ago

decoding_attention Bruce-Lee-LY

1

26

bsd-3-clause

2

Decoding Attention is specially optimized for multi head attention (MHA) using CUDA core for the decoding stage of LLM inference.

gpu llm mha cuda nvidia cuda-core inference flashinfer flash-attention decoding-attention large-language-model multi-head-attention

Created 2024-08-14

1 commits to master branch, last one about a month ago