11 results found Sort:

QwenLM
Qwen QwenLM
1.2k
14.2k
apache-2.0
104
The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
llm chinese flash-attention pretrained-models large-language-models natural-language-processing
Created 2023-08-03
497 commits to main branch, last one 12 days ago
ymcui
Chinese-LLaMA-Alpaca-2 ymcui
576
7.1k
apache-2.0
79
中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
64k llm nlp rlhf yarn llama alpaca llama2 alpaca2 llama-2 alpaca-2 flash-attention large-language-models
Created 2023-07-18
264 commits to main branch, last one about a month ago
InternLM
InternLM InternLM
458
6.5k
apache-2.0
58
Official release of InternLM2.5 base and chat models. 1M context support
gpt llm rlhf chatbot chinese long-context fine-tuning-llm flash-attention pretrained-models large-language-model
Created 2023-07-06
234 commits to main branch, last one 3 days ago
DefTruth
Awesome-LLM-Inference DefTruth
193
2.9k
gpl-3.0
93
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
llm llms sora vllm deepseek open-sora awesome-llm tensorrt-llm llm-inference flash-attention paged-attention flash-attention-2 flash-attention-3
Created 2023-08-27
414 commits to main branch, last one 3 days ago
DefTruth
CUDA-Learn-Notes DefTruth
162
1.5k
gpl-3.0
13
📚Modern CUDA Learn Notes with PyTorch: Tensor/CUDA Cores, 📖150+ CUDA Kernels with PyTorch bindings, 📖HGEMM/SGEMM (95%~99% cuBLAS performance), 📖100+ LLM/CUDA Blogs.
cuda gemm gemv triton pytorch rmsnorm softmax layernorm elementwise warp-reduce block-reduce flash-attention cuda-programming flash-attention-2 flash-attention-3
Created 2022-12-17
360 commits to main branch, last one a day ago
flashinfer-ai
flashinfer flashinfer-ai
140
1.5k
apache-2.0
19
FlashInfer: Kernel Library for LLM Serving
gpu jit cuda pytorch llm-inference flash-attention large-large-models
Created 2023-07-22
816 commits to main branch, last one a day ago
InternLM
InternEvo InternLM
52
310
apache-2.0
10
InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
910b gemma llava zero3 llama3 pytorch internlm internlm2 multi-modal llm-training llm-framework ring-attention flash-attention deepspeed-ulysses tensor-parallelism transformers-models pipeline-parallelism sequence-parallelism
Created 2024-01-16
479 commits to develop branch, last one 3 days ago
DAMO-NLP-SG
Inf-CLIP DAMO-NLP-SG
9
178
apache-2.0
7
The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss". A super memory-efficiency CLIP training scheme.
clip ring-attention flash-attention memory-efficient infinite-batch-size contrastive-learning
Created 2024-10-16
29 commits to main branch, last one 22 days ago
CoinCheung
gdGPT CoinCheung
8
90
apache-2.0
1
Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
llm nlp bloom llama2 pytorch pipeline deepspeed chatglm3-6b baichuan2-7b mixtral-8x7b full-finetune flash-attention model-parallization
Created 2023-06-24
27 commits to master branch, last one 9 months ago
alexzhang13
flashattention2-custom-mask alexzhang13
7
77
apache-2.0
5
Triton implementation of FlashAttention2 that adds Custom Masks.
triton attention triton-lang cuda-kernels deep-learning flash-attention flash-attention-2 attention-mechanism
Created 2024-07-20
18 commits to main branch, last one 3 months ago
Bruce-Lee-LY
flash_attention_inference Bruce-Lee-LY
3
29
bsd-3-clause
1
Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
gpu llm mha cuda nvidia cutlass inference tensor-core flash-attention flash-attention-2 large-language-model multi-head-attention
Created 2023-08-16
1 commits to master branch, last one 2 months ago