7 results found Sort:

QwenLM
Qwen QwenLM
995
12.3k
apache-2.0
96
The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
llm chinese flash-attention pretrained-models large-language-models natural-language-processing
Created 2023-08-03
487 commits to main branch, last one 6 days ago
ymcui
Chinese-LLaMA-Alpaca-2 ymcui
569
7.0k
apache-2.0
75
中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
64k llm nlp rlhf yarn llama alpaca llama2 alpaca2 llama-2 alpaca-2 flash-attention large-language-models
Created 2023-07-18
263 commits to main branch, last one about a month ago
InternLM
InternLM InternLM
398
5.5k
apache-2.0
49
Official release of InternLM2 7B and 20B base and chat models. 200K context support
gpt llm rlhf chatbot chinese long-context fine-tuning-llm flash-attention pretrained-models large-language-model
Created 2023-07-06
220 commits to main branch, last one 8 days ago
DefTruth
Awesome-LLM-Inference DefTruth
128
1.8k
gpl-3.0
69
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
llm llms sora vllm deepseek open-sora awesome-llm tensorrt-llm llm-inference streaming-llm flash-attention paged-attention flash-attention-2
Created 2023-08-27
292 commits to main branch, last one 2 days ago
DefTruth
CUDA-Learn-Notes DefTruth
80
796
gpl-3.0
10
🎉CUDA 笔记 / 大模型手撕CUDA / C++笔记，更新随缘: flash_attn、sgemm、sgemv、warp reduce、block reduce、dot product、elementwise、softmax、layernorm、rmsnorm、hist etc.
cuda gemm gemv rmsnorm softmax layernorm elementwise warp-reduce block-reduce cuda-kernels flash-attention cuda-programming flash-attention-2
Created 2022-12-17
108 commits to main branch, last one 3 days ago
flashinfer-ai
flashinfer flashinfer-ai
59
742
apache-2.0
12
FlashInfer: Kernel Library for LLM Serving
gpu tvm cuda pytorch llm-inference flash-attention large-large-models
Created 2023-07-22
601 commits to main branch, last one 2 days ago
CoinCheung
gdGPT CoinCheung
8
88
apache-2.0
1
Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
llm nlp bloom llama2 pytorch pipeline deepspeed chatglm3-6b baichuan2-7b mixtral-8x7b full-finetune flash-attention model-parallization
Created 2023-06-24
27 commits to master branch, last one 4 months ago