Search Results - RepositoryStats

17

233

apache-2.0

8

A fast communication-overlapping library for tensor parallelism on GPUs.

gpu cuda cutlass pytorch

Created 2024-03-01

24 commits to main branch, last one about a month ago

13

107

mit

1

Examples of CUDA implementations by Cutlass CuTe

gpu cuda cutlass

Created 2024-04-28

26 commits to main branch, last one 9 days ago

3

30

bsd-3-clause

1

Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.

gpu llm mha cuda nvidia cutlass inference tensor-core flash-attention flash-attention-2 large-language-model multi-head-attention

Created 2023-08-16

1 commits to master branch, last one 2 months ago