4 results found Sort:

33
196
mit
4
Shush is an app that deploys a WhisperV3 model with Flash Attention v2 on Modal and makes requests to it via a NextJS app
Created 2023-11-18
64 commits to main branch, last one 7 months ago
Triton implementation of FlashAttention2 that adds Custom Masks.
Created 2024-07-20
18 commits to main branch, last one 5 months ago
Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
Created 2023-08-16
1 commits to master branch, last one 4 months ago
Uses the powerful WhisperS2T and Ctranslate2 libraries to batch transcribe multiple files
Created 2024-02-29
33 commits to main branch, last one 4 months ago