4 results found Sort:
- Filter by Primary Language:
- Python (2)
- C++ (1)
- TypeScript (1)
- +
Shush is an app that deploys a WhisperV3 model with Flash Attention v2 on Modal and makes requests to it via a NextJS app
Created
2023-11-18
64 commits to main branch, last one 7 months ago
Triton implementation of FlashAttention2 that adds Custom Masks.
Created
2024-07-20
18 commits to main branch, last one 5 months ago
Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
Created
2023-08-16
1 commits to master branch, last one 4 months ago
Uses the powerful WhisperS2T and Ctranslate2 libraries to batch transcribe multiple files
Created
2024-02-29
33 commits to main branch, last one 4 months ago