3 results found Sort:

kennethleungty
Llama-2-Open-Source-LLM-CPU-Inference kennethleungty
212
950
mit
14
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
cpu llm nlp faiss llama python chatgpt llama-2 langchain document-qa transformers cpu-inference deep-learning c-transformers language-models open-source-llm machine-learning large-language-models sentence-transformers natural-language-processing
Created 2023-07-06
37 commits to main branch, last one about a year ago
CoderLSF
fast-llama CoderLSF
8
86
mit
7
Runs LLaMA with Extremely HIGH speed
llama llama2 cpu-inference inference-engine
Created 2023-11-07
159 commits to main branch, last one about a year ago
rbitr
llm.f90 rbitr
4
53
mit
5
LLM inference in Fortran
ai llm llama mamba phi-2 llama2 chatbot llamacpp transformer cpu-inference language-model state-space-model
Created 2023-09-03
99 commits to master branch, last one 10 months ago