Statistics for topic llama

Get up and running with Llama 3.3, Mistral, Gemma 2, and other large language models.

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

A high-throughput and memory-efficient inference and serving engine for LLMs

SOTA Open Source TTS

LLM inference in C/C++

Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O

Zotero chat PDF with GPT, ChatGPT, Claude, Gemini

Hallucinations (Confabulations) Document-Based Benchmark for RAG

The llama model inference lite framework by triton.

The first AI Agent Server, Eidolon is a pluggable Agent SDK and enterprise ready, deployment server for Agentic applications

Get up and running with Llama 3.3, Mistral, Gemma 2, and other large language models.

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

SOTA Open Source TTS

A high-throughput and memory-efficient inference and serving engine for LLMs

LLM inference in C/C++

This repository provides programs to build Retrieval Augmented Generation (RAG) code for Generative AI with LlamaIndex, Deep Lake, and Pinecone leveraging the power of OpenAI and Hugging Face models f...

The llama model inference lite framework by triton.

Implementing OCR with a local visual model run by ollama.

Zotero chat PDF with GPT, ChatGPT, Claude, Gemini

A highly optimized LLM inference acceleration engine for Llama and its variants.

Zotero chat PDF with GPT, ChatGPT, Claude, Gemini

A highly optimized LLM inference acceleration engine for Llama and its variants.

Implementing OCR with a local visual model run by ollama.

🚀LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training

Run Ollama LLM models in Google Colab

Get up and running with Llama 3.3, Mistral, Gemma 2, and other large language models.

SOTA Open Source TTS

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

A high-throughput and memory-efficient inference and serving engine for LLMs

LLM inference in C/C++

🚀LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training

The llama model inference lite framework by triton.

Simple is Effective: The Roles of Graphs and Large Language Models in Knowledge-Graph-Based Retrieval-Augmented Generation

This repository provides programs to build Retrieval Augmented Generation (RAG) code for Generative AI with LlamaIndex, Deep Lake, and Pinecone leveraging the power of OpenAI and Hugging Face models f...

TensorZero creates a feedback loop for optimizing LLM applications — turning production data into smarter, faster, and cheaper models.

SGLang is a fast serving framework for large language models and vision language models.

Llama3、Llama3.1 中文仓库（随书籍撰写中... 各种网友及厂商微调、魔改版本有趣权重 & 训练、推理、评测、部署教程视频 & 文档）

Efficient Triton Kernels for LLM Training

🧑‍🚀 全世界最好的LLM资料总结 | Summary of the world's best LLM resources.

Turn any webpage into structured data using LLMs

Get up and running with Llama 3.3, Mistral, Gemma 2, and other large language models.

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

LLM inference in C/C++

A high-throughput and memory-efficient inference and serving engine for LLMs

aider is AI pair programming in your terminal

Private & local AI personal knowledge management app for high entropy people.

中文羊驼大模型三期项目 (Chinese Llama-3 LLMs) developed from Meta Llama 3

SGLang is a fast serving framework for large language models and vision language models.

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization