Trending repositories for topic llama

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

Brand new TTS solution

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

A high-throughput and memory-efficient inference and serving engine for LLMs

LLM inference in C/C++

Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a ...

Finetune Llama 3.2, Mistral, Phi, Qwen & Gemma LLMs 2-5x faster with 80% less memory

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, tr...

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Ll...

Practical Llama 3 inference in Java

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Use PEFT or Full-parameter to finetune 400+ LLMs or 100+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-Vis...

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any...

An open-source implementation for training LLaVA-NeXT.

AirLLM 70B inference with single 4GB GPU

make LLMs improve through experience

A one-stop data processing system to make data higher-quality, juicier, and more digestible for (multimodal) LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！

SGLang is a fast serving framework for large language models and vision language models.

Dabarqus is a stand alone application that implements a complete RAG solution.

Dabarqus is a stand alone application that implements a complete RAG solution.

🦙 echoOLlama: A real-time voice AI platform powered by local LLMs. Features WebSocket streaming, voice interactions, and OpenAI API compatibility. Built with FastAPI, Redis, and PostgreSQL. Perfect f...

LLM inference server implementation based on llama.cpp.

An open-source implementation for training LLaVA-NeXT.

📋 NotebookMLX - An Open Source version of NotebookLM (Ported NotebookLlama)

Practical Llama 3 inference in Java

Vim plugin for LLM-assisted code/text completion

make LLMs improve through experience

Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

A list of free LLM inference resources accessible via API.

Hexabot is an open-source AI chatbot / agent builder. It allows you to create and manage multi-channel and multilingual chatbots / agents with ease.

This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT) variant. The implementation focuses on the model architecture ...

QA-Pilot is an interactive chat project that leverages online/local LLM for rapid understanding and navigation of GitHub code repository.

The first AI Agent Server, Eidolon is a pluggable Agent SDK and enterprise ready, deployment server for Agentic applications

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

End to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects

A modern and easy-to-use client for Ollama

Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.

A novel medical large language model family with 13/70B parameters, which have SOTA performances on various medical tasks

Create characters in Unity with LLMs!

🦙 echoOLlama: A real-time voice AI platform powered by local LLMs. Features WebSocket streaming, voice interactions, and OpenAI API compatibility. Built with FastAPI, Redis, and PostgreSQL. Perfect f...

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

Brand new TTS solution

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

A high-throughput and memory-efficient inference and serving engine for LLMs

LLM inference in C/C++

Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a ...

Finetune Llama 3.2, Mistral, Phi, Qwen & Gemma LLMs 2-5x faster with 80% less memory

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, tr...

📋 NotebookMLX - An Open Source version of NotebookLM (Ported NotebookLlama)

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

🦙 echoOLlama: A real-time voice AI platform powered by local LLMs. Features WebSocket streaming, voice interactions, and OpenAI API compatibility. Built with FastAPI, Redis, and PostgreSQL. Perfect f...

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Ll...

Practical Llama 3 inference in Java

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Use PEFT or Full-parameter to finetune 400+ LLMs or 100+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-Vis...

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any...

An open-source implementation for training LLaVA-NeXT.

make LLMs improve through experience

Dabarqus is a stand alone application that implements a complete RAG solution.

A one-stop data processing system to make data higher-quality, juicier, and more digestible for (multimodal) LLMs! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷为大模型提供更高质量、更丰富、更易”消化“的数据！

🦙 echoOLlama: A real-time voice AI platform powered by local LLMs. Features WebSocket streaming, voice interactions, and OpenAI API compatibility. Built with FastAPI, Redis, and PostgreSQL. Perfect f...

Dabarqus is a stand alone application that implements a complete RAG solution.

📋 NotebookMLX - An Open Source version of NotebookLM (Ported NotebookLlama)

LLM inference server implementation based on llama.cpp.

Open source AI analyst powered by E2B. Analyze your CSV files with Llama 3.1 and create interactive charts.

An open-source implementation for training LLaVA-NeXT.

Practical Llama 3 inference in Java

Vim plugin for LLM-assisted code/text completion

make LLMs improve through experience

Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

A list of free LLM inference resources accessible via API.

Hexabot is an open-source AI chatbot / agent builder. It allows you to create and manage multi-channel and multilingual chatbots / agents with ease.

This repository contains an implementation of the LLaMA 2 (Large Language Model Meta AI) model, a Generative Pretrained Transformer (GPT) variant. The implementation focuses on the model architecture ...

QA-Pilot is an interactive chat project that leverages online/local LLM for rapid understanding and navigation of GitHub code repository.

The first AI Agent Server, Eidolon is a pluggable Agent SDK and enterprise ready, deployment server for Agentic applications

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

End to End Generative AI Industry Projects on LLM Models with Deployment_Awesome LLM Projects

Building a 2.3M-parameter LLM from scratch with LLaMA 1 architecture.

A novel medical large language model family with 13/70B parameters, which have SOTA performances on various medical tasks

Create characters in Unity with LLMs!

📋 NotebookMLX - An Open Source version of NotebookLM (Ported NotebookLlama)

Vim plugin for LLM-assisted code/text completion

The official code of the paper "Deciphering Cross-Modal Alignment in Large Vision-Language Models with Modality Integration Rate".

🦙 echoOLlama: A real-time voice AI platform powered by local LLMs. Features WebSocket streaming, voice interactions, and OpenAI API compatibility. Built with FastAPI, Redis, and PostgreSQL. Perfect f...

Hallucinations (Confabulations) Document-Based Benchmark for RAG

A native macOS app that allows users to chat with a local LLM with RAG capabilities. It can gain context from resources including folders, files and websites.

Open source AI analyst powered by E2B. Analyze your CSV files with Llama 3.1 and create interactive charts.

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a ...

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

A high-throughput and memory-efficient inference and serving engine for LLMs

LLM inference in C/C++

Finetune Llama 3.2, Mistral, Phi, Qwen & Gemma LLMs 2-5x faster with 80% less memory

Brand new TTS solution

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, tr...

AirLLM 70B inference with single 4GB GPU

🧑‍🚀 全世界最好的LLM资料总结 | Summary of the world's best LLM resources.

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

SGLang is a fast serving framework for large language models and vision language models.

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Ll...

Use PEFT or Full-parameter to finetune 400+ LLMs or 100+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-Vis...

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any...

Hexabot is an open-source AI chatbot / agent builder. It allows you to create and manage multi-channel and multilingual chatbots / agents with ease.

make LLMs improve through experience

PyTorch native quantization and sparsity for training and inference

Harness LLMs with Multi-Agent Programming

The official code of the paper "Deciphering Cross-Modal Alignment in Large Vision-Language Models with Modality Integration Rate".

🦙 echoOLlama: A real-time voice AI platform powered by local LLMs. Features WebSocket streaming, voice interactions, and OpenAI API compatibility. Built with FastAPI, Redis, and PostgreSQL. Perfect f...

LangCommand is a local inference command-line tool that transforms natural language descriptions into shell commands.

📋 NotebookMLX - An Open Source version of NotebookLM (Ported NotebookLlama)

make LLMs improve through experience

Hexabot is an open-source AI chatbot / agent builder. It allows you to create and manage multi-channel and multilingual chatbots / agents with ease.

Hallucinations (Confabulations) Document-Based Benchmark for RAG

Vim plugin for LLM-assisted code/text completion

This repository provides programs to build Retrieval Augmented Generation (RAG) code for Generative AI with LlamaIndex, Deep Lake, and Pinecone leveraging the power of OpenAI and Hugging Face models f...

A list of free LLM inference resources accessible via API.

LLM inference server implementation based on llama.cpp.

Custom nodes for using fal API. Video generation with Kling, Runway, Luma. Image generation with Flux. LLMs and VLMs OpenAI, Claude, Llama and Gemini.

Full stack tools for building voice agents

Practical Llama 3 inference in Java

🔮 Using ChatGPT4/3.5-turbo/Gemini-Pro/BlackBox and etc. unlimited and free

An open-source implementation for training LLaVA-NeXT.

🧑‍🚀 全世界最好的LLM资料总结 | Summary of the world's best LLM resources.

Offical Repo for "Programming Every Example: Lifting Pre-training Data Quality Like Experts at Scale"

LLM Jailbreaks, ChatGPT, Claude, Llama, DAN Prompts, Prompt Leaking

This is a PHP library for Ollama. Ollama is an open-source project that serves as a powerful and user-friendly platform for running LLMs on your local machine. It acts as a bridge between the complexi...

Finetune Llama 3.2, Mistral, Phi, Qwen & Gemma LLMs 2-5x faster with 80% less memory

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Private & local AI personal knowledge management app for high entropy thinkers.

SGLang is a fast serving framework for large language models and vision language models.

Llama3、Llama3.1 中文仓库（随书籍撰写中... 各种网友及厂商微调、魔改版本有趣权重 & 训练、推理、评测、部署教程视频 & 文档）

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

Efficient Triton Kernels for LLM Training

Turn any webpage into structured data using LLMs

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

🧑‍🚀 全世界最好的LLM资料总结 | Summary of the world's best LLM resources.

中文羊驼大模型三期项目 (Chinese Llama-3 LLMs) developed from Meta Llama 3

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

仅需Python基础，从0构建大语言模型；从0逐步构建GLM4\Llama3\RWKV6， 深入理解大模型原理

Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation

Lag-Llama: Towards Foundation Models for Probabilistic Time Series Forecasting

Help your LLMs online

Dify in ComfyUI includes Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai/gemini interfaces, such as o1,ollama, grok, qwe...

🍦 Speech-AI-Forge is a project developed around TTS generation model, implementing an API Server and a Gradio-based WebUI.

Empower Large Language Models (LLM) using Knowledge Graph based Retrieval-Augmented Generation (KG-RAG) for knowledge intensive tasks

Create characters in Unity with LLMs!

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

LLM inference in C/C++

A high-throughput and memory-efficient inference and serving engine for LLMs

Finetune Llama 3.2, Mistral, Phi, Qwen & Gemma LLMs 2-5x faster with 80% less memory

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Ll...

Brand new TTS solution

整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, tr...

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Scripts for fine-tuning Meta Llama with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a ...

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用

Private & local AI personal knowledge management app for high entropy thinkers.

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SF...

SGLang is a fast serving framework for large language models and vision language models.

Tools for merging pretrained large language models.

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any...

Llama3、Llama3.1 中文仓库（随书籍撰写中... 各种网友及厂商微调、魔改版本有趣权重 & 训练、推理、评测、部署教程视频 & 文档）

Java version of LangChain

Finetune Llama 3.2, Mistral, Phi, Qwen & Gemma LLMs 2-5x faster with 80% less memory

Brand new TTS solution

PyTorch native quantization and sparsity for training and inference

中文羊驼大模型三期项目 (Chinese Llama-3 LLMs) developed from Meta Llama 3

SGLang is a fast serving framework for large language models and vision language models.

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling

Fast Multimodal LLM on Mobile Devices

🍦 Speech-AI-Forge is a project developed around TTS generation model, implementing an API Server and a Gradio-based WebUI.

A modern and easy-to-use client for Ollama

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

A Discord LLM chat bot that supports any OpenAI compatible API (OpenAI, xAI, Mistral, Groq, OpenRouter, ollama, LM Studio and more)

All-in-one desktop app for running LLMs locally.

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

LLaMA (Language Learning for Machine Translation) adalah proyek riset yang diprakarsai oleh Facebook AI Research (FAIR) yang bertujuan untuk meningkatkan kualitas terjemahan mesin menggunakan pendekat...

A complete guide to start and improve your LLM skills in 2024 with little background in the field and stay up-to-date with the latest news and state-of-the-art techniques!

A high-performance inference system for large language models, designed for production environments.

Turn any webpage into structured data using LLMs

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.