Statistics for topic llm-inference

Graph-Based Editor for LLM Workflows

A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/autogen-officehour

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

A list of software that allows searching the web with the assistance of AI.

Graph-Based Editor for LLM Workflows

Chrome extension that interacts with content using Groq

Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O

MagicPIG: LSH Sampling for Efficient LLM Generation

A research project to add some brrrrrr to Burp

Graph-Based Editor for LLM Workflows

A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/autogen-officehour

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Graph-Based Editor for LLM Workflows

Chrome extension that interacts with content using Groq

The llama model inference lite framework by triton.

All the code and materials related to our YouTube channel (TwoSetAI)

A research project to add some brrrrrr to Burp

A research project to add some brrrrrr to Burp

Chrome extension that interacts with content using Groq

A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/autogen-officehour

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

Graph-Based Editor for LLM Workflows

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Efficient LLM Inference over Long Sequences

Graph-Based Editor for LLM Workflows

The llama model inference lite framework by triton.

LLM notes, including model inference, transformer model structure, and llm framework code analysis notes

A research project to add some brrrrrr to Burp

MagicPIG: LSH Sampling for Efficient LLM Generation

Code examples and resources for DBRX, a large language model developed by Databricks

Optimizing inference proxy for LLMs

Arch is an intelligent gateway for agents. Engineered with (fast) LLMs for the secure handling, rich observability, and seamless integration of prompts with your APIs - all outside business logic. Bui...

Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.

Graph-Based Editor for LLM Workflows

A programming framework for agentic AI 🤖 PyPi: autogen-agentchat Discord: https://aka.ms/autogen-discord Office Hour: https://aka.ms/autogen-officehour

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Graph-Based Editor for LLM Workflows

Streamlines and simplifies prompt design for both developers and non-technical users with a low code approach.

校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。

An acceleration library that supports arbitrary bit-width combinatorial quantization operations

USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference