Trending repositories for topic transformer
A high-throughput and memory-efficient inference and serving engine for LLMs
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), ga...
SGLang is a fast serving framework for large language models and vision language models.
pix2tex: Using a ViT to convert images of equations into LaTeX code.
A framework for few-shot evaluation of language models.
🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.
《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases
🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)
Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters
"You Only Need One Color Space: An Efficient Network for Low-light Image Enhancement"
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
Translate manga/image 一键翻译各类图片内文字 https://cotrans.touhou.ai/
BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, sa...
"You Only Need One Color Space: An Efficient Network for Low-light Image Enhancement"
Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters
Code release for Efficient Planning in a Compact Latent Action Space (ICLR2023) https://arxiv.org/abs/2208.10291.
Do Transformers Really Perform Bad for Graph Representation? [NIPS-2021]
[ECCV 2024 - Oral] HiT-SR: Hierarchical Transformer for Efficient Image Super-Resolution
[ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"
Code for "Cross-modal Learning for Image-Guided Point Cloud Shape Completion" (NeurIPS 2022)
Official PyTorch implementation of Superpoint Transformer introduced in [ICCV'23] "Efficient 3D Semantic Segmentation with Superpoint Transformer" and SuperCluster introduced in [3DV'24 Oral] "Scalabl...
whisper-cpp-serve Real-time speech recognition and c+ of OpenAI's Whisper model in C/C++
Official code, datasets and checkpoints for "Timer: Generative Pre-trained Transformers Are Large Time Series Models" (ICML 2024)
The official code for "TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecasting (ICLR 2024)". TEMPO is one of the very first open source Time Series Foundation Models for fo...
The official repo for the paper "HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Model"
A low-latency & high-throughput serving engine for LLMs
A PyTorch implementation of DTrOCR: Decoder-only Transformer for Optical Character Recognition
BERT4ETH: A Pre-trained Transformer for Ethereum Fraud Detection (WWW23)
A high-throughput and memory-efficient inference and serving engine for LLMs
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), ga...
🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.
SGLang is a fast serving framework for large language models and vision language models.
Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters
pix2tex: Using a ViT to convert images of equations into LaTeX code.
Large Language Model Text Generation Inference
A framework for few-shot evaluation of language models.
🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)
《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases
"You Only Need One Color Space: An Efficient Network for Low-light Image Enhancement"
Translate manga/image 一键翻译各类图片内文字 https://cotrans.touhou.ai/
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, sa...
An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.
Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters
"You Only Need One Color Space: An Efficient Network for Low-light Image Enhancement"
multispy is a lsp client library in Python intended to be used to build applications around language servers.
[ECCV 2024 - Oral] HiT-SR: Hierarchical Transformer for Efficient Image Super-Resolution
A low-latency & high-throughput serving engine for LLMs
whisper-cpp-serve Real-time speech recognition and c+ of OpenAI's Whisper model in C/C++
[ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"
[CVPR 2024] This repo is official PyTorch implementation of Joint Reconstruction of 3D Human and Object via Contact-Based Refinement Transformer.
The official code for "TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecasting (ICLR 2024)". TEMPO is one of the very first open source Time Series Foundation Models for fo...
Official code, datasets and checkpoints for "Timer: Generative Pre-trained Transformers Are Large Time Series Models" (ICML 2024)
EdgeFace: Efficient Face Recognition Model for Edge Devices [TBIOM 2024] the winner of compact track of IJCB 2023 Efficient Face Recognition Competition
The original transformer implementation from scratch. It contains informative comments on each block
[ICIP 2023] ArtiFact: A Large-Scale Dataset with Artificial (Fake) and Factual (Real) Images for Generalizable and Robust Synthetic Image Detection
A PyTorch implementation of DTrOCR: Decoder-only Transformer for Optical Character Recognition
Code release for Efficient Planning in a Compact Latent Action Space (ICLR2023) https://arxiv.org/abs/2208.10291.
Official implementation of the paper "DeblurDiNAT: A Generalizable Transformer for Perceptual Image Deblurring".
Do Transformers Really Perform Bad for Graph Representation? [NIPS-2021]
The official repo for the paper "HyperSIGMA: Hyperspectral Intelligence Comprehension Foundation Model"
Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters
🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.
A high-throughput and memory-efficient inference and serving engine for LLMs
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), ga...
SGLang is a fast serving framework for large language models and vision language models.
Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters
pix2tex: Using a ViT to convert images of equations into LaTeX code.
《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases
A framework for few-shot evaluation of language models.
🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)
Large Language Model Text Generation Inference
Translate manga/image 一键翻译各类图片内文字 https://cotrans.touhou.ai/
PyTorch native quantization and sparsity for training and inference
Natural Language Processing Tutorial for Deep Learning Researchers
Transformer: PyTorch Implementation of "Attention Is All You Need"
Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters
"You Only Need One Color Space: An Efficient Network for Low-light Image Enhancement"
[NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective
multispy is a lsp client library in Python intended to be used to build applications around language servers.
A PyTorch implementation of DTrOCR: Decoder-only Transformer for Optical Character Recognition
Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis
Official code, datasets and checkpoints for "Timer: Generative Pre-trained Transformers Are Large Time Series Models" (ICML 2024)
[ECCV 2024 - Oral] HiT-SR: Hierarchical Transformer for Efficient Image Super-Resolution
The official code for "TEMPO: Prompt-based Generative Pre-trained Transformer for Time Series Forecasting (ICLR 2024)". TEMPO is one of the very first open source Time Series Foundation Models for fo...
whisper-cpp-serve Real-time speech recognition and c+ of OpenAI's Whisper model in C/C++
Do Transformers Really Perform Bad for Graph Representation? [NIPS-2021]
Offical code of "QKFormer: Hierarchical Spiking Transformer using Q-K Attention" (NeurIPS 2024，Spotlight 3%)
Collection and Implementation of Mobile-based Vision Transformer in Pytorch
Pytorch implementation of "Genie: Generative Interactive Environments", Bruce et al. (2024).
The official PyTorch implementation for CascadedGaze: Efficiency in Global Context Extraction for Image Restoration, TMLR'24.
A Convolutional Transformer to decode mental states from Electroencephalography (EEG) for Brain-Computer Interfaces (BCI)
SGLang is a fast serving framework for large language models and vision language models.
🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)
Lumina-T2X is a unified framework for Text to Any Modality Generation
[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
🤖✨ChatMLX is a modern, open-source, high-performance chat application for MacOS based on large language models.
[Mamba-Survey-2024] Paper list for State-Space-Model/Mamba and it's Applications
T-GATE: Temporally Gating Attention to Accelerate Diffusion Model for Free!
Official code, datasets and checkpoints for "Timer: Generative Pre-trained Transformers Are Large Time Series Models" (ICML 2024)
Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters
[ECCV2024 Oral🔥] Official Implementation of "GiT: Towards Generalist Vision Transformer through Universal Language Interface"
[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
[ECCV 2024] Efficient Large-Baseline Radiance Fields, a feed-forward 2DGS model
An awesome repository & A comprehensive survey on interpretability of LLM attention heads.
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
Create-tsi is a generative AI RAG toolkit which generates AI Applications with low code.
[ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"
Deep learning in motion deblurring: current status, benchmarks and future prospects[J], The Visual Computer, 2024.
A high-throughput and memory-efficient inference and serving engine for LLMs
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
🧑🏫 60+ Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), ga...
SGLang is a fast serving framework for large language models and vision language models.
pix2tex: Using a ViT to convert images of equations into LaTeX code.
《李宏毅深度学习教程》（李宏毅老师推荐👍，苹果书🍎），PDF下载地址：https://github.com/datawhalechina/leedl-tutorial/releases
🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)
A framework for few-shot evaluation of language models.
🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.
Large Language Model Text Generation Inference
Translate manga/image 一键翻译各类图片内文字 https://cotrans.touhou.ai/
RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, sa...
Lumina-T2X is a unified framework for Text to Any Modality Generation
Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation a...
SGLang is a fast serving framework for large language models and vision language models.
📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥
[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)
PyTorch native quantization and sparsity for training and inference
[Mamba-Survey-2024] Paper list for State-Space-Model/Mamba and it's Applications
A Jax-based library for designing and training transformer models from scratch.
[ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters
[AAAI 2024] GLOP: Learning Global Partition and Local Construction for Solving Large-scale Routing Problems in Real-time
llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deployment, such as UI, RESTful API, auto-scaling, computing resource...
Build high-performance AI models with modular building blocks
[WACV 2024] "CVTHead: One-shot Controllable Head Avatar with Vertex-feature Transformer"
Learning Language-guided Adaptive Hyper-modality Representation for Multimodal Sentiment Analysis
Deep learning in motion deblurring: current status, benchmarks and future prospects[J], The Visual Computer, 2024.
Space Group Informed Transformer for Crystalline Materials Generation
OCR Tamil is a powerful tool that can detect and recognize text in Tamil images with high accuracy on Natural Scenes