Trending repositories for topic mlops
A high-throughput and memory-efficient inference and serving engine for LLMs
Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
Turns Data and AI algorithms into production-ready web applications in no time.
Label Studio is a multi-type data labeling and annotation tool with standardized output format
🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 11 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 ...
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a c...
Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
🔥 A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，支持sso登录，多租户，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，serverless，标注平台，自动化标注，数据集管理，大模型微调，vllm大模型推理，llmops，私有知识库，AI模型应用商店，支持模型一键开发/推理/微调，支持国...
An orchestration platform for the development, production, and observation of data assets.
An awesome & curated list of best LLMOps tools for developers
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckD...
This repo provides a customizable stack for starting new ML projects on Databricks that follow production best-practices out of the box.
🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 11 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 ...
Here lies the resources and topics necessary for the role of Data Scientist and Machine Learning
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
ML/AI meta-model, used in MLRun/Iguazio/Nuclio, see qgate-sln-<solution>
VectorHub is a free, open-source learning website for people (software developers to senior ML architects) interested in adding vector retrieval to their ML stack.
Unified storage framework for the entire machine learning lifecycle
A Full Stack ML (Machine Learning) Roadmap involves learning the necessary skills and technologies to become proficient in all aspects of machine learning, including data collection and preprocessing,...
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.
Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, persist, and execute on your own infrastructure.
A Hands on Guide on MLOps Practices to take your model from Laptop to Production. Created by the Author - Nachiketh Murthy
🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
Learn how to create, develop, and maintain a state-of-the-art MLOps code base
A high-throughput and memory-efficient inference and serving engine for LLMs
cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，支持sso登录，多租户，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，serverless，标注平台，自动化标注，数据集管理，大模型微调，vllm大模型推理，llmops，私有知识库，AI模型应用商店，支持模型一键开发/推理/微调，支持国...
A high-throughput and memory-efficient inference and serving engine for LLMs
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.
Turns Data and AI algorithms into production-ready web applications in no time.
Label Studio is a multi-type data labeling and annotation tool with standardized output format
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckD...
🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 11 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 ...
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a c...
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
An orchestration platform for the development, production, and observation of data assets.
A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，支持sso登录，多租户，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，serverless，标注平台，自动化标注，数据集管理，大模型微调，vllm大模型推理，llmops，私有知识库，AI模型应用商店，支持模型一键开发/推理/微调，支持国...
🔥 A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.
The easiest way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Multi-model Inference Graph/Pipelines, LLM/RAG apps, and more!
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 11 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 ...
A Hands on Guide on MLOps Practices to take your model from Laptop to Production. Created by the Author - Nachiketh Murthy
This repo provides a customizable stack for starting new ML projects on Databricks that follow production best-practices out of the box.
ML/AI meta-model, used in MLRun/Iguazio/Nuclio, see qgate-sln-<solution>
7 Day AI ML Fundamentals Workshop The purpose of this FREE workshop is 1. To give you a boost of getting started with AI. 2. A life-long community with a similar mindset. 3. strong grip on fundamental...
Scalable Machine Learning and Deep Learning, Final Project, 2023/2024
Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, persist, and execute on your own infrastructure.
Awesome products for securing AI systems includes open source and commercial options and an infographic licensed CC-BY-SA-4.0.
Here lies the resources and topics necessary for the role of Data Scientist and Machine Learning
VectorHub is a free, open-source learning website for people (software developers to senior ML architects) interested in adding vector retrieval to their ML stack.
Additional packages (components, document stores and the likes) to extend the capabilities of Haystack version 2.0 and onwards
A Full Stack ML (Machine Learning) Roadmap involves learning the necessary skills and technologies to become proficient in all aspects of machine learning, including data collection and preprocessing,...
Unified storage framework for the entire machine learning lifecycle
Modern columnar data format for ML and LLMs implemented in Rust. Convert from parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckD...
🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps
A curated list of awesome open source tools and commercial products for monitoring data quality, monitoring model performance, and profiling data 🚀
Awesome products for securing AI systems includes open source and commercial options and an infographic licensed CC-BY-SA-4.0.
A high-throughput and memory-efficient inference and serving engine for LLMs
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
Turns Data and AI algorithms into production-ready web applications in no time.
A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
Label Studio is a multi-type data labeling and annotation tool with standardized output format
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
🐢 Open-Source Evaluation & Testing for LLMs and ML models
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a c...
Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.
🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 11 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 ...
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，支持sso登录，多租户，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，serverless，标注平台，自动化标注，数据集管理，大模型微调，vllm大模型推理，llmops，私有知识库，AI模型应用商店，支持模型一键开发/推理/微调，支持国...
An orchestration platform for the development, production, and observation of data assets.
Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.
Learn how to design, develop, deploy and iterate on production-grade ML applications.
An awesome & curated list of best LLMOps tools for developers
Learn how to create, develop, and maintain a state-of-the-art MLOps code base
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
7 Day AI ML Fundamentals Workshop The purpose of this FREE workshop is 1. To give you a boost of getting started with AI. 2. A life-long community with a similar mindset. 3. strong grip on fundamental...
🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 11 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 ...
ML/AI meta-model, used in MLRun/Iguazio/Nuclio, see qgate-sln-<solution>
Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, persist, and execute on your own infrastructure.
A Hands on Guide on MLOps Practices to take your model from Laptop to Production. Created by the Author - Nachiketh Murthy
A curated list of open source tools used in analytical stacks and data engineering ecosystem
💻 Decoding ML articles hub: Hands-on articles with code on production-grade ML
Open source AI platform for rapid development of advanced AI and AGI pipelines.
Scalable Machine Learning and Deep Learning, Final Project, 2023/2024
A Full Stack ML (Machine Learning) Roadmap involves learning the necessary skills and technologies to become proficient in all aspects of machine learning, including data collection and preprocessing,...
deploy ML Infrastructure and MLOps tooling anywhere quickly and with best practices with a single command
Additional packages (components, document stores and the likes) to extend the capabilities of Haystack version 2.0 and onwards
A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
A curated list of MLSecOps tools, articles and other resources on security applied to Machine Learning and MLOps systems.
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦�...
:closed_book: Clarity in the current fast-paced mess of Open Source innovation
🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 11 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 ...
Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.
Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, persist, and execute on your own infrastructure.
Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability.
Kickstart your MLOps initiative with a flexible, robust, and productive Python package.
VectorHub is a free, open-source learning website for people (software developers to senior ML architects) interested in adding vector retrieval to their ML stack.
An extensive library of AI resources including books, courses, papers, guides, articles, tutorials, notebooks, AI field advancements and more.
One-click machine learning deployment (LLM, text-to-image and so on) at scale on any cluster (GCP, AWS, Lambda labs, your home lab, or even a single machine).
ML/AI meta-model, used in MLRun/Iguazio/Nuclio, see qgate-sln-<solution>
A Full Stack ML (Machine Learning) Roadmap involves learning the necessary skills and technologies to become proficient in all aspects of machine learning, including data collection and preprocessing,...
LLMOps with Prompt Flow is a "LLMOps template and guidance" to help you build LLM-infused apps using Prompt Flow. It offers a range of features including Centralized Code Hosting, Lifecycle Management...
A high-throughput and memory-efficient inference and serving engine for LLMs
Turns Data and AI algorithms into production-ready web applications in no time.
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
Qdrant - High-performance, massive-scale Vector Database for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalab...
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Label Studio is a multi-type data labeling and annotation tool with standardized output format
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a c...
🐢 Open-Source Evaluation & Testing for LLMs and ML models
An orchestration platform for the development, production, and observation of data assets.
Learn how to design, develop, deploy and iterate on production-grade ML applications.
A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning
RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry
🦖 𝗟𝗲𝗮𝗿𝗻 about 𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀 for free by designing, training, and deploying a real-time financial advisor LLM system ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 𝘷𝘪𝘥𝘦𝘰 & 𝘳𝘦�...
An awesome & curated list of best LLMOps tools for developers
🔥 A tool for visualizing and tracking your machine learning experiments. This repo contains the CLI and Python API.
🤖Self-Modifying Framework from the Future 🔮 World's First AMS
🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalab...
:closed_book: Clarity in the current fast-paced mess of Open Source innovation
A high-throughput and memory-efficient inference and serving engine for LLMs
Tools for easing the handoff between AI/ML and App/SRE teams.
Kickstart your MLOps initiative with a flexible, robust, and productive Python package.
Turns Data and AI algorithms into production-ready web applications in no time.
Learn how to create, develop, and maintain a state-of-the-art MLOps code base
Develop and deploy a real-time feature pipeline in Python, using Bytewax 🐝 and Hopsworks Feature Store.
AIShield Watchtower: Dive Deep into AI's Secrets! 🔍 Open-source tool by AIShield for AI model insights & vulnerability scans. Secure your AI supply chain today! ⚙️🛡️
deployKF builds machine learning platforms on Kubernetes. We combine the best of Kubeflow, Airflow†, and MLflow† into a complete platform.
This is a pick-your-problem style guide I created to educate everyone from my leadership team to my ML engineers on the process of how to work with AI in production settings.
Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.
All the available resources to master MLOPS from scratch
A curated list of MLSecOps tools, articles and other resources on security applied to Machine Learning and MLOps systems.
Experiment tracking server focused on speed and scalability
🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 11 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 ...