2 results found Sort:

withcatai
node-llama-cpp withcatai
61
723
mit
9
Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level
ai llm cuda gguf catai cmake llama metal nodejs grammar bindings cmake-js llama-cpp json-schema self-hosted prebuilt-binaries
Created 2023-08-12
69 commits to master branch, last one 7 days ago
withcatai
catai withcatai
27
422
mit
10
Run AI ✨ assistant locally! with simple API for Node.js 🚀
ai llm gguf catai dalai chatui ggmlv3 nodejs openai vicuna chatbot chatgpt localai wizardlm llama-cpp local-llm ai-assistant node-llama-cpp vicuna-installation-guide
Created 2023-03-25
189 commits to main branch, last one 7 days ago