2 results found Sort:

withcatai
node-llama-cpp withcatai
113
1.3k
mit
14
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
ai gpu llm cuda gguf catai cmake llama metal nodejs vulkan grammar bindings cmake-js embedding llama-cpp json-schema self-hosted function-calling prebuilt-binaries
Created 2023-08-12
193 commits to master branch, last one 18 days ago
withcatai
catai withcatai
32
467
mit
9
Run AI ✨ assistant locally! with simple API for Node.js 🚀
ai llm gguf catai dalai chatui ggmlv3 nodejs openai vicuna chatbot chatgpt localai wizardlm llama-cpp local-llm ai-assistant node-llama-cpp vicuna-installation-guide
Created 2023-03-25
189 commits to main branch, last one 8 months ago