2 results found Sort:

withcatai
node-llama-cpp withcatai
100
1.1k
mit
15
Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level
ai gpu llm cuda gguf catai cmake llama metal nodejs vulkan grammar bindings cmake-js embedding llama-cpp json-schema self-hosted function-calling prebuilt-binaries
Created 2023-08-12
185 commits to master branch, last one 4 days ago
withcatai
catai withcatai
30
460
mit
10
Run AI ✨ assistant locally! with simple API for Node.js 🚀
ai llm gguf catai dalai chatui ggmlv3 nodejs openai vicuna chatbot chatgpt localai wizardlm llama-cpp local-llm ai-assistant node-llama-cpp vicuna-installation-guide
Created 2023-03-25
189 commits to main branch, last one 6 months ago