Search results

7 packages found

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

published version 3.9.0, 4 days ago31 dependents licensed under $MIT
34,802

An attempt at a pure cpp turbo module library

published version 0.2.6, 8 days ago0 dependents licensed under $Apache-2.0
1,478

llama.cpp gguf file parser for javascript

published version 0.2.2, a year ago1 dependents licensed under $MIT
1,214

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

published version 1.4.0, 4 days ago1 dependents licensed under $MIT
589

A simple, unified NPM-based interface for interacting with multiple Large Language Model (LLM) APIs, including OpenAI, AI21 Studio, Anthropic, Cloudflare AI, Cohere, Fireworks AI, Google Gemini, Goose AI, Groq, Hugging Face, Mistral AI, Perplexity, Reka A

published version 2.0.1495, 9 months ago0 dependents licensed under $MIT
311

Chat UI and Local API for the Llama models

published version 3.2.2, a year ago0 dependents licensed under $MIT
85

Run AI models locally on your machine with node.js bindings for llama.cpp. Force a JSON schema on the model output on the generation level

published version 0.1.0, 10 months ago0 dependents licensed under $MIT
13