Fast prompt classification that routes prompts to the appropriate Claude model tier (Ex: Haiku, Sonnet, or Opus) using on-device ONNX models. Works as both a CLI with an interactive TUI and a library you can import into any Node.js project. Optimize API costs by intelligently selecting the right model based on prompt complexity and reasoning effort.
MODELS_DIR -- resolved path to the bundled model directory
CLI Usage
# Buildnpm run build# Runnpm start# Development (runs from source)npm run dev
Controls
Key
Action
Type
Enter your prompt
Tab
Accept autocomplete suggestion
Enter
Classify the prompt
Alt+Enter
Insert newline
Escape
Clear suggestion
Ctrl+U
Clear input
Ctrl+C
Quit
How It Works
knowmatic loads four quantized ONNX models at startup:
Model
Size
Purpose
Difficulty classifier
14M
Routes to Haiku / Sonnet / Opus
Reasoning effort classifier
14M
Estimates low / medium / high effort
Code classifier
14M
Detects programming language
SFT autocomplete
28M
Generates word-level completions
All inference runs on CPU via onnxruntime-node. A BPE tokenizer handles text encoding with a 512-token context window.
Project Structure
src/ index.ts # CLI entry point and TUI state machine lib.ts # Public library API paths.ts # Model directory resolution inference.ts # ONNX model inference engine tokenizer.ts # BPE tokenizer implementation autocomplete.ts # Generative autocomplete engine sampling.ts # Token sampling strategies codeDetection.ts # Code block detection ui.ts # Terminal renderingmodels/ difficulty_classifier/ reasoning_effort/ code_classifier/ sft/ tokenizer/
Terms of Use
See TERMS_OF_USE.md for full terms. Models are provided under a limited license and may not be redistributed. See the terms document for commercial use provisions.
License
All models, weights, code, and associated materials are the exclusive property of knowmatic hobby lab.