🔢 ONNX Embeddings
/docs/ecosystem--integrations/onnx-embeddings
Generate embeddings locally without API calls:
typescriptimport { getOptimizedEmbedder, cosineSimilarity } from 'agentic-flow/embeddings'; const embedder = getOptimizedEmbedder(); await embedder.init(); // Generate embedding (3ms local vs 230ms Transformers.js) const vector = await embedder.embed('authentication patterns'); // Batch processing const vectors = await embedder.embedBatch([ 'user login flow', 'password reset', 'session management' ]); // Calculate similarity const similarity = cosineSimilarity(vectors[0], vectors[1]);
| Provider | Latency | Cost | Offline |
|---|---|---|---|
| Agentic-Flow ONNX | ~3ms | Free | ✅ |
| Transformers.js | ~230ms | Free | ✅ |
| OpenAI | ~50-100ms | $0.02-0.13/1M | ❌ |