ruflo

🔢 ONNX Embeddings

/docs/ecosystem--integrations/onnx-embeddings

Generate embeddings locally without API calls:

typescript
import { getOptimizedEmbedder, cosineSimilarity } from 'agentic-flow/embeddings';

const embedder = getOptimizedEmbedder();
await embedder.init();

// Generate embedding (3ms local vs 230ms Transformers.js)
const vector = await embedder.embed('authentication patterns');

// Batch processing
const vectors = await embedder.embedBatch([
  'user login flow',
  'password reset',
  'session management'
]);

// Calculate similarity
const similarity = cosineSimilarity(vectors[0], vectors[1]);
ProviderLatencyCostOffline
Agentic-Flow ONNX~3msFree
Transformers.js~230msFree
OpenAI~50-100ms$0.02-0.13/1M