14× faster embeddings: how we rebuilt the ONNX path in Manticore
dev_tools
Manticore Search, the open-source search engine, rebuilt the ONNX execution path for embeddings and achieved a fourteen times speedup. The optimization improves embedding generation performance for developers using Manticore's platform.
Source: https://manticoresearch.com/blog/onnx-embeddings-speedup/
Listen to this story
Hear this and more stories in a personalized audio briefing.
Open The Chonkerton