Skip to main content

Show HN: USearch – Smaller and Faster Single-File Vector Search Engine https://ift.tt/Jo9CPOQ

Show HN: USearch – Smaller and Faster Single-File Vector Search Engine Last week was insane for vector search. Weaviate raised $50M, and Pinecone raised $100M... That's a lot and makes you believe that vector search is hard. But it's not. I have spent the last couple of days implementing a single-file vector search engine from scratch, which is at least the tenth in the twenty years of my career. But this time, it's different. Instead of inventing a brand new algorithm and doing some crazy optimizations on the GPU, I: 1. took the standard HNSW algorithm, 2. fitted into 1000 lines of C++11 for portability, 3. added quantization and hardware-accelerated metrics, 4. wrapped for Python, JavaScript, Rust, and Java, and 5. open-sourced it! It was fun, and to my surprise, it performed well, reaching 300K QPS on Amazon c7g instances. I never had to use third-party vector search products, but the first testers of USearch suggested 3x performance improvement over their existing solutions. My colleagues and friends are also adding bindings for GoLang and the Wolfram language. We will soon add Windows support, a standalone server, and a distributed version based on UCall we shared a month ago. There are, of course, but you can already use it! One of the apparent use cases is Semantic Search platforms. The example at the end of the GitHub page shows how to use USearch, UCall, and the UForm transformers together to build up a text-to-image semantic search platform in just 20 lines of Python. Try it and join the development! We also have a lot of open positions, especially for those who want to work with us on next-get algorithms and AI infra rather than polishing and repackaging existing ideas :) https://ift.tt/UoaxKbW May 3, 2023 at 08:33PM

Comments

Popular posts from this blog

Show HN: TPMouse - A Virtual Trackball for Windows, controlled from the homerow https://ift.tt/BtjAqD4

Show HN: TPMouse - A Virtual Trackball for Windows, controlled from the homerow Hello all, I apologize for the repost as the previous submission was made from an unfortunate timezone. I've been refining my app to the point that it's pretty much become an indispensable daily driver in my own workflow. Hoping to hear some critiques/feedbacks on its usability! https://ift.tt/p6HvZCc October 24, 2022 at 02:24AM