Many people reading this will call bullshit on the performance improvement metrics, and honestly, fair. I too thought the agents would stumble in hilarious ways trying, but they did not. To demonstrate that I am not bullshitting, I also decided to release a more simple Rust-with-Python-bindings project today: nndex, an in-memory vector “store” that is designed to retrieve the exact nearest neighbors as fast as possible (and has fast approximate NN too), and is now available open-sourced on GitHub. This leverages the dot product which is one of the simplest matrix ops and is therefore heavily optimized by existing libraries such as Python’s numpy…and yet after a few optimization passes, it tied numpy even though numpy leverages BLAS libraries for maximum mathematical performance. Naturally, I instructed Opus to also add support for BLAS with more optimization passes and it now is 1-5x numpy’s speed in the single-query case and much faster with batch prediction. 3 It’s so fast that even though I also added GPU support for testing, it’s mostly ineffective below 100k rows due to the GPU dispatch overhead being greater than the actual retrieval speed.
触屏 MacBook 是必然会到来的产品，详情可参考51吃瓜
建设单位：西安精卓航宇科技有限公司（企业法人：耿金红，项目负责人：司拥军）；施工单位：陕西中泰以安建设工程有限公司（企业法人：王明超，项目经理：李明）；监理单位：陕西众志项目管理有限公司（企业法人：张鹏飞，总监理工程师：张鹏），详情可参考搜狗输入法下载
Последние новости