912 results for vector · 2.155s

News for “vector”
20 results • 2148 ms server time
Moozonian News
github.com• Aug 23, 2023• 1 min read
Show HN: Fast vector similarity using Rust and PythonI recently found myself computing the similarity between lots of very high dimensional vectors (i.e., sentence embedding vectors from LLMs), and I wanted to try some more powerful measures of similarity/dependency than just Cosine similarity, which seems to be the default for everything nowadays because of its computational efficiency.There are many other more involved measures that can detect more subtle relationships, but the problem is that some of them are quite slow to compute, especially if you're trying to do it in Python. For my favorite measure of statistical dependency, Hoeffding's D, that's true even if you use Numpy. Since I recently learned Rust and wanted to learn how to make Python packages using Rust, I put together this new library that I call Fast Vector Similarity.I was blown away by the performance of Rust and the quality of the tooling while making this. And even though it required a lot of fussing with Github Actions, I was also really impressed with just how easy
Moozonian News
github.com• Aug 10, 2023• 1 min read
Show HN: VectorFlow – Open-Source Vector Embedding PipelineHey HNWe've just released the initial version of our open-source vector embedding pipeline. It's designed to embed large volumes of data. While embedding a few documents for Q&A is straightforward, consistently ingesting gigabytes of unstructured data is a whole different ballgame.By using our API, you can embed raw data and store vectors in your vector database, sidestepping the complexities of cloud infrastructure.Now, in true YC spirit, we're launching before everything is polished. Our Github repo (https://github.com/dgarnitz/vectorflow ) is a work in progress, and we're eager to get it in front of the community early on.Check out our Github repo and let us know what you think. Your feedback, suggestions, and critiques will be highly appreciated as we continue to refine and develop.
Advertisement
Advertisement
Moozonian News
loom.com• Jun 7, 2023• 1 min read
Show HN: Open-source vector & data lake to debug, curate and version AI dataHi HN! I’m Farah, co-founder of Dioptra.ai. We just open sourced katiML (https://github.com/dioptra-ai/katiml) this week and wanted to get your take.katiML is a vector+data lake to debug, curate and version AI data. With katiML, teams avoid the “garbage in, garbage out” effect by taking control over the quality of their data. They quickly and effectively curate high quality data for training, fine-tuning, and fixing hallucinations and edge cases.Features include: - Data Curation: interactive embedding visualization and similarity search, mislabeling and hallucination scores as well as SOTA Active Learning miners. - GenAI 4 explainability: uncover drift and bias in your data with multi-modal foundational models that describe in human language what’s in your data. - ML Data Lake: zero copy, highly efficient ML data lake to store and query any ML data (vectors, metadata etc). - Data Versioning: to track changes in datasets, prompts, and model performance; and pinpoint the causes behind th
Advertisement