Toots from 2025-09-09
“I recently spoke with the CTO of a popular AI note-taking app who told me something surprising…
“I recently spoke with the CTO of a popular AI note-taking app who told me something surprising: they spend twice as much on vector search as they do on OpenAI API calls. Think about that for a second. Running the retrieval layer costs them more than paying for the LLM itself. “
https://milvus.io/blog/will-amazon-s3-vectors-kill-vector-databases-or-save-them