How do you generate embeddings for millions of documents?
Shard the corpus, run GPU workers that skip finished shards after a restart, and do the math: 10M documents cost $6 to $11 of GPU time vs $102 by API.
Shard the corpus, run GPU workers that skip finished shards after a restart, and do the math: 10M documents cost $6 to $11 of GPU time vs $102 by API.