How much does it cost to fine-tune a 70B model?
About $1 per million training tokens in GPU time, so $20 to $45 for a 20M-token run. The FLOP math, five GPU setups priced and what doubles it.
70b
1 post with the tag “70b”
About $1 per million training tokens in GPU time, so $20 to $45 for a 20M-token run. The FLOP math, five GPU setups priced and what doubles it.