How much does LLM inference cost per million tokens?
1M tokens costs $0.09 to $8 of input and $0.18 to $40 of output by tier, but resent context and caching decide most real bills.
1M tokens costs $0.09 to $8 of input and $0.18 to $40 of output by tier, but resent context and caching decide most real bills.