Engineering
Batch is half price. The wait is the cost
Batch cuts GPT-6.1 Sol from $10 to $5 per million output tokens. On a 2 million token nightly run that is $220 a month, if the job can wait.
#batch-processing
1 story tagged batch-processing.