Comment by Farmadupe

I compared the costs between luna and haiku for some classification work. Luna comes out a fair amount cheaper due to more efficient tokenization and less outputs.

  Model        input tokens   output tokens   batch cost   sync cost
  Haiku 5.5    11,893,643     240,451         $0.21        $0.42
  gpt-6-luna   7,903,468      177,602         $0.16        $0.31