D daft.ai Cutting LLM Batch Inference Time in Half: Dynamic Prefix Bucketing at Scale 5 points ykev 1 year ago 1 comments
