Comment
Comment by junrushao1994
LLM decoding is dominated by memory bandwidth, and 3090Ti and 4090 happen to have the identical theoretical memory bandwidth
No comments yet
Be the first to share your thoughts.
Be the first to share your thoughts.