Comment

Comment by taco-man

since whole inference is in int hence the matrix multiplacaiotn which is most part of the compute becomes faster. max multiple is i8 and which can fit in i128 which can be clipped down in determinstic way down to i8 again ( since we scaled the float to integer which makes it we just lose few extra precision instead of rn it was we lose whole thing )
parent taco-man 14 days ago

No comments yet

Be the first to share your thoughts.

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton