Comment

Comment by LolWolf

Hmm, how does this compare to things like

https://github.com/cjdoris/LogarithmicNumbers.jl

or

https://github.com/cjdoris/HugeNumbers.jl

(Apart from the PyTorch impl)

In particular, it feels like storing the complete complex number is a bit silly since we know, a priori, that the number exponentiates to ±1, so, wouldn't this mean that we have wasted 31 bits? (=32-1 since only one bit is needed for the sign.)

That being said, this representation is very useful for certain scenarios, of course, when you know that the dynamic range of your number is very large, but, as far as I can tell, it's not exactly super novel, unless I'm missing something!

parent LolWolf 1 year ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton