komuher
Joined 6 years ago
Joined 6 years ago
If 1000 TFLOPS is possible to do in inference time then im speechless
But i can agree results are good but we need also to remember Samsung 8nm [rtx 3090 node] is 4 years old so 2 generations different from TSMC 5nm 4090 will be probably on 5nm node in few months and presumably will have 3x teraflops (probably 3x tf32 precision but it could be fp32 using 2/1.5x(?) more power).
(also I'm not sure about optimization it was write by apple employees and apple likes to drop open source support and focus on proprietary software)
Right now we have about 2milion UA refugees in Poland and about 2-3 million immigrants so they should be able to have normal life for a short period of time and communicate in Russian/Ukrainian in most places cause of enormous polish efforts otherwise they should go to Poland and from there you could start supporting them.
Apple is on TSMC 5nm here comment from 2years ago about 8nm samsung vs 7nm TSMC
"Hell, Samsung 8nm is really a 10nm process, it's just an extension of Samsung 10nm with a ~15-20% improvement in transistor density.
TSMC 7nm (EUV 4 layer) is nearly twice as dense as Samsung 8nm. non-EUV (first gen TSMC 7nm) is still far denser than Samsung 8nm."
Despite this m1 ultra gpu is a big step for all people intrested in apple market and DL/ML workloads
34s on ultra (64 core gpu) vs 11s on rtx 3090
So 3 times slower but taking ~4 times less power (350W 3090 70W ultra [on 48 core gpu so about 90 on 64 cores])
We all need to take Apple claims with grain of salt as they are always cherrypicked so i wont be surprise if it wont be even 3070 performance in real usage.
Julia is getting usable even in "normal" applications not only academic stuff, as person who come back after 1.5/2 years to julia i feel like i can use it again in my job cause it is a lot more stable at have a lot of new neat futures + CUDA.jl is amazing.
I hope Julia team will still explore a bit more static type inference and full AOT compilation if language got full support for AOT it'll be a perfect deal for me :).