jstmm
Joined 3 years ago
Karma
5
Submissions
5
Member since
Dec 8
Recent submissions
Comment · 2 years ago
what does PK mean?
Comment · 2 years ago
It seems like a bad decision from the business side of things too. Having your employees freaked out about the new robots seems like a nonzero ding towards a company purchasing one.
Comment · 2 years ago
why will the ocean absorb more heat from the sun if 'sea creatures that rely on sight will starve'?
Comment · 2 years ago
In both the '1-bit Model' and '2-bit Model' tables, the forward time (sec) for Llama2-7B with FP16 (full precision) is 0.1 s, whereas it's ~0.231, ~0.257, ~0.353 s respectively for HQQ (1-bit) / HQQ+ (1-bit) / Quip# (2-bit) meaning the FP16 model has ~3x lower inference time.
On the contrary, in the BitNet b1.56 paper [0] the authors report their 7b model has 2.9x reduced inference latency.
It's not clear to me what's happening here. Can someone explain why the 1/2bit HQQ/HQQ+ models are so much slower than the BitNet b1.56 models?
Comment · 3 years ago
Kevin Lynch has a great course "Modern Robotics: Mechanics, Planning, and Control Specialization" on coursera. It covers the key ideas in robotics at a high level (however it leaves out perception). I recommend it for people interested in getting started on this topic.
https://www.coursera.org/specializations/modernrobotics#cour...