mayerwin
Joined 10 years ago
Karma
54
Submissions
30
Member since
May 6
Recent submissions
Comment · 5 months ago
Yes, that is definitely a limitation. If all models become worse at the same pace, we won't see any degradation either. I couldn't find any historical dataset of model benchmarks (I'd really have loved that, to see how performance holds over time vs. the initial announcement), so the Elo data from Arena AI was the least imperfect proxy I could find.
Comment · 5 months ago
It'd be amazing if you could open an issue with a screenshot so I can take a look, I haven't been able to find issues when clicking on a group of models: https://github.com/mayerwin/AI-Arena-History/issues. Note: the model change points label being hidden when more than one curve is active is by design (to avoid cluttering), if this is what you were referring to.
Comment · 5 months ago
You're right, thanks for the heads up! Corrected (I can't edit the post on HN though).
Comment · 5 months ago
Make sure the prerequisites are installed (I haven't tested on Windows 10), feel free to open an issue on GitHub and share the logs.
Comment · 5 months ago
No I haven't tested this project. I couldn't find any mention about BLE polling inside though, it probably offers complementary features.
Comment · 5 months ago
Yes, Claude was very helpful to make this project work too (it would have taken me months otherwise to dig into how BLE works, and I'd probably have missed a lot of edge cases)!
Comment · 5 months ago
Yes! I was surprised myself it was so complicated, especially as BLE MIDI is not something particularly new (Apple has nailed the implementation much better, luckily Pete at Microsoft is now doing his best to provide a comparable experience). When I played with USB MIDI 25 years ago it felt so much simpler.
Comment · 5 months ago
I haven't measured it as my use cases were not sensitive to latency, but it felt pretty instant. Results will probably vary depending on the Bluetooth adapter, so best is to just test and see!