mikepapadim
Joined 6 years ago
Karma
87
Submissions
68
Member since
Mar 9
Recent submissions
Comment · 8 days ago
You can do both. It supports nvidia's cuTile programming model through Tilecontext API or you can write megakernels in Java and compile then to CUDA or even add native libraries in the mix like cudnn. JITllm is a good example how all these can work together
Comment · 8 days ago
For now it supports directly cuTile through what they call TileContext API. Is a 1-1 mapping of the cuTile C++ implementation.
Comment · 9 days ago
no TPU support yet, just NVIDIA, Apple and any other HW thats supports OpenCL
Comment · 9 days ago
Many components for a jax for java are already tested in https://github.com/beehive-lab/jitllm
Comment · 9 days ago
https://github.com/beehive-lab/jitllm there is already an vllm-like inference engine that uses tornadovm as the GPU backend all written in java
Comment · 9 days ago
https://github.com/beehive-lab/TornadoVM this is main repo.
You can use it with any JDK21+ and Nvidia or Apple hardware and their Nvidia libs or MLX libs.