aliasaria

Getting ROCm working was... an adventure. We documented the entire (painful) journey in a detailed blog post because honestly, nothing went according to plan. If you've ever wrestled with ROCm setup for ML, you'll probably relate to our struggles.

The good news? Everything works smoothly now! We'd love for you to try it out and see what you think.

Thanks for finding this!

Will get this merged as soon as we can test across platforms.

One of the maintainers here. Yes this is a big part of our plans. In addition to our plugin system which allows arbitrary Python scripts, we will soon publish how to add decorators to any existing script which can be run externally but logged into Transformer Lab. So you could do training anywhere but trigger evals in the app, for example.

Yes it all works as webapp, in addition to working as an electron app. we haven’t gotten to publishing how in the docs as this feature is brand new.

Short story, run: “npm run start:cloud” in the git repo.

Will make this more known soon.

Apple MLX is a game changer for what is possible in Local LLM development for everyone. Getting this to work as a single application that "just works" across platforms has been one of the hardest engineering problems we've ever worked on, but we're determined to get it right.

We want this tool to be for everyone that wants to train and tune their own LLMs.

Our vision is that the sphere of people who do these types of tasks will grow as LLMs become more accessible and the tooling becomes more reliable.

Let us know what other types of functionality you'd like to see. I will record Assistant-type functionality for our team to look into!

If you know any we should incorporate, let us know! We really want to bring the best of open source LLM tools together in one UI.

The functionality in Transformer Lab comes from plugins. Plugins are just Python scripts behind the scenes. So anything that can be done in Python can be done as a plugin.

Right now we have export plugins for going to GGUF, MLX and LlamaFile but if you know a good library for exporting to TensorRT, let's make a plugin for this! (Feel free to join our Discord if you want help)