Evan-Almloff

The two projects have different usecases so they can't be directly compared. Slegehammer bindgen makes calling javascript from rust faster in the browser. Wasmtime is a native runtime for WASM outside of the browser

Kalosm is a library for pre-trained text, audio and visual models in Rust. It includes support for:

- Whisper for audio transcription

- Llama, phi and mistral models for text generation.

- Structured generation: You can generate text that fits your specific format by deriving a parser automatically with structured generation

- Bert for text embedding and search

The latest release adds support for deriving parsers and json schemas to use with structured text generation, real time audio transcription and a bunch of performance improvements

All data you insert into a generational box needs to be allowed to last for the 'static lifetime (have no internal temporary pointers). You cannot insert something like &'a str into a generational box

Dioxus web compiles to WASM, but we compile to native code for desktop rendering to make it easier to interact with native APIs like the filesystem. We just use the web browser for rendering

We are copying the reference to the data, not the data itself. The reference to the data lasts for the lifetime of the program. Generational box lets you insert data that last for shorter than the lifetime of the program (as long as that data contains no references). Once you drop the data you inserted, we reuse the box for other allocations.

It uses a very similar approach to a generational arena but with boxes instead of a centralized arena (to avoid locking issues). If you try to access the Copy reference to the data after it has been dropped, it will fail with a nice error message

I would love to integrate llava in the future!