Hi everyone, I'm happy to announce the release of Kalosm! [Kalosm](
https://floneum.com/kalosm/) is a framework for embedded AI in rust.
## What is Kalosm?
Kalosm provides a simple interface for pre-trained language, audio, and image models models. To make it easy to use with these models in your application, Kalosm includes a set of integrations other systems like your database or documents.
```rust
use kalosm::language::*;
#[tokio::main]
async fn main() {
let mut model = Llama::new_chat();
let mut chat = Chat::builder(&mut model)
.with_system_prompt("The assistant will act like a pirate")
.build();
loop {
chat.add_message(prompt_input("\n> ").unwrap())
.await
.unwrap()
.to_std_out()
.await
.unwrap();
}
}
```
## What can you build with Kalosm?
Kalosm is designed to be a flexible and powerful tool for building AI into your applications. It is a great fit for any application that uses AI models to process sensitive information where local processing is important.
Here are a few examples of applications that are built with Kalosm:
- Floneum (https://floneum.com/): A local open source workflow editor and automation tool that uses Kalosm to provide natural language processing and other AI features.
- Kalosm Chat (https://github.com/floneum/kalosm-chat): A simple chat application that uses Kalosm to run quantized language models.
## Kalosm 0.2
The 0.2 release includes several new features and some performance improvements:
- Tasks and Agents
- Task Evaluation
- Prompt Auto-Tuning
- Regex Validation
- Surreal Database Integration
- RAG improvements
- Performance Improvements
- New Models
If you have any questions, feel free to ask them here, in the discord (https://discord.gg/dQdmhuB8q5) or on GitHub (https://github.com/floneum/floneum/tree/master/interfaces/ka...).
To get started with Kalosm, you can follow the quick start guide: https://floneum.com/kalosm/docs/
## What is Kalosm?
Kalosm provides a simple interface for pre-trained language, audio, and image models models. To make it easy to use with these models in your application, Kalosm includes a set of integrations other systems like your database or documents.
```rust use kalosm::language::*;
#[tokio::main] async fn main() { let mut model = Llama::new_chat();
} ```## What can you build with Kalosm?
Kalosm is designed to be a flexible and powerful tool for building AI into your applications. It is a great fit for any application that uses AI models to process sensitive information where local processing is important.
Here are a few examples of applications that are built with Kalosm:
- Floneum (https://floneum.com/): A local open source workflow editor and automation tool that uses Kalosm to provide natural language processing and other AI features.
- Kalosm Chat (https://github.com/floneum/kalosm-chat): A simple chat application that uses Kalosm to run quantized language models.
## Kalosm 0.2
The 0.2 release includes several new features and some performance improvements:
- Tasks and Agents
- Task Evaluation
- Prompt Auto-Tuning
- Regex Validation
- Surreal Database Integration
- RAG improvements
- Performance Improvements
- New Models
If you have any questions, feel free to ask them here, in the discord (https://discord.gg/dQdmhuB8q5) or on GitHub (https://github.com/floneum/floneum/tree/master/interfaces/ka...).
To get started with Kalosm, you can follow the quick start guide: https://floneum.com/kalosm/docs/