stfurkan
Joined 7 years ago
Karma
78
Submissions
81
Member since
Jan 13
Recent submissions
Comment · 1 month ago
Comment · 2 months ago
1. bitgpu: Fast WebGPU runtime for 1-bit (binary-weight) LLMs in the browser.
Repo: https://github.com/stfurkan/bitgpu
Demo: https://stfurkan.github.io/bitgpu/examples/chat.html
2. aidekin: In browser local AI assistant for any website (it uses the bitgpu engine)
Repo: https://github.com/stfurkan/aidekin
Website: https://aidekin.com
3. Carbonless: Calculate and reduce your website's carbon emissions
Website: https://carbonless.cc
Comment · 3 months ago
I'm currently working on an open-source LLM inference engine [1] for browsers via webGPU. If anyone wants to try or has any suggestions, I'm happy to listen :)
1. https://github.com/stfurkan/bitgpu
Demo: https://stfurkan.github.io/bitgpu/examples/chat.html
2. https://aidekin.com --> this is one of my project that's currently using bitgpu engine
Comment · 3 months ago
Hi again :) I updated the engine and 27B model should work in the demo[1]. We can still consider it as experimental but I am trying to make it better and efficient.
Comment · 3 months ago
Thank you :) I wanted to create it from zero myself so I can control it better. e.g. I started with ONNX support but now it support gguf models too. It might be a good idea to add some popular connectors in the future. Good luck with your project :)
Comment · 3 months ago
Hello, I sent you a LinkedIn connection request. We can chat first and schedule a meeting. Thanks
Comment · 3 months ago
Hi, the engine itself already has tool calling capabilities but if you're asking for the aidekin I didn't add tool calling there on purpose.
It needs webgpu support but I haven't had a chance to test with different devices.
Comment · 3 months ago
Hi :) There are some smaller embedding and re-ranking models (I am currently using some of them on my aidekin project) but having it like bonsai models will be great to have.
Comment · 3 months ago
Thank you for trying it :) I just added the 27B support 1 hour ago. Let me check and try to fix it. All other models should work as expected but if you have issues with them too, I can take a look.
Comment · 3 months ago
I'm currently working on an open-source engine [1] exactly for this purpose. If anyone wants to try or has any suggestions, I'm happy to listen :)
1. https://github.com/stfurkan/bitgpu
2. https://aidekin.com --> this is one of my projects that's currently using bitgpu engine
Link: https://apps.apple.com/us/app/muntazam-habit-tracker/id68053...
- Carbonless: Calculate your website's carbon emissions
Link: https://carbonless.cc
- Aidekin: An AI assistant that runs inside your visitor’s browser
Link: https://aidekin.com