sercand

we also build similar product in-house for our apps.

llama.cpp is a generalized inference engine; therefore, model-specific optimizations should remain outside its core architecture. When developing a bespoke inference application, it is standard practice to fuse operations and heavily optimize the compute kernels for the specific target model.

I have one of my own. My reason for this is that you can get up to 2x performance compared to llama.cpp on the same model weights. It is optimized for single model to serve it well.

I have green card and last time I left is 2 years ago, How can I return back to the US?

Where did you see the matmul acceleration support? I couldn't find this detail online.

I dropped Spotify when they started to push more podcasts on my home feed as well.

You can't build to mobile on 4.x version, only desktop supported.

Solar has the advantage of scaling down. 1000 people can give 1M US dollar which can produce approximately 1GW of power on a thousand of power plant in a year. You can scale down as low as 400W of energy production and distribute the financial cost to many people.

As a person from Mediterranean, It finally makes sense the 5% of Nordic genes in my 23andMe result.

I am wondering what is the use case for a website that sends notification to the user who didn't install the PWA to home screen.

Gmail initially offered very big email storage space comparing the others, and it was going up continuously until its storage area merged with Google Drive.

It depends on the company size. On a small startup with 10 people and a company with 1000 people have different CTO definitions and roles.

This is the worst type of PR. Just submit a different PR for the code format changes.

I mean Unity in general for desktop and mobile. Mentioned exporting to android and iOS as an extra benefit.

If you are using a game engine like Unity you should not worry at all. If you need to access Windows specific APIs, of course it is a different story. A Macbook is a perfect machine for developers: you can build for android and iOS, has a great screen, perfect touchpad, finally fixed keyboard and ports.