Comment by shuhongwu

1. llama.cpp can run on both Android and iOS devices. 2. For non-transformer models, Mamba and RWKV are also good options. 3. Additionally, you should have a better understanding of embeddings, tokens, and the structure of transformers.

And on Apple Silicon chips, MLX is preferred and is often the best choice.