The biggest part was dynamic shapes that weren’t allowed for newer iOS. I’d do it with masking similar to other transformers being ported to ANE. Another thing was people would cut the graph cause some operations are not allowable on this chip - tho if you look at the op that is doing segfault, i.e. tile - you can rewrite the same functionality with other supported ops and port the weights to the new graph. Works the same way compared to PyTorch weights comparing spectrograms, around 10x realtime on 14pro :)
Anything you found interesting there? Every proposal on GitHub I found was kinda lucking in both documentation and completeness
Anything you found interesting there? Every proposal on GitHub I found was kinda lucking in both documentation and completeness