Comment by avetiszakharyan

Yes, i did that but its not apple silicon optimized so it was taking forever for 30b models. So its ok, but its not fantastic