potatoman22
Joined 6 years ago
Joined 6 years ago
I also found this researcher on their staff who studies tomography https://scholar.google.com/citations?hl=en&user=idvD2yYAAAAJ
The source also says > The new architecture centers on Apple Foundation Models co-developed with Google, which Apple says are adapted to run both on-device and on servers through its existing Private Cloud Compute infrastructure
Which could mean Google and Apple have trained some custom models, probably the on-device ones, specifically tailored towards Apple's hardware.
> y = y - scale * direction[layer] * dot(direction[layer], y)
From https://vgel.me/posts/representation-engineering/
> A control vector is a vector (technically a list of vectors, one per layer) that you can apply to model activations during inference to control the model's behavior without additional prompting