Comment Comment by mosseater GPT-J specifically was written using Google Cloud's TPU stuff.https://github.com/kingoflolz/mesh-transformer-jax/#gpt-j-6bThey even have a google colab notebook thingie. Not much setup needed, just an account.https://colab.research.google.com/github/kingoflolz/mesh-tra... parent mosseater 3 years ago
https://github.com/kingoflolz/mesh-transformer-jax/#gpt-j-6b
They even have a google colab notebook thingie. Not much setup needed, just an account.
https://colab.research.google.com/github/kingoflolz/mesh-tra...