Voyager Minecraft

After reading Voyager Minecraft paper, take a moment to appreciate how easy it is to remap the variable “zombie” to “human” in a prompt. It instantly makes anyone appreciate the immensity of the AI alignment problem.