Great clarifying question; sorry I should have been more clear.
I mean working with open weights and in the future, creating their own open source models from the ground up. At the moment, that's not reasonable, but I'm leaving the door open for when/if there's a break through in training that greatly reduces the costs of training new models.
Right now, LoRA can give amazing results with small models.
I mean working with open weights and in the future, creating their own open source models from the ground up. At the moment, that's not reasonable, but I'm leaving the door open for when/if there's a break through in training that greatly reduces the costs of training new models.
Right now, LoRA can give amazing results with small models.