Joined 13 years ago
You could absolutely do something streaming, or mmap the weights instead of loading them into system RAM. Just the default interfaces don't.