> Docker images are layered for a reason. If you’re having to download multi gigabyte docker layers multiple times, something has gone very wrong.
Well the images need to be in some order, and if you are fine tuning the very initial parts of the image, this can happen.
But it seems a better transfer algorithm could be used for those individual layers. It rather seems like if they don't match, everything's transferred, while there could be a lot better options as well. If we consider that they are structured like file systems then it opens even more options.
---
So I took a peek on my local Docker installation. It seems the layer files on the drive are gzipped json.
That's right, .json.gz, _that includes the files BASE64-encoded_.
Yes, I believe there is room for improvement, if this is also the format they are transferred in.
Well the images need to be in some order, and if you are fine tuning the very initial parts of the image, this can happen.
But it seems a better transfer algorithm could be used for those individual layers. It rather seems like if they don't match, everything's transferred, while there could be a lot better options as well. If we consider that they are structured like file systems then it opens even more options.
---
So I took a peek on my local Docker installation. It seems the layer files on the drive are gzipped json.
That's right, .json.gz, _that includes the files BASE64-encoded_.
Yes, I believe there is room for improvement, if this is also the format they are transferred in.