Comment by p0w3n3d

No I checked it against the amount of RAM. Podman with 8GB does not increase speed, Docker with 4GB is still 9s

  podman run   27->24
  docker run   9.4->9.769 total

(I increased limit in podman and decreased limit in docker). This happens with amd64 arch images (which I for some reason need in my work and cannot rebuild)