Why do websites use src=data:image/png;base64

Many websites use src=data:image/png;base64 for images. It results a huge string of gibberish that renders a small image. What advantage does this have over just uploading the image and linking to it? Wouldn't the huge string of gibberish slow the site down by increasing the memory size of the page?