Ask HN: How much of a security concern is self-hosting code?

Realistically, how much of a concern should you have when using an open source code hosting solution such as Gogs or Gitea?