As you observe one can't really recover any non-trivial number theoretic things by looking at integers with the discrete topology. The theory of discrete topological spaces is just the theory of sets.
Instead you can look at things like prime ideals of integers localized at some prime, and consider algebro-geometric topologies on that
Instead you can look at things like prime ideals of integers localized at some prime, and consider algebro-geometric topologies on that