They also wanted to keep it from the Germans. Before war, much of the foundations of atomic physics were developed by people in the Axis countries. It was plausible that Germany had a nuclear program as big as the American one. Denying them fuel was important.
See the sabotage of Norwegian heavy water:
https://en.wikipedia.org/wiki/Norwegian_heavy_water_sabotage