Comment by veratwiger

You can make you your custom domain your account address and just delete the Fastmail address if you want.