If you are comfortable with purchasing used hardware, used 3090 are great value, they can be had for roughly a third of the price of a new 4090.
How many GPUs you need is completely dependent on the size of your team, their frequency of usage, and the size of the models you are comfortable with.
I generally recommend you rent instances on something like runpod to build out a good estimate of your actual usage before commiting a bunch of money to hardware.
How many GPUs you need is completely dependent on the size of your team, their frequency of usage, and the size of the models you are comfortable with.
I generally recommend you rent instances on something like runpod to build out a good estimate of your actual usage before commiting a bunch of money to hardware.