pajeets

wait this is crazy

what model can i run on 1TB and how many tokens per second ?

for instance Nvidia Nemotron Llama 3.1 quantized at what speed ? ill get a GPU too but not sure how much VRAM I need for the best value for your buck

gonna need quantum computing once you breach in to the mid 20s

need a 3090 at least for that

so 4 vCPU per customer + 40gigs of RAM ?

but SQL isn't a blackbox and is a declarative language with a strict syntax

Piggybacking on OpenAI or any GPT is not at all the same as SQL

main appeal is the large amount of RAM and cores

VDS seems to go up in cost when you go beyond 32GB with a decent CPU

amen to the depreciation but methinks 7950x + 512gb of DDR5 RAM should be fairly future proof no ?

literally 90% of AI startups right now are some combination of the above and their "edge" is just a long system prompt that tells them to "be this niche and output response that mimics an expert from that niche"

This was never going to work out because OpenAI is literally watching everybody and how they are using it including prompts. AI wrapper startups serve these functions:

- wrappers prop up NVIDIA which are owned by the people giving VCs the money to invest in wrappers who are long Nvidia too.

- wrappers give OpenAI RSU holders a fuzzy warm feeling and they are able to see what the market is doing with their product so they can pull "Amazon Basics"

- IRS, attorneys, accountants, politicians love them all because they all get to squeeze milk from the fume

> you can bet this isn't the exit most parties wished for. Although by this stage the founder(s) is probably happy to find a buyer who will retain their team.

I've seen a startup that was bootstrapped 10 years ago but took on too much money and ended up getting acquired for "undisclosed sum" but at the same time everybody knew the investors were just recouping their money while founders got nothing (they had sold their equity for raising more money as their costs were way up but nobody was buying their product). Cue local news reporters don't know the nuances so they'll just announce "Startup X acquired by Y, wow!"

Founders place a lot of emphasis on getting "acquired" but there is roughly 95% chance of you selling at breakeven where the terms leave you with a year's worth of salary as a junior SWE

Get ready to see a lot more of these "acquired" news coming out in the near future. something around less than 1% chance of getting more money than you put in.

Startup has horrible odds especially if you are building a simple GPT wrappers