adonese
Joined 9 years ago
Joined 9 years ago
It would take a bit of time for similar societies to adjust to the new realities.
Because I think as far as running the existing models and handling whatever nuances, it must be well understood by oai and ANT -- but you don't what you don't know.
select (up arrow)
will loop through your psql history for commands that started with e.g., . The challenging part is in wide tables and or table with large data. Less is awkward usually so using pspg made it less awkward.
I tried also to with help of ai, to write a plugin for sublime that fits my flow. It worked well but I think I'm more used to psql.
[1]
~/.inputrc
$if psql "\e[A": history-search-backward "\e[B": history-search-forward $endif
edit: formatting
> AIUI, people are even experimenting with offloading the KV cache itself to storage, which may unlock this batching capability even beyond physical RAM limits as contexts grow.
Especially this point. Any reason that this idea was considered bad? Is it due to the speed difference between the GPU VRAM to the RAM?
PS. mentioning amp because i used to use it and I pay directly for token. I topped up 5 usd so I will be going to use it and see how far can it take me. But my impression so far is even when model subsidization is done, those open source models are quite viable alternatives.