dicey
Joined 6 years ago
Joined 6 years ago
Do you find that with the performance of duckdb, you see large deployments of spark based workflows less often? It seems hard to justify the complexity of spark if you can use duckdb , but I’m wondering if you see end users still reach for spark for any reasons?
It's really an excuse to get started with things like hardware, 3D printing, and embedded development - I've never done anything in that world before, and its been really exciting to get into! I've just started, so hopefully I'll have a better update next month.
Honestly, for task specific tasks methods like this seem like the way to go over the more general LLM.
Does anyone know if there is any benchmarks that show LLM performance on classification tasks? It’d be interesting to have data to back that up.