xLaszlo

6TB - Snowflake

Why?

That's the boring solution. If you don't have a use case, what kind of queries you would run then opt for maximum flexibility with the minimum setup of a managed solution.

If cost is prohibitive on the long run, you can figure out a more tailored solution based on the revealed preferences.

Fiddling with CSVs is the DWH version of the legendary "Dropbox HN commenter".

That's Kent Beck's 3X: Explore Expand Extract (there is a good video on it about his time at FB)

It's a question of "What is the economy for?"

Disruptive tech monopolies upset entire existing industries for the sake of their owners/shareholders/employees, which is usually tiny compared to the said industries.

(Think of FB/Google advertisement centralisation as the end of other media providers.)

I think feast is sunsetted

Hungary had and still has a state sponsored "elite" education for gifted children. From a relatively early age kids are regularly tested (both materially and curiosity wise) if they are interested in "better" Maths. So they are prepared to a STEM trajectory.

You don't need to be a genius just reasonably good and interested. I would think 10% of all kids take part.

Check out UKMT for the equivalent in the UK or Kangaroo competitions.

Secondary schools has a 130! year old journal (KOMAL) for competition Maths (again various difficulties) but those who go on to become mathematicians (an extremely selective subject in Hungary) pass the hardest tests as well.

So Hungary has various levels of gifted children support programs and has it for the last 100+ years (across 3-4 different government structures)

Until it turns out that the NSA was involved writing said RNG and explicitly weekend it with a backdoor...

It's beer, isn't? Completely makes sense...

If they find evidence that the next step was caffeine, I have no more questions...

Neither does Tadatem ;)

There should be a balance of short term and long term thinking and project management is the optimisation between the two.

My experience is that managers only think short term which makes SWEs defensive and be dogmatic about long term.

The the project fail.

If you are looking for low discrepancy (fills the space "smoothly") quasy random numbers check out Sobol and Niederreiter sequences.

I found that the best to think of graph implementation is sparse matrices of the adjacency matrix. CSR/CSC format has fast lookup abilities, building and switching between formats is "relative" efficient. Most graph algorithms need primitives that can be built on top of this.

For distributed computing one can look int GraphLab or its smaller version, now largely abandoned GraphChi.

This is called "Goodhart's Law"

Ahh, I never heard about it, but it looks promising.

I will reach out to the author.

Thanks for bringing it to my attention.