ellimilial

Joined 12 years ago

Karma
162
Submissions
77
Member since
Jan 13
Working at the crossroads of data engineering, AI/ML and biology/health.

https://ellarion.com

Take a look at our (largest of its kind) catalogue of biomedical datasets: https://biokeanos.com

View on Hacker News

Recent submissions

Comment · 4 years ago
If it fits on a single machine - jq, flat files, JSON lines / avro if relatively flat. Change to a tabular format if when nesting not required.

Postgres JSONB works, but it requires maintaining a heavy server process. So does Lucene/elasticsearch.

I have been yearning for embeddable store (in line with SQLite the support that both works and also keeps the data compressed like JSONB). I know there were some attempts, tried some of it those, mostly monstrosities).

Comment · 4 years ago
Try a nociception, drug design or pharmacy group at your local university. Chances are they’ve been doing this for years.
Comment · 4 years ago
Great content, but incredibly difficult to trawl through.
Comment · 4 years ago
It's always great fun compounding new, manual 'indexes' when you discover you need another query.
Comment · 4 years ago
With a lot of fuzziness, some state and temporal stuff.
Comment · 5 years ago
Yes please, it took me over 5 secs to figure out what to click, felt like ages.
Comment · 5 years ago
Diffusione Urino

Sure it's delish, very appealing.

Comment · 5 years ago
For https://biokeanos.com (biomedical data catalog and discovery tool), keeping things on disk and versioning by pushing to repo saved me months already on dubugging and maintenance only.
Comment · 5 years ago
Isn’t this counting the lines with any G/C in them vs the total number of G/C literals?
Comment · 5 years ago
A context might be useful.

From what I gather, the author is a researcher in bioinformatics related field. This may indicate that they tend to work either alone or in a relatively small group. The domain is small scope data processing/manipulation, research/exploratory code, ,likely short-lived or even one-off.

The progress in this context will possibly be governed by sheer processing speed (e.g. it’s unlikely anyone will delve deep into the code, a lot of iterations to ‘just get it done’ instead of testing etc.).

If this is more or less correct, the point that Nim might be more useful than Python for the author sounds very sensible to me. It’s a nice spot between command line tools and more functionality-loaded languages.

Comment · 5 years ago
The team being 'all-British' for obvious security reasons. Which I imagine might have felt like and insult to an injury to the 'little people', who, despite cracking the code, were not permitted to continue working on it. Making them, you know, 'little people'.
Comment · 5 years ago
The wording of the abstract indicates that this article itself has been auto-generated, right? :)

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton