stephanheijl

Love to see this on HN, very interesting research. I'm looking forward to the paper release and I appreciate the way that you are licensing these models. ESM 2-650M is still a solid baseline but seeing ESM C 6B outperforming it by these kinds of strides looks encouraging for the future possibilities of protein language models. Would be very interested to find out how well it performs on other benchmarks (ie ProteinGym zero-shot).

I would normally only buy apples around september/october in the Netherlands, trying to get them fresh from local orchards when possible. Elstar is amazing when plucked right from the tree, but becomes mealy before the end of the year IMO.

My new go to is the Magic Star variety, which has been sold as "Sprank" for the last 3 years at least in the Netherlands. These apples keep amazingly well; they ran out of stock around the summer in the last two years, but I found them delicious year round. I hope that this cultivar does not befall the same fate as the Honeycrisp, which I had the pleasure of tasting 5 years ago.

To be more exact, LoRA adds two matrices `A` and `B` to any layers that contain trainable weights. The original weights (`W_0`) have the shape `d × k`. These are frozen. Matrix `A` has dimensions `d × <rank>` (`rank` is configurable) and matrix `B` has the shape `<rank> × k`. A and B are then multiplied and added to `W_0` to get altered weights. The benefit here is that the extra matrices are small compared to `W_0`, which means less parameters need to be optimized, so less activations need to be stored in memory.

> Much too often, we are overworked and underpaid. We are in what people call a “passion industry,” one that ultimately capitalizes on our love of stories to excuse low wages and a “you better be grateful to this opportunity” attitude. We wish it was different. We’re not quite sure how to make it different.

The author identifies the situation completely accurately and is also able to see that they have no leverage whatsoever to make Harper Collins change their behavior. The fact is that doing a job that you are absolutely passionate about is something to be grateful for, and also something that is in high demand. Combined with the fact that the exact skill set required for this kind of work is currently possessed by a surplus of workers means that any position left by a striker will be rapidly fulfilled by a passionate scab.

I have no doubt that publishers will also readily take advantage of AI to make the pool of available jobs even shallower, which will decrease the viability of this movement even more.

Designing novel viral proteins might become trivial, but actually doing the lab work to produce them would still be a tough exercise. On the other hand, exactly by the mechanism that would give rise to such a novel pathogen, actors that do have access to large manufacturing capabilities would be able to create novel drugs rapidly or even prevantatively.

I just add them to an img folder in my Github repository and it is then served as part of the Github page. Just using `src=img/picture.jpg` works fine.

Based on the Global Wealth Book 2018 and 2019 from Credit Suisse, comparing Table 3-1 in both books, it appears that the number of adults in "under 10.000" range increased significantly in 2019. This is likely not a real change, but rather a change of methodology or data sources. As far as I can tell however, this is not detailed in the text. I have directed an email to Credit Suisse on this, as it's a rather interesting piece of data.

I've been looking at the use of algae with regards to sequester img CO2 from the atmosphere. This seems to have some remarkable advantages: single molecules which make mass production easier, presumably less finicky operating procedure and way more straightforward to pump into disused oil wells. From the abstract it does seem to need CO2 being supplied to it as opposed to drawing it from the atmosphere actively. I assume this could be used in exhausts of some kind? Definite benefit is the fact that the CO2 is captured immediately as opposed to over a years long timeline, like trees.