Comment

Comment by dannyw

NVIDIA is one of the most open labs.

They even share many of their pre-training and even post-training datasets for Nemotron on HuggingFace; for example: https://huggingface.co/datasets/nvidia/Nemotron-Post-Trainin...

Which other lab shares this?

Yes, there is no question NVIDIA wants to lock you into CUDA and their hardware. But also, they’ve consistently demonstrated the most openness when it comes to model training, datasets, and research; even before the LLM era (e.g. StyleGAN).

There’s also modelscope.cn (china’s huggingface) which is worth checking out. I would not be surprised if one day, we have to use China VPNs to download open weight models.

parent dannyw 2 months ago

Discussion

Live from the official Hacker News API

A modern reader for Hacker News · SvelteKit + Skeleton