slacka
Joined 14 years ago
Joined 14 years ago
https://web.archive.org/web/20260313125244/https://old.reddi...
[1] https://www.cbsnews.com/news/income-taxes-billionaire-tax-ra...
[2] https://www.propublica.org/article/the-secret-irs-files-trov...
* NVIDIA is also releasing most of the data they used to create it, including the pretraining corpus
* The model uses a hybrid architecture consisting primarily of Mamba-2 and MLP layers combined with just four Attention layers. For the architecture, please refer to the Nemotron-H tech report. The model was trained using Megatron-LM and NeMo-RL.
At this size and with only 4 attention layers, it should run very fast locally on cheap 12GB GPUs.
Some Highlights:
* Trained on 10M hours of diverse audio — speech, music, sound events, and natural conversations
* Built on top of Llama 3.2 3B for deep language and acoustic understanding
* Runs in real-time and supports edge deployment — smallest versions run on Jetson Orin Nano
* Outperforms GPT-4o-mini-tts and ElevenLabs v2 in prosody, emotional expressiveness, and multi-speaker dialogue
* Zero-shot natural multi-speaker dialogues — voices adapt tone, energy, and emotion automatically
* Zero-shot voice cloning with melodic humming and expressive intonation — no fine-tuning needed
* Multilingual support with automatic prosody adaptation for narration and dialogue
* Simultaneous speech and background music generation — a first for open audio foundation models
* High-fidelity 24kHz audio output for studio-quality sound on any device
* Open source and commercially usable — no barriers to experimentation or deployment
Model on Huggingface: https://huggingface.co/bosonai/higgs-audio-v2-generation-3B-...
What am I missing? For non-terminal diseases, it's a bit murkier, but still I don't follow the analogy.
It's not over, unless Google doesn't care enough about Google News to fix it.