cpdomina
Joined 15 years ago
Joined 15 years ago
"using GPT-4o-mini for query rewriting" -> model from 2024, when RAG was trendy, and all the langchain, llama-index, etc, docs mentioned this specific model
their bloom model was also a collaborative effort https://huggingface.co/docs/transformers/en/model_doc/bloom
https://github.com/Music-and-Culture-Technology-Lab/omnizart and https://basicpitch.spotify.com/
They work better if you apply some source separation before (e.g, https://github.com/sigsep/open-unmix-pytorch, https://github.com/facebookresearch/demucs, or https://mvsep.com)
Still, I think the best results are from proprietary models (specifically https://www.ableton.com/en/manual/converting-audio-to-midi/ and https://www.celemony.com/en/melodyne/what-is-melodyne)
- https://huggingface.co/EleutherAI/gpt-j-6B
- https://huggingface.co/t5-base
- https://huggingface.co/facebook/opt-66b
- https://huggingface.co/bigscience/bloomz-3b
There are also other companies offering large models as a service:
There's also some open source projects out there, such as aubio [3] and Omnizart [4].
[1] https://www.ableton.com/en/manual/converting-audio-to-midi/
[2] https://www.celemony.com/en/melodyne/what-is-melodyne
[3] https://aubio.readthedocs.io/en/latest/cli.html#aubionotes
[4] https://music-and-culture-technology-lab.github.io/omnizart-...