diibv
Joined 6 years ago
Joined 6 years ago
See [2] for the list of models currently available. It includes updated ML models for the classifiers used in AcousticBrainz and many new models (e.g., a 400-style music classifier, models for arousal-valence emotion recognition, and feature embeddings that can be used for audio similarity or training new classifiers).
[1] https://essentia.upf.edu/ [2] https://essentia.upf.edu/models.html
Song Describer is an open-source annotation platform featuring CC-licensed music that anyone can annotate with natural language descriptions. Through this platform, we aim to create the first research dataset of music-caption pairs, which will give us insights into how people describe music and support the development of audio-text ML models.
There is an increasing need for music datasets that go beyond categorical labels and we hope that our data collection efforts will promote more research on the relationship between natural language and music audio, and its many potential applications. If you're interested in this field or are curious or willing to contribute, you can head to Song Describer to read more about it and start annotating right away!
For more information about the platform's design, see the late-breaking demo presented at the ISMIR 2022 conference: https://ismir2022program.ismir.net/lbd_405.html
Facilitating search and exploration is one of our main research directions related to Freesound. We do audio ML research, in particular, audio-based auto-tagging (see the already mentioned Freesound Datasets https://annotator.freesound.org/fsd/ we've built for this purpose) but also similarity and clustering based on audio analysis and tags.
So far, Freesound API provides similarity search and audio analysis features.
Have a look at the Freesound Explorer, which is an example of a 2D sound exploration interface built on top of audio features: https://labs.freesound.org/apps/2017/08/21/freesound-explore...
https://dbogdanov.com