Anna-Maria Multimodal Music Processing

Oslo, Norway
Joined November 2020
Attention systematic musicology students! 🎵🔬 As 2024 draws to a close, we, the SysMus25 elves, have an important reminder: 🗓 Abstract submission deadline: January 10th, 2025
1
3
7
1,081
Calling all MA and PhD students of Systematic Musicology: Are you wanting to share your research with peers at the #SysMus25 conference hosted by RITMO at the University of Oslo on the 11-13th of June 2025? Well, you are in luck!
2
8
1
6
2,592
Replying to @UniOslo_RITMO
@UniOslo_RITMO is recruiting a PhD student to study musical microrhythm, supervised by @annedanielsen and Rainer Polack. This is the best imaginable situation for a budding rhythm nerd. If you have any star undergrads in your lab open to a move to Norway...jobbnorge.no/en/available-jo…
12
1
15
2,465
What should we work on in music AI? Should we compose a similar document?
“What should I work on?” is a question we hear more & more often from NLP students, during a time when the media rhetoric is that “it’s been all solved” Turns out there are many NLP research areas rich for exploration—here is our answer from 20+ students arxiv.org/abs/2305.12544
4
2
2
19
11,203
We have no less than THREE new positions at RITMO!🎉 Two Doctoral Research Fellowships and one Postdoctoral Research Fellow. Deadline February 1. See below for more info! uio.no/ritmo/english/about/w…
2
25
1
27
4,445
MuTecEn retweeted
be careful which library you're using to load large numbers of audio files. librosa and pydub are very slow. the others are good. audioread is *very* fast.
12
12
4
82
13,094
📖#NewBook! 'Neurocognitive Music Therapy' by Dr. Rafael Ramírez-Meléndez from @mtg_upf 🗣️"The book provides an overview of neurocognitive music therapy, its impact and implications in the practice of evidence-based music interventions" cutt.ly/NwG5CrDz
4
8
516
"Guess the song title based on my drawing ..."🎄🎵 #Google #Gemini
2
11
1
91
33,310
Truly proud of this work done with @marcomunita and @EmilianPostola1! Check it out! Also thanks to our respective advisors @dhan90001 @IntelSoundEng @EmanueleRodola
SyncFusion: Multimodal Onset-synchronized Video-To-Audio Foley Synthesis. We use onsets extracted from silent videos and audio/text embeddings to condition a diffusion model for synchronized sound effects synthesis. arxiv: arxiv.org/abs/2310.15247 web: mcomunita.github.io/diffusio…
1
1
10
1,542
MuTecEn retweeted
Recent publication by Hans-Hinrich Thedens and @OlliLartinen: "AudioSegmentor: Et verktøy for formidling av arkivopptak på nettet" (AudioSegmentor: A tool for disseminating archival recordings online) idunn.no/eprint/AESAPBKW8VKD…
3
2
270
Next year I'll be hosting a Student Researcher on the Magenta Team at @GoogleDeepMind who's primary goal will be to explore new methods for controllable generative models for music. Apply at the link below (US only) and reach out with any questions. deepmind.google/about/career…
3
13
1
86
14,307
Very interesting new MULTIMODAL model from Google to "enhance creativity, extend knowledge, advance science and transform the way billions of people live and work around the world".
We believe in making AI helpful for everyone. That’s why we’re launching Gemini, our most capable model that’s inspired by the way people understand and interact with the world. #GeminiAI
118
Every leading AI x Music company should have at least one senior-level member who spent a portion of their life as a *professional* musician. Groups composed solely of engineers simply cannot understand the immensely difficult life of a 21st century working artist.
I’ve resigned from my role leading the Audio team at Stability AI, because I don’t agree with the company’s opinion that training generative AI models on copyrighted works is ‘fair use’. First off, I want to say that there are lots of people at Stability who are deeply thoughtful about these issues. I’m proud that we were able to launch a state-of-the-art AI music generation product trained on licensed training data, sharing the revenue from the model with rights-holders. I’m grateful to my many colleagues who worked on this with me and who supported our team, and particularly to Emad for giving us the opportunity to build and ship it. I’m thankful for my time at Stability, and in many ways I think they take a more nuanced view on this topic than some of their competitors. But, despite this, I wasn’t able to change the prevailing opinion on fair use at the company. This was made clear when the US Copyright Office recently invited public comments on generative AI and copyright, and Stability was one of many AI companies to respond. Stability’s 23-page submission included this on its opening page: “We believe that Al development is an acceptable, transformative, and socially-beneficial use of existing content that is protected by fair use”. For those unfamiliar with ‘fair use’, this claims that training an AI model on copyrighted works doesn’t infringe the copyright in those works, so it can be done without permission, and without payment. This is a position that is fairly standard across many of the large generative AI companies, and other big tech companies building these models — it’s far from a view that is unique to Stability. But it’s a position I disagree with. I disagree because one of the factors affecting whether the act of copying is fair use, according to Congress, is “the effect of the use upon the potential market for or value of the copyrighted work”. Today’s generative AI models can clearly be used to create works that compete with the copyrighted works they are trained on. So I don’t see how using copyrighted works to train generative AI models of this nature can be considered fair use. But setting aside the fair use argument for a moment — since ‘fair use’ wasn’t designed with generative AI in mind — training generative AI models in this way is, to me, wrong. Companies worth billions of dollars are, without permission, training generative AI models on creators’ works, which are then being used to create new content that in many cases can compete with the original works. I don’t see how this can be acceptable in a society that has set up the economics of the creative arts such that creators rely on copyright. To be clear, I’m a supporter of generative AI. It will have many benefits — that’s why I’ve worked on it for 13 years. But I can only support generative AI that doesn’t exploit creators by training models — which may replace them — on their work without permission. I’m sure I’m not the only person inside these generative AI companies who doesn’t think the claim of ‘fair use’ is fair to creators. I hope others will speak up, either internally or in public, so that companies realise that exploiting creators can’t be the long-term solution in generative AI.
9
21
5
154
24,646
Hi! Since the MIRtoolbox official webpage has been currently removed, we just released MIRtoolbox GitHub project. You can download the latest version from here. github.com/olivierlar/mirtoo…
1
4
209
MuTecEn retweeted
I'm excited to introduce our new foundation model for music audio, demonstrating remarkable performance gain in multiple downstream tasks, even with shallow probing layers. The pretrained model is available online. 🎶 Paper: arxiv.org/abs/2311.03318 Code: github.com/minzwon/musicfm
3
25
4
130
14,353
🔊🎶mirdata 0.3.8 is out‼️ 7 new loaders, for a total of 52 dataset loaders! If you work in MIR and haven’t checked it out yet, now is your chance! #@ISMIRConf Zenodo: zenodo.org/records/10070589 Datasets: mirdata.readthedocs.io/en/st…
2
13
3
60
8,700
✍️New model out✍️ MAEST is an open music representation model trained in music style classification. 🎙️Conf: Accepted in #ISMIR2023 📄Paper: hdl.handle.net/10230/58023 💻Code: github.com/palonso/MAEST ⚙️Essentia: essentia.upf.edu/models.html… 🤗 HF: huggingface.co/mtg-upf 🧵👇 [1/6]
1
22
2
63
11,784
Welcome to have a look at out new work: "Loop Copilot: Conducting AI Ensembles for Music Generation and Iterative Editing"! Now you can interactively modify the results. Paper: bit.ly/loop-copilot (see the arxiv version tomorrow!) Demo: sites.google.com/view/loop-c…
6
28
7
135
25,583