Dottorando in Ingegneria Informatica E Dei Sistemi , 41o ciclo (2025-2028)
Dipartimento di Automatica e Informatica (DAUIN)
Docente a contratto e/o collaboratore didattico
Scuola di Master e Formazione Permanente (SCMAST)
Profilo
Dottorato di ricerca
Argomento di ricerca
Preference models for multimodal annotations
Tutori
Keywords
Biografia
My research is currently focused on the frontier of Multimodal Language Models, with a specific emphasis on Audio LMs.
During the first year the I will benchmark Multimodal LLMs on established tasks by prompting them with annotation of different types and modalities. I will not only study the effect of annotation types and modality but also the ways to transfer modalities and input formats effectively and efficiently.
During the second year, the research will focus on designing a modality preference model able to recommend the right modality and format of the input annotations according to the model, context, and task. Finally, in the third year the research will extend the modality preference model and test in different real-world use cases.