The Multi-Agent Systems (MAS) group at IIIA-CSIC carries out scientific research of excellence in areas that are central to autonomous agents and multi-agent systems: computational models of negotiation, control and organisation, trust and reputation, optimisation, semantics, and recommender systems. It positions itself at the intersection of CSIC's global areas SOCIETY and MATTER through interdisciplinary research of high socio-economic impact. The goals of the group are governed by an approach to AI focused on human beings, developing computer systems that are aligned with the ethical and social values of the communities that use them, empowering people in the interactions mediated by these systems, respecting and fostering diversity, and exploring new forms of collaboration.
Head of the Group: Marco Schorlemmer
Prev
1 (current)
2
3
4
5
Next
In Press
Nardine Osman,
Ronald Chenu-Abente,
Qiang Shen,
Carles Sierra,
& Fausto Giunchiglia
(In Press).
Empowering Users in Online Open Communities.
SN Computer Science.
[BibTeX]
[PDF]
in press
Pablo Noriega,
Manel Poch,
& Donaire Jose A
(in press).
Sandboxing Sustainable Tourism.
Annika Bush (Eds.),
Sustainability and Artificial Intelligence - Reshaping Tomorrow
.
[BibTeX]
[PDF]
2026
Pablo Noriega,
& Enric Plaza
(2026).
Four Settings and a Proposal for the Exploration of Value Alignment in AI.
Pablo Jiménez Schlegl Daniel López Castro (Eds.),
Regulating Autonomy (pp 1-30 proof).
SPRINGER NATURE.
[BibTeX]
[PDF]
Pompeu Casanovas,
& Pablo Noriega
(2026).
Governance of Artificial Agency and AI Value Chains.
Pablo Jiménez Schlegl Daniel López Castro (Eds.),
Regulating Autonomy (pp 1-30 proof).
SPRINGER.
https://doi.org/10.007/978-3-032-13063-1_16.
[BibTeX]
[PDF]
Nardine Osman,
Manel Rodríguez Soto,
& Jordi Sabater-Mir
(2026).
Instilling Organisational Values in Firefighters through Simulation-Based Training.
Daniel López Castro, Manuel Cebral-Loureda, & Pablo Jiménez Schlegl (Eds.),
Regulating autonomy: Ethics, values and governance in artificial intelligence.
Springer.
[BibTeX]
[PDF]
Manel Rodríguez Soto,
Roxana Rădulescu,
Filippo Bistaffa,
Oriol Ricart,
Arnau Mayoral Macau,
Maite López-Sánchez,
Juan A. Rodríguez-Aguilar,
& Ann Nowé
(2026).
Multi-objective reinforcement learning for provably incentivising alignment with value systems.
Artificial Intelligence, 351, 104460.
https://doi.org/10.1016/j.artint.2025.104460.
[BibTeX]
Margarida Romero,
& Oksana Strutynska
(2026).
Pre-Service Teachers and Artificial Intelligence in Education: A Comparative Study Between.
Methodologies and Intelligent Systems for Technology Enhanced Learning, Workshops-15th International Conference
(pp. 19).
[BibTeX]
Núria Vallès-Peris,
Cristian Barrué,
& Guillem Alenyà
(2026).
Relational autonomy with robots. A focused ethnography of meal assistance robots.
International Journal of Social Robotics.
https://doi.org/10.1007/s12369-026-01372-4.
[BibTeX]
[PDF]
Alexandre Lepage,
Normand Roy,
& Margarida Romero
(2026).
Un modèle didactique d’enseignement-apprentissage de l’intelligence artificielle: Une étude par théorisation ancrée des pratiques de médiation scientifique de la Maison de l’intelligence artificielle en France.
Sciences et Technologies de l'Information et de la Communication pour l'Education et la Formation, 33.
[BibTeX]
[PDF]
2025
Eric Roselló-Marín,
Inmaculada Rodríguez Santiago,
Maite López-Sánchez,
Manel Rodríguez Soto,
& Juan A. Rodríguez-Aguilar
(2025).
A Conversational Agent That Learns to be Aligned With the Moral Value of Respect.
The European Journal on Artificial Intelligence.
https://doi.org/10.1177/30504554241311168.
[BibTeX]
[PDF]
Margarida Romero,
& Alex Urmeneta
(2025).
AI as Facilitator of Human-Led Creativity, Creative Partner, or Semi-autonomous Creative Artefact Generator? The Role of AI in Supporting Creative Processes.
International Conference in Methodologies and intelligent Systems for Techhnology Enhanced Learning
(pp. 44--54).
[BibTeX]
[PDF]
Arnau Mayoral Macau,
Manel Rodríguez Soto,
Enrico Marchesini,
Martí Sánchez Fibla,
Maite López-Sánchez,
Juan A. Rodríguez-Aguilar,
& Alessandro Farinelli
(2025).
An approximate embedding for designing ethical reinforcement learning environments.
Proceedings of the 28th European Conference on Artificial Intelligence (ECAI 2025)
.
[BibTeX]
[PDF]
Núria Vallès-Peris,
& Víctor Bermejo Gil
(2025).
Artificial Intelligence in Vocational Training. Opportunities and Risks.
Ayuda en Acción.
[BibTeX]
[PDF]
Arnau Mayoral Macau,
Manel Rodríguez Soto,
Enrico Marchesini,
Maite López-Sánchez,
Martí Sánchez Fibla,
Alessandro Farinelli,
& Juan A. Rodríguez-Aguilar
(2025).
Automated ethical design of multi-agent reinforcement learning environments.
Proceedings of the 27th International Conference of the Catalan Association for Artificial Intelligence, CCIA 2025
.
[BibTeX]
[PDF]
Dave de Jonge
(2025).
BINGO: An Algorithm for Automated Negotiations with Hidden Reservation Values and a Fixed Number of Rounds.
Inês Lynce, Nello Murano, Mauro Vallati, Serena Villata, Federico Chesani, Michela Milano, Andrea Omicini, & Mehdi Dastani (Eds.),
28th European Conference on Artificial Intelligence, 25-30 October 2025, Bologna, Italy
(pp. 4897 - 4904).
IOS Press.
https://doi.org/10.3233/FAIA251400.
[BibTeX]
[PDF]
Manel Rodríguez Soto,
Nardine Osman,
& Jordi Sabater-Mir
(2025).
Bridging the Gap between Value Alignment and Multi-Objective Reinforcement Learning.
.
Third International Workshop on Value Engineering in Artificial Intelligence (VALE2025) at the European Conference on Artificial Intelligence (ECAI), Bologna).
[BibTeX]
[PDF]
Pompeu Casanovas
(2025).
Compliance, Regtech, and smart legal ecosystems: a methodology for legal governance validation.
Woodrow Barfield, & Ugo Pagallo (Eds.),
Research handbook on the law of artificial intelligence. Current and future directions: Second edition (pp 73/104).
Edward Elgar Publishing.
[BibTeX]
[PDF]
Roger Xavier Lera Leri,
Filippo Bistaffa,
Tomas Trescak,
& Juan A. Rodríguez-Aguilar
(2025).
Computing Job-Tailored Degree Plans Towards the Acquisition of Professional Skills.
Annals of Operations Research, 1--34.
[BibTeX]
[PDF]
Arnau Mayoral Macau,
Manel Rodríguez Soto,
Enrico Marchesini,
Martí Sánchez Fibla,
Maite López-Sánchez,
Juan A. Rodríguez-Aguilar,
& Alessandro Farinelli
(2025).
Designing ethical environments using multi-agent reinforcement learning.
Adaptive and Learning Agents Workshop (AAMAS 2025)
.
[BibTeX]
[PDF]
Ferran Gebellí,
Anaís Garell,
Séverin Lemaignan,
& Raquel Ros
(2025).
Dynamics of Mental Models: Objective Vs. Subjective User Understanding of a Robot in the Wild.
IEEE Robotics and Automation Letters, 10, 7755-7762.
https://doi.org/10.1109/LRA.2025.3579217.
[BibTeX]
[PDF]
Sara Cooper,
Bartomeu Pou,
Arnau Mayoral-Macau,
Alberto Redondo,
David Rios,
& Raquel Ros
(2025).
EMOROBCARE: A Low-Cost Social Robot for Supporting Children with Autism in Therapeutic Settings.
International Conference on Social Robotics (ICSR)
.
[BibTeX]
[PDF]
Víctor Abia Alonso,
Marc Serramia,
& Eduardo Alonso
(2025).
Finding Our Moral Values: Guidelines for Value System Aggregation.
Proceedings of the DemocrAI workshop at IJCAI 2025
.
[BibTeX]
[PDF]
Lorenzo Ferrini,
Antonio Andriella,
Raquel Ros,
& Severin Lemaignan
(2025).
From Percepts to Semantics: A Multi-modal Saliency Map to Support Social Robots's Attention.
ACM Transactions on Human-Robot Interaction, 14.
https://doi.org/10.1145/3737891.
[BibTeX]
[PDF]
Pablo Noriega,
& Pompeu Casanovas
(2025).
{From the Pascal Wager to Value Engineering: A Glance at AI Risks and How to Address Them}.
Value Engineering in Artificial Intelligence: Second International Workshop, VALE 2024, Santiago de Compostela, Spain, October 19–24, 2024, Revised Selected Papers
(pp. 257–275).
Springer-Verlag.
https://doi.org/10.1007/978-3-031-85463-7_16.
[BibTeX]
[PDF]
Núria Vallès-Peris,
& Víctor Bermejo Gil
(2025).
La Inteligencia Artificial en la Formación Profesional. Oportunidades y riesgos.
Ayuda en Acción.
[BibTeX]
[PDF]
Marc-André Girard,
Normand Roy,
& Margarida Romero
(2025).
L’émergence de l’intelligence artificielle dans les établissements d’enseignement. Quelle perception des directions?.
Enjeux et société, 12, 25--61.
[BibTeX]
Ferran Gebelli,
Anais Garrell,
Jan-Gerrit Habekost,
Séverin Lemaignan,
Stephan Wermter,
& Raquel Ros
(2025).
Personalised Explanations in Long-Term Human-Robot Interactions.
IEEE International Conference on Robot and Human Interactive Communication
.
[BibTeX]
[PDF]
Margarida Romero,
& Oksana Strutynska
(2025).
Pre-Service Teachers and Artificial Intelligence in Education: A Comparative Study Between Ukraine and France.
International Conference in Methodologies and intelligent Systems for Techhnology Enhanced Learning
(pp. 19--30).
[BibTeX]
Arnau Mayoral Macau,
Manel Rodríguez Soto,
Daniele Meli,
Martí Sánchez Fibla,
& Juan A. Rodríguez-Aguilar
(2025).
Safety embedding: designing safe environments with lexicographic deep reinforcement learning.
Multi-Objective Decision Making Workshop - 2025 (MoDeM 2025)
.
[BibTeX]
[PDF]
Manel Rodríguez Soto,
Nardine Osman,
Carles Sierra García,
Rocio Cintas-Garcia,
Cristina Farriols-Danes,
Montserrat Garcia-Retortillo,
Silvia Minguez-Maso,
& Jordi Martinez-Roldan
(2025).
Towards Automating the Design of Value-Aligned Clinical Protocols.
Proceedings of the 24th International Conference on Autonomous Agents and Multiagent Systems
(pp. 2729–2731).
International Foundation for Autonomous Agents and Multiagent Systems.
[BibTeX]
[PDF]
Margarida Romero,
Enric Vidal,
Annalisa Sannino,
Sylvie Barma,
Katerina Plakitsi,
Brett Bligh,
Yannick Lémonie,
Manuel Mata,
Diego Di Masi,
Thomas Frøsig,
& others
(2025).
Towards Equity, Peace and Sustainability in Times of Crisis.
ISCAR 2025 Southern Europe and West Asia conference
(pp. 185).
[BibTeX]
[PDF]
Chengheng Li Chen,
Antonio Lobo Santos,
Marc Serramia,
& Maite Lopez-Sanchez
(2025).
Trustworthy AI Through Dual-Role Reasoning: Ethical, Legal, and Psychological Internal Critique.
Proceedings of the Identity-Aware AI workshop at the 28th European Conference on Artificial Intelligence
.
[BibTeX]
[PDF]
Prev
1 (current)
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
Next