Multimodal Database for Emotion Recognition among Individuals with Intellectual Disability


Social robots with empathic interaction is a crucial requirement towards deliverance of an effective cognitive stimulation among individuals with Intellectual Disability (ID) and has been challenged by absence of any particular database. Project REHABIBOTICS presents a first ever multimodal database of individuals with ID, recorded in a nearly real world settings for analysis of human affective states. MuDERI is an annotated multimodal database of audiovisual recordings, RGBD videos and physiological signals of 12 participants in actual settings, which were recorded as participants were elicited using personalized real world objects and/or activities.

The dataset was first presented in the following paper:

  • Shukla, J., Barreda-Ángeles, M., Oliver, J., Puig, D.: MuDERI: Multimodal Database for Emotion Recognition Among Intellectually Disabled Individuals. In: Agah, A., Cabibihan, J.-J., Howard, A.M., Salichs, M.A., and He, H. (eds.) Social Robotics: 8th International Conference, ICSR 2016, Kansas City, MO, USA, November 1-3, 2016 Proceedings. pp. 264–273. Springer International Publishing, Cham (2016).

Online link:

How to obtain:

To promote research for Individuals with Intellectual Disability, MuDERI is publicly available and can be obtained free of cost.

  • Interested researcher will have to send an email to after signing an EULA (End User License Agreement) which can be downloaded here.

The database will be provided after the receipt of the signed EULA.


This research work has been supported by the Industrial Doctorate program (Ref. ID.: 2014-DI-022) of AGAUR, Govt. of Catalonia and partially funded by the La Caixa Banking Foundation via project AutonoME (Ref. ID: APPSE-09429-AD16-00877-FAM). Also, authors are grateful for the cooperation of participants and their guardians, involved psychologists and professional caregivers from Ave Maria Foundation, Sitges in this research.

In collaboration with:

Fundació Obra Social “la Caixa”
Fundació Obra Social “la Caixa”
Doctorats Industrials
Fundació Obra Social “la Caixa”
Doctorats Industrials