MusicCollage: A Music Composition Tool for Children Based on Synesthesia and a Genetic Algorithm

Ge Yan, Cheng Yao, Chao Zhang, Jiadi Wang, Yuqi Hu, Fangtian Ying

Research output: Chapter in Book/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

Creating music can be challenging for children aged 4–6. Making the creation procedure more interesting has been proved to stimulate and build children’s interests in music. Based on the design concept of synesthesia from vision to hearing, we propose an application by which children aged 4–6 can create collages by matching different images of scenes and animals. The information contained in the created collages is then used as input parameters for generating music so as to create melodies corresponding to the collages. To evaluate our approach, we conducted a quantitative and qualitative user study with children (n = 6) by using our initial prototype. We concluded that the proposed application helps cultivate children's willingness to create melodies, and helps children better perceive and understand music by combining scenes and animal images in the collages.

Original languageEnglish
Title of host publicationDistributed, Ambient and Pervasive Interactions. Smart Living, Learning, Well-being and Health, Art and Creativity - 10th International Conference, DAPI 2022, Held as Part of the 24th HCI International Conference, HCII 2022, Proceedings
EditorsNorbert A. Streitz, Shin’ichi Konomi
PublisherSpringer Science and Business Media Deutschland GmbH
Pages205-216
Number of pages12
ISBN (Print)9783031054303
DOIs
Publication statusPublished - 2022
Externally publishedYes
Event10th International Conference on Distributed, Ambient and Pervasive Interactions, DAPI 2022 Held as Part of the 24th HCI International Conference, HCII 2022 - Virtual, Online
Duration: 26 Jun 20221 Jul 2022

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13326 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference10th International Conference on Distributed, Ambient and Pervasive Interactions, DAPI 2022 Held as Part of the 24th HCI International Conference, HCII 2022
CityVirtual, Online
Period26/06/221/07/22

Keywords

  • Children
  • Collage
  • Genetic algorithm
  • Music creation
  • Synesthesia

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'MusicCollage: A Music Composition Tool for Children Based on Synesthesia and a Genetic Algorithm'. Together they form a unique fingerprint.

Cite this