Music Composition Assistance

5. Music Composition Assistance#

Presumably, LLM as an assistant for music composition would share many properties with LLMs as an assistant for writing. So, I shamelessly replace this section with this paper: [IYCB22].

..Since that feels overly shameless, here are some recent progress in using LLMs for composition. These are all about the symbolic domain and notations.

  • ChatMusician [YLW+24]

    • MusicPile: 4B-token music-language corpora

    • MusicTheoryBench: Curated college-level music understanding benchmark

    • A LLaMA2-finetuned model “ChatMusician” that can understand and generate ABC notation

  • ComposerX [DYY+24]

    • GPT-4 with various prompting methods to create melody and harmony / to review and revise / to finalize the composition.

  • SongComposer [DLD+24]

    • Lyric-to-melody generation by finetuning an open-sourced LM.

  • ByteComposer [LLD24]

  • A workflow consists of conception analysis - drafting - self-evaluation - final selection