Leveraging diversity in computer-aided musical orchestration with an artificial immune system for multi-modal optimization

  title={Leveraging diversity in computer-aided musical orchestration with an artificial immune system for multi-modal optimization},
  author={Marcelo F. Caetano and Asterios Zacharakis and Isabel Barbancho and Lorenzo J. Tard{\'o}n},
  journal={Swarm Evol. Comput.},
Abstract The aim of computer-aided musical orchestration (CAMO) is to find a combination of musical instrument sounds that perceptually approximates a reference sound when played together. The complexity of timbre perception and the combinatorial explosion of all possible musical instrument sound combinations make it very challenging to find even one orchestration for a reference sound. However, finding only one orchestration is seldom enough given the creative nature of the compositional… Expand
Applications of Computational Intelligence in Computer Music Composition
This study shows that the most suitable techniques for human composers imitative systems are case-based reasoning and artificial neural networks, and it is shown that Markov models are more suitable for predicting musical notes based on the given previous notes. Expand
Top 10 Artificial Intelligence Algorithms in Computer Music Composition
This study gives an insight on the most suitable algorithm for each musical task, such as rule-based systems for music theory representation, case-based reasoning for capturing previous musical experiences, Markov chains for melody generation, generative grammars for fast composition of musical pieces that comply to music rules, and linear programming for timbre synthesis. Expand
Leveraging Compatibility and Diversity in Computational Music Mashup Creation
The proposed model adopts the Artificial Immune System (AIS) opt-aiNet algorithm to efficiently compute a population of compatible and diverse mashups from loop recombinations to promote a diverse mashup population, outperforming both GA or BF approaches. Expand
Estimating Unobserved Audio Features for Target-Based Orchestration
Neural models for estimating the features of a mixture of sounds from the Features of the component sounds are explored, finding that standard features can be estimated with accuracy significantly better than that of the methods currently used in assisted orchestration systems. Expand
Audio Content Descriptors of Timbre
This chapter introduces acoustic modeling of timbre with the audio descriptors commonly used in music, speech, and environmental sound studies, and covers traditional temporal and spectral descriptors, including harmonic description, time-varying descriptor, and techniques for descriptor selection and descriptor decomposition. Expand
LQR Tuning Using AIS for Frequency Oscillation Damping
An Artificial Immune System (AIS) via clonal selection to automatically adjust the weighting matrices, Q and R, of LQR related to various system operating conditions changes is proposed and the obtained simulation results have shown that the proposed method could reduce the settling time and the overshoot of frequency oscillation, which is better than conventional L QR optimal control and without LQr optimal control. Expand
Time–frequency scattering accurately models auditory similarities between instrumental playing techniques
A machine listening model that relies on joint time–frequency scattering features to extract spectrotemporal modulations as acoustic features and minimizes triplet loss in the cluster graph by means of the large-margin nearest neighbor (LMNN) metric learning algorithm. Expand


Computer-Aided Musical Orchestration Using an Artificial Immune System
An artificial immune system AIS called opt-aiNet is used to search for combinations of musical instrument sounds that minimize the distance to a target sound encoded in a fitness function, and proposes alternative orchestrations for the same target sound that are different among themselves. Expand
Solving the musical orchestration problem using multiobjective constrained optimization with a genetic local search approach
Orchidée is introduced, a time-efficient evolutionary orchestration algorithm that allows the discovery of optimal solutions and favors the exploration of non-intuitive sound mixtures and the innovative CDCSolver repair metaheuristic, thanks to which the search is led towards regions fulfilling a set of musical-related requirements. Expand
Enhancing Orchestration Technique via Spectrally Based Linear Algebra Methods
The proposed tool (Linear Algebra Based ORCHestration) uses a bank of Discrete Fourier Transforms of orchestral sounds, which are accessed in different ways designed to either perform sound analysis or propose orchestrations that imitate the energetic pattern of a reference sound. Expand
Automatic Orchestration for Automatic Composition
The automatic orchestration problem is that of assigning instruments or sounds to the notes of an unorchestrated score. This is related to, but distinct from, problems of automatic expressiveExpand
Replacing the Orchestra? – The Discernibility of Sample Library and Live Orchestra Sounds
An internet-based experiment was conducted to investigate whether a classic orchestral work, produced with sounds from a state-of-the-art OSL, could be reliably discerned from a live orchestra recording of the piece. Expand
Predicting timbral and perceptual characteristics of orchestral instrument combinations
Using supervised learning methods to create regression and classification models, it is possible to predict specific timbral and perceptual characteristics from information about a combination of different orchestral instruments, which would provide methods to estimate the perception of instrument timbre fusions directly from abstract information. Expand
Predicting Timbre Features of Instrument Sound Combinations: Application to Automatic Orchestration
A set of functions to predict the timbre features of an instrument sound combination, given the features of the individual components in the mixture, are introduced and the accuracy of these predictors is shown. Expand
Simulation of Human voice Timbre by Orchestration of acoustic Music Instruments
A method which simulates the timbre of the human voice through the orchestration of classic music instrumental ensembles through the spectral envelope of speech, which was applied in the orchestra piece Nicanor, premiered 1999 in Stuttgart. Expand
An Evolutionary Approach to Computer-Aided Orchestration
The orchestration problem can be viewed as a multi-objective 0/1 knapsack problem, with additional constraints and a case-specific criteria formulation, and an hybrid evolutionary algorithm for computer-aided orchestration is introduced. Expand
On Computer-Assisted Orchestration
Almost 10 years after the start of this research project, it is time to look back at what was accomplished from the musical stand point, and to open some new perspectives on the subject, like the introduction of target descriptors for orchestral qualities, and Orchestral layers. Expand