摘要
This study proposes a new generation network based on transformers and guided by the music theory to produce high-quality music work.In this study,the decoding block of the transformer is used to learn the internal information of single-track music,and cross-track transformers are used to learn the information amongst the tracks of different musical instruments.A reward network based on the music theory is proposed,which optimizes the global and local loss objective functions while training and discriminating the network so that the reward network can provide a reliable adjustment method for the generation of the network.The method of combining the reward network and cross entropy loss is used to guide the training of the generator and produce high-quality music work.Compared with other multi-track music generation models,the experimental results verify the validity of the model.
基金
the research project funded by the National Natural Science Foundation of China(Grant No.61631016 and 61901421)
the National Key R&D Program of China(Grant No.2018YFB1403903)
supported by the Fundamental Research Funds for the Central Universities(Grant No.CUC210B011).
