Please use this identifier to cite or link to this item:
https://open.uns.ac.rs/handle/123456789/15353
Title: | Style transplantation in neural network-based speech synthesis | Authors: | Suzić, Siniša Delić, Tijana Pekar, Darko Delić, Vlado Sečujski, Milan |
Issue Date: | 1-Jan-2019 | Journal: | Acta Polytechnica Hungarica | Abstract: | © 2019, Budapest Tech Polytechnical Institution. All rights reserved. The paper proposes a novel deep neural network (DNN) architecture aimed at improving the expressiveness of text-to-speech synthesis (TTS) by learning the properties of a particular speech style from a multi-speaker, multi-style speech corpus, and transplanting it into the speech of a new speaker, whose actual speech in the target style is missing from the training corpus. In most research on this topic speech styles are identified with corresponding emotional expressions, which was the approach accepted in this research as well, and the entire process is conventionally referred to as “emotion transplantation”. The proposed architecture builds on the concept of shared hidden layer DNN architecture, which was originally used for multi-speaker modelling, principally by introducing the style code as an auxiliary input. In this way, the mapping between linguistic and acoustic features performed by the DNN was made style dependent. The results of both subjective or objective evaluation of the quality of synthesized speech as well as the quality of style reproduction show that in case the emotional speech data available for training is limited, the performance of the proposed system represents a small but clear improvement to the state of the art. The system used as a baseline reference is based on the standard approach which uses both speaker code and style code as auxiliary inputs. | URI: | https://open.uns.ac.rs/handle/123456789/15353 | ISSN: | 17858860 | DOI: | 10.12700/APH.16.6.2019.6.11 |
Appears in Collections: | FTN Publikacije/Publications |
Show full item record
SCOPUSTM
Citations
10
checked on May 10, 2024
Page view(s)
32
Last Week
7
7
Last month
2
2
checked on May 10, 2024
Google ScholarTM
Check
Altmetric
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.