Publication detail

Sequence Summarizing Neural Networks for Spoken Language Recognition

PEŠÁN, J. BURGET, L. ČERNOCKÝ, J.

Original Title

Sequence Summarizing Neural Networks for Spoken Language Recognition

Type

conference paper

Language

English

Original Abstract

This paper explores the use of Sequence Summarizing Neural Networks (SSNNs) as a variant of deep neural networks (DNNs) for classifying sequences. In this work, it is applied to the task of spoken language recognition. Unlike other classification tasks in speech processing where the DNN needs to produce a per-frame output, language is considered constant during an utterance. We introduce a summarization component into the DNN structure producing one set of language posteriors per utterance. The training of the DNN is performed by an appropriately modified gradient-descent algorithm. In our initial experiments, the SSNN results are compared to a single state-of-the-art i-vector based baseline system with a similar complexity (i.e. no system fusion, etc.). For some conditions, SSNNs is able to provide performance comparable to the baseline system. Relative improvement up to 30% is obtained with the score level fusion of the baseline and the SSNN systems.

Keywords

Sequence Summarizing Neural Network, DNN, i-vectors

Authors

PEŠÁN, J.; BURGET, L.; ČERNOCKÝ, J.

Released

8. 9. 2016

Publisher

International Speech Communication Association

Location

San Francisco

ISBN

978-1-5108-3313-5

Book

Proceedings of Interspeech 2016

Pages from

3285

Pages to

3289

Pages count

5

URL

BibTex

@inproceedings{BUT131019,
  author="Jan {Pešán} and Lukáš {Burget} and Jan {Černocký}",
  title="Sequence Summarizing Neural Networks for Spoken Language Recognition",
  booktitle="Proceedings of Interspeech 2016",
  year="2016",
  pages="3285--3289",
  publisher="International Speech Communication Association",
  address="San Francisco",
  doi="10.21437/Interspeech.2016-764",
  isbn="978-1-5108-3313-5",
  url="https://www.researchgate.net/publication/307889421_Sequence_Summarizing_Neural_Networks_for_Spoken_Language_Recognition"
}