Birdsong Syllable Recognition Using Neuromorphic Computing

POSTER

Abstract

Neuromorphic computing enables highly parallel and energy-efficient computation compared to traditional CPUs. These features make it an ideal candidate for the implementation of continuous speech recognition, which requires low-latency. Audio data can be converted into sparse, spatiotemporal sequences of spikes which are input into a spiking neural network that performs speech recognition. The parallel nature of neuromorphic hardware enables a template matching network to be implemented using a large number of templates while minimizing the latency of recognition. Birdsong audio is an ideal dataset for developing speech recognition networks, as it possesses distinct syllables that can be recognized in a similar manner to human speech. Using Intel's Loihi neuromorphic chip, we are implementing a template-matching spiking neural network to perform recognition of syllables in birdsong recordings.

*This work was supported by the Intel Corporation through the Intel Neuromorphic Research Community

Presenters

  • Kevin Sargent

    • Pennsylvania State University

Authors

  • Kevin Sargent

    • Pennsylvania State University
  • Leonardo E Tavares

    • The Pennsylvania State University
    • Pennsylvania State University
  • Dezhe Z Jin

    • Pennsylvania State University
    • The Pennsylvania State University
    • Department of Physics and Center for Neural Engineering, Pennsylvania State University