Efficient Continual Learning in Keyword Spotting using Binary Neural NetworksShow others and affiliations
2025 (English)In: 2025 IEEE Sensors Applications Symposium (SAS), IEEE conference proceedings, 2025, p. 1-6Conference paper, Published paper (Refereed)
Abstract [en]
Keyword spotting (KWS) is an essential function that enables interaction with ubiquitous smart devices. However, in resource-limited devices, KWS models are often static and can thus not adapt to new scenarios, such as added keywords. To overcome this problem, we propose a Continual Learning (CL) approach for KWS built on Binary Neural Networks (BNNs). The framework leverages the reduced computation and memory requirements of BNNs while incorporating techniques that enable the seamless integration of new keywords overtime. This study evaluates seven CL techniques on a 16-classuse case, reporting an accuracy exceeding 95% for a single additional keyword and up to 86% for four additional classes. Sensitivity to the amount of training samples in the CL phase, and differences in computational complexities are being evaluated. These evaluations demonstrate that batch-based algorithms are more sensitive to the CL dataset size, and that differences between the computational complexities are insignificant. These findings highlight the potential of developing an effective and computationally efficient technique for continuously integrating new keywords in KWS applications that is compatible with resource-constrained devices.
Place, publisher, year, edition, pages
IEEE conference proceedings, 2025. p. 1-6
Keywords [en]
binary neural network, continual learning, keyword spotting, tinyML
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:miun:diva-55334DOI: 10.1109/sas65169.2025.11105106ISI: 001565970000006Scopus ID: 2-s2.0-105029898799ISBN: 979-8-3315-1193-7 (electronic)OAI: oai:DiVA.org:miun-55334DiVA, id: diva2:1990382
Conference
2025 IEEE Sensors Applications Symposium (SAS), Newcastle, 8-10 July, 2025
Funder
Knowledge Foundation2025-08-202025-08-202026-02-24Bibliographically approved