Mid Sweden University

miun.sePublikasjoner
Endre søk
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf
Tiny Machine Learning for Structural Health Monitoring with Acoustic Emissions
Mittuniversitetet, Fakulteten för naturvetenskap, teknik och medier, Institutionen för data- och elektroteknik (2023-).ORCID-id: 0000-0002-8617-0435
2024 (engelsk)Licentiatavhandling, med artikler (Annet vitenskapelig)
Abstract [en]

Acoustic Emission (AE) technology, as one of the non-destructive Structural Health Monitoring (SHM) methods, is increasingly utilized for the damage prediction, classification, maintenance, and real-time monitoring of infrastructure. Addressing the need for low latency, power consumption and high portability, a novel approach has been adopted where processing algorithms are embedded close to the sensors on these devices. Continuous data monitoring and collection, coupled with data processing and interpretation comparable to human experts, are anticipated from the next generation of the Internet of Things and smart sensing systems. While Machine Learning (ML) and Deep Learning (DL) has been successfully applied in a number of domains including SHM, resource-constrained, low-power devices pose a challenge for computationally complex ML algorithm execution.

To explore the feasibility of deploying ML and DL algorithms on edge devices, this study first proposes a lightweight CNN model based on raw AE signals for concrete damage classification and evaluates its performance on an ultra-low-power microcontroller unit (MCU). Subsequently, to further simplify the algorithm and explore the adaptability across various MCU platforms, a raw AE signal-based Artificial Neural Network (ANN) model is proposed, and its deployment performance on multiple MCUs is assessed. Additionally, the study assesses the impact of feature extraction on ANN performance with raw AE signals on MCUs, finding that using raw data directly is more resource and time-efficient. Lastly, the study investigates the generalization ability of the aforementioned CNN on a carbon fiber panel AE dataset, as well as the performance of 13 traditional ML algorithms on this dataset and their final deployment performance on MCUs. Due to the small size of the dataset, various data augmentation methods were also introduced and their impact on model robustness and accuracy was evaluated.

This thesis demonstrates for the first time that real-time inference on edge devices using AE signals for SHM is feasible. It also effectively demonstrates how to balance the critical trade-offs between accuracy, resource demands, and power consumption. Different MCUs and signal preprocessing methods are evaluated, and the impact of various data augmentation techniques on the accuracy of different ML algorithms and their inference robustness is explored in response to the challenge of collecting AE data, which is crucial for the next generation of SHM devices.

sted, utgiver, år, opplag, sider
Sundsvall: Mid Sweden University , 2024. , s. 48
Serie
Mid Sweden University licentiate thesis, ISSN 1652-8948 ; 204
HSV kategori
Identifikatorer
URN: urn:nbn:se:miun:diva-51322ISBN: 978-91-89786-69-1 (tryckt)OAI: oai:DiVA.org:miun-51322DiVA, id: diva2:1857441
Presentation
2024-06-13, C312, Holmgatan 10, Sundsvall, 13:00 (engelsk)
Opponent
Veileder
Merknad

Vid tidpunkten för framläggningen av avhandlingen var följande delarbeten opublicerade: delarbete 4 och 5 (inskickade manuskript).

At the time of the defence the following papers were unpublished: paper 4 and 5 (submitted manuscripts).

Tilgjengelig fra: 2024-05-14 Laget: 2024-05-13 Sist oppdatert: 2024-05-14bibliografisk kontrollert
Delarbeid
1. A Lightweight Convolutional Neural Network Model for Concrete Damage Classification using Acoustic Emissions
Åpne denne publikasjonen i ny fane eller vindu >>A Lightweight Convolutional Neural Network Model for Concrete Damage Classification using Acoustic Emissions
2022 (engelsk)Inngår i: 2022 IEEE Sensors Applications Symposium, SAS 2022 - Proceedings, IEEE, 2022Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

In this study, a convolutional neural network (CNN) model was developed for non-destructive damage classification of concrete materials based on acoustic emission techniques. The raw acoustic emission signal is used as the network model input, while the damage type is used as the output. In the study, 15,000 acoustic emission signals were used as the dataset, of which 12,000 signals were used for training, 1,500 signals for validation, and 1,500 signals for testing. Adaptive moment estimation (Adam) was used as the learning algorithm. Batch normalization and dropout layers were used to solve the overfitting problem generated in earlier versions of the model. The proposed model achieves an accuracy of 99.70% with 20,243 parameters, which provides a significant improvement over previous models. As a result, the classification of damages and decisions based upon them in non-destructive structural health monitoring applications can be improved. 

sted, utgiver, år, opplag, sider
IEEE, 2022
Emneord
acoustic emission, convolutional neural network, damage classification, Non-destructive
HSV kategori
Identifikatorer
urn:nbn:se:miun:diva-46299 (URN)10.1109/SAS54819.2022.9881386 (DOI)000861380600060 ()2-s2.0-85139088014 (Scopus ID)9781665409810 (ISBN)
Konferanse
17th IEEE Sensors Applications Symposium, SAS 2022, 1 August 2022 through 3 August 2022
Tilgjengelig fra: 2022-10-20 Laget: 2022-10-20 Sist oppdatert: 2024-05-13bibliografisk kontrollert
2. Leveraging Acoustic Emission and Machine Learning for Concrete Materials Damage Classification on Embedded Devices
Åpne denne publikasjonen i ny fane eller vindu >>Leveraging Acoustic Emission and Machine Learning for Concrete Materials Damage Classification on Embedded Devices
2023 (engelsk)Inngår i: IEEE Transactions on Instrumentation and Measurement, ISSN 0018-9456, E-ISSN 1557-9662, Vol. 72, artikkel-id 2525108Artikkel i tidsskrift (Fagfellevurdert) Published
Abstract [en]

For the field of structural health monitoring (SHM), acoustic emission (AE) technology is important as a damage identification technique that does not cause secondary damage to concrete. Nowadays, applications of non-destructive concrete damage identification are mostly limited to commercial software or identification algorithms running on desktop computers. It has so far not been deployed in low-power embedded devices. In this study, a lightweight convolutional neural network (CNN) model for online non-destructive damage type recognition of concrete materials is presented and deployed on a resource-constrained microcontroller unit as a tiny machine learning (TinyML) application. The CNN model uses raw acoustic emission signals as input and damage recognition types as output. 15,000 acoustic emission signals are used as data sets divided into training, validation, and test sets in the ratio of 8:1:1. The experimental results show that an accuracy of 99.6% is achieved on the nRF52840 microcontroller (ARM Cortex M4) with only 166.822 ms and 0.555mJ for a single inference using only 20K parameters and 30.5KB model size. This work demonstrates the effectiveness and feasibility of the proposed model, which achieves a trade-off between high classification accuracy and deployability on resource-constrained MCUs. Consequently, it provides strong support for online continuous non-destructive structural health monitoring. 

sted, utgiver, år, opplag, sider
IEEE, 2023
Emneord
Acoustic emission, acoustic emissions, Convolution, Convolutional neural networks, damage classification, Data models, embedded systems, Monitoring, Non-destructive testing, structural health monitoring, Testing, TinyML, Training
HSV kategori
Identifikatorer
urn:nbn:se:miun:diva-49234 (URN)10.1109/TIM.2023.3307751 (DOI)001063248800019 ()2-s2.0-85168744324 (Scopus ID)
Tilgjengelig fra: 2023-09-05 Laget: 2023-09-05 Sist oppdatert: 2024-05-13bibliografisk kontrollert
3. Tiny Machine Learning for Damage Classification in Concrete Using Acoustic Emission Signals
Åpne denne publikasjonen i ny fane eller vindu >>Tiny Machine Learning for Damage Classification in Concrete Using Acoustic Emission Signals
2023 (engelsk)Inngår i: 2023 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), IEEE, 2023Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

Acoustic emission (AE) is a widely used non-destructive test method in structural health monitoring applications to identify the damage type in the material. Usually, the analysis of the AE signal is done by using traditional parameter-based methods. Recently, machine learning methods showed promising results for the analysis of AE signals. However, these machine learning models are complex, slow, and consume significant amounts of energy. To address these limitations and to explore the trade-off between model complexity and the classification accuracy, this paper presents a lightweight artificial neural network model to classify damage types in concrete material using raw acoustic emission signals. The model consists of one hidden layer with four neurons and is trained on a public acoustic emission signal dataset. The created model is deployed to several microcontrollers and the performance of the model is evaluated and compared with a state-of-the-art machine learning model. The model achieves 98.4% accuracy on the test data with only 4019 parameters. In terms of evaluation metrics, the proposed tiny machine learning model outperforms previously proposed models 10 to 1000 times. The proposed model thus enables machine learning in real-time structural health monitoring applications. 

sted, utgiver, år, opplag, sider
IEEE, 2023
Emneord
acoustic emission, damage classification, embedded systems, IoT, machine learning, structural-health-monitoring, TinyML
HSV kategori
Identifikatorer
urn:nbn:se:miun:diva-49095 (URN)10.1109/I2MTC53148.2023.10175972 (DOI)001039259600092 ()2-s2.0-85166377110 (Scopus ID)9781665453837 (ISBN)
Konferanse
2023 IEEE International Instrumentation and Measurement Technology Conference (I2MTC)
Tilgjengelig fra: 2023-08-17 Laget: 2023-08-17 Sist oppdatert: 2024-05-13bibliografisk kontrollert
4. Comparison of Tiny Machine Learning Techniques for Embedded Acoustic Emission Analysis
Åpne denne publikasjonen i ny fane eller vindu >>Comparison of Tiny Machine Learning Techniques for Embedded Acoustic Emission Analysis
2024 (engelsk)Inngår i: 2024 IEEE 10th World Forum on Internet of Things (WF-IoT), IEEE conference proceedings, 2024Konferansepaper, Publicerat paper (Fagfellevurdert)
Abstract [en]

This paper compares machine learning approaches with different input data formats for the classification of acoustic emission (AE) signals. AE signals are a promising monitoring technique in many structural health monitoring applications. Machine learning has been demonstrated as an effective data analysis method, classifying different AE signals according to the damage mechanism they represent. These classifications can be performed based on the entire AE waveform or specific features that have been extracted from it. However, it is currently unknown which of these approaches is preferred. With the goal of model deployment on resource-constrained embedded Internet of Things (IoT) systems, this work evaluates and compares both approaches in terms of classification accuracy, memory requirement, processing time, and energy consumption. To accomplish this, features are extracted and carefully selected, neural network models are designed and optimized for each input data scenario, and the models are deployed on a low-power IoT node. The comparative analysis reveals that all models can achieve high classification accuracies of over 99\%, but that embedded feature extraction is computationally expensive. Consequently, models utilizing the raw AE signal as input have the fastest processing speed and thus the lowest energy consumption, which comes at the cost of a larger memory requirement.

sted, utgiver, år, opplag, sider
IEEE conference proceedings, 2024
Emneord
TinyML, acoustic emission, machine learning, structural health monitoring, feature extraction
HSV kategori
Identifikatorer
urn:nbn:se:miun:diva-51320 (URN)10.1109/WF-IoT62078.2024.10811219 (DOI)979-8-3503-7301-1 (ISBN)
Konferanse
10th IEEE World Forum on Internet of Things, WF-IoT 2024, Ottawa, Canada, 10 November - 13 November, 2024
Tilgjengelig fra: 2025-02-11 Laget: 2024-05-13 Sist oppdatert: 2025-02-11bibliografisk kontrollert
5.
Posten ble ikke funnet. Det kan skyldes at posten ikke lenger er tilgjengelig eller det er feil id i adressefeltet.

Open Access i DiVA

fulltext(1213 kB)268 nedlastinger
Filinformasjon
Fil FULLTEXT02.pdfFilstørrelse 1213 kBChecksum SHA-512
c5a899fd6e60860cda090dda555dd22d6c277e931242d9b99c88b10a5632fc1fb554a4f208d02650a3dcce1bf94598237c465148ac32a029bb46247a07339ee0
Type fulltextMimetype application/pdf

Person

Zhang, Yuxuan

Søk i DiVA

Av forfatter/redaktør
Zhang, Yuxuan
Av organisasjonen

Søk utenfor DiVA

GoogleGoogle Scholar
Totalt: 269 nedlastinger
Antall nedlastinger er summen av alle nedlastinger av alle fulltekster. Det kan for eksempel være tidligere versjoner som er ikke lenger tilgjengelige

isbn
urn-nbn

Altmetric

isbn
urn-nbn
Totalt: 965 treff
RefereraExporteraLink to record
Permanent link

Direct link
Referera
Referensformat
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Annet format
Fler format
Språk
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Annet språk
Fler språk
Utmatningsformat
  • html
  • text
  • asciidoc
  • rtf