Mid Sweden University

miun.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Skin Cancer Classification based on Cosine Cyclical Learning Rate with Deep Learning
Mid Sweden University, Faculty of Science, Technology and Media, Department of Electronics Design.
Mid Sweden University, Faculty of Science, Technology and Media, Department of Electronics Design.
Show others and affiliations
2022 (English)In: Conference Record - IEEE Instrumentation and Measurement Technology Conference, IEEE, 2022Conference paper, Published paper (Refereed)
Abstract [en]

Since early-stage skin cancer identification can improve melanoma prognosis and significantly reduce treatment costs, AI-based diagnosis systems might greatly benefit patients suffering from suspicious skin lesions. The study proposes a cosine cyclical learning rate with a skin cancer classification model to improve melanoma prediction. The contributions of models involve three critical CNNs, which are standard deep feature extraction modules for the skin cancer classification in this study (Vgg19, ResNet101 and InceptionV3). Each CNN model applies three different learning rates: fixed learning rate(LR), Cosine Annealing LR, and Cosine Annealing with WarmRestarts. HAM10000 is a large collection of publicly available dermoscopic images dataset used for our experiments. The performance of the proposed approach was appraised through comparative experiments. The outcome has indicated that the proposed method has high efficiency in diagnosing skin lesions with a cosine cyclical learning rate. 

Place, publisher, year, edition, pages
IEEE, 2022.
Keywords [en]
cosine cyclical learning rate, deep learning, dermoscopic images, HAM10000, skin cancer
National Category
Computer Engineering Cancer and Oncology
Identifiers
URN: urn:nbn:se:miun:diva-45757DOI: 10.1109/I2MTC48687.2022.9806568ISI: 000844585400099Scopus ID: 2-s2.0-85134427579ISBN: 9781665483605 (print)OAI: oai:DiVA.org:miun-45757DiVA, id: diva2:1685459
Conference
2022 IEEE International Instrumentation and Measurement Technology Conference, I2MTC 2022, 16 May 2022 through 19 May 2022
Available from: 2022-08-03 Created: 2022-08-03 Last updated: 2023-01-20Bibliographically approved
In thesis
1. Deep Learning Approaches towards Skin Lesion Classification with Dermoscopic Images
Open this publication in new window or tab >>Deep Learning Approaches towards Skin Lesion Classification with Dermoscopic Images
2023 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Melanoma is a skin cancer that tends to be deadly. The incidence of melanoma is currently at the highest level ever recorded in Europe, North America and Oceania. The survival rate can be significantly increased if skin lesions are identified in dermoscopic images at an early stage. In the other hand, the classification of skin lesions is incredibly challenging. Skin lesion classification using deep learning approaches has provided better results in classifying skin diseases than those of dermatologist, which is lifesaving in terms of diagnosis.

This thesis presents a review of our research articles on classifying skin lesions using deep learning. Regarding the research, I have four goals concerning research frontier work, small datasets, data imbalance, and improving accuracy. In this thesis, I discuss how deep learning can classify skin diseases, summarizing the problems that remain at this stage and the outlook for the future.

For the above goals, I first studied and summarized more than 200 highguality articles published over five years. I then used three versions of You only look once (Yolo) to detect skin lesions. Although there were only 200 pictures, the test was very effective for detection. I applied the five-fold algorithm to Vgg_16, trained five models, and fused them so solve the small data problem. To improve the accuracy, I also tried to combine the traditional machine learning method, i.e., the seven-point checklist, with three different backbones. Since the learning rate. Then, I also tried to use the hybrid model, combining convolutional neural networks (CNN) and transformer to train the dataset, and applied focal loss to balance the extremely unbalanced weight of the data.

In addition to high-quality data sets and high-performance computers being extremely important in the research and application of deep learning, the optimization of machine learning algorithms for skin lesions can be endless

Abstract [sv]

Melanom är en form av hudcancer som tenderar att vara dödlig. Förekomsten av melanom är för närvarande på den högsta nivån som någonsin registrerats i Europa, Nordamerika och Oceanien. Chansen för överlevnad ökar avsevärt om hudskadorna identifieras i dermatoskopiska bilder i ett tidigare skede, men klassificering av hudskador är otroligt utmanande. Med metoder för djupinlärning har klassificering av hudsjukdomar i vissa fall gett bättre resultat än hudläkares diagnoser, vilket ger större möjligheter att rädda liv.

Denna avhandling presenterar en genomgång av våra forskningsartiklar om klassificering av hudskador med hjälp av djupinlärning. När det gäller vår forskning har jag fyra mål som handlar om forskningens frontlinjearbete, små datamängder, obalans i data och om att förbättra noggrannheten. I detta avhandlingsarbete diskuterar jag hur djupinlärning kan klassificera hudsjukdomar, sammanfattar de problem som kvarstår i detta skede och diskuterar utsikterna för framtiden.

För ovanstående mål studerade och sammanfattade jag först mer än 200 högkvalitativa artiklar publicerade under fem år. Jag använde sedan tre versioner av You only look once (Yolo) för att upptäcka hudskador. Även om det bara fanns 200 bilder var testet mycket effektivt för upptäckt. Jag tillämpade en femdelad algoritm på Vhh-16, tränade fem modeller och sammanfogade dem för att lösa problemet med små datamängder. För att förbättra noggrannheten försökte jag också kombinera en sjupunkts checklista, förstärkt med maskininlärning, med tre olika grundstommar. Eftersom inlärningshastigheten starkt påverkar modellträningen använde jag cosinus-inlärningshastigheten. Sedan försökte jag också använda hybridmodellen, som kombinerade konvolutionella neurala nätverk (CNN) och transformator för att träna dataset, och tillämpade fokalförlust för att balansera den extremt obalanserade vikten av datan.

Förutom att högkvalitativa datamängder och högpresterande datorer är extremt viktiga i forskningen och tillämpningen av djupinlärning, kan optimeringen av maskininlärningsalgoritmer för hudskador vara oändliga.

Place, publisher, year, edition, pages
Sundsvall: Mid Sweden University, 2023. p. 51
Series
Mid Sweden University doctoral thesis, ISSN 1652-893X ; 383
National Category
Medical Image Processing
Identifiers
urn:nbn:se:miun:diva-46957 (URN)978-91-89341-86-9 (ISBN)
Public defence
2023-02-16, C312, Holmgatan 10, Sundsvall, 09:00 (English)
Supervisors
Available from: 2023-01-20 Created: 2023-01-19 Last updated: 2023-01-20Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Nie, YaliO'Nils, MattiasLundgren, Jan

Search in DiVA

By author/editor
Nie, YaliO'Nils, MattiasLundgren, Jan
By organisation
Department of Electronics Design
Computer EngineeringCancer and Oncology

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 101 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf