Open this publication in new window or tab >> Show others...
2026 (English) In: IEEE Access, E-ISSN 2169-3536, Vol. 14, p. 6833-6846Article in journal (Refereed) Published
Abstract [en] Deploying deep neural networks (DNNs) in real-time, resource-constrained edge environments remains a significant challenge due to the increasing depth and computational demand of state-of-the-art models. While state-of-the-art split computing and early-exit architectures independently offer solutions to reduce inference latency and offloading overhead, they are rarely integrated in a unified framework. This paper introduces BranchySplit, a novel architecture that combines runtime-adaptable state-of-the-art split computing with early exit mechanisms to accelerate inference in edge-cloud systems. Our method employs a shared runtime-adaptable autoencoder to support multiple partitioning points, enabling runtime adaptability based on varying system conditions. By integrating early exit branches at intermediate layers, the model can terminate inference early when confidence is sufficient, further reducing computation and communication. Extensive experiments on Caltech-256 and Tiny-ImageNet datasets using four backbone models (VGG-16, ResNet-50, EfficientFormerV2-S2, and ConvNeXT-Small) show that our approach consistently outperforms the traditional split computing approaches, achieving up to 2.7x latency speed-up compared to an all-in-server solution, while maintaining comparable or even improved accuracy. In addition, our proposed runtime-adaptable compression pipeline achieves a higher speed-up compared to the pipeline in similar work, i.e. SPINN, with up to 10x for ResNet50 on Caltech-256. These results demonstrate the efficacy of BranchySplit in enabling low-latency, resource-efficient vision inference in heterogeneous edge-cloud settings.
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2026
Keywords early exit, Edge computing, partitioning, runtime-adaptable inference, split computing, vision models
National Category
Computer Sciences
Identifiers urn:nbn:se:miun:diva-56544 (URN) 10.1109/ACCESS.2026.3651845 (DOI) 001663386200015 () 2-s2.0-105027998138 (Scopus ID)
2026-02-032026-02-032026-02-23