Mid Sweden University

miun.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Investigation of human interaction with an augmented remote operating system for scaling in mining applications
Mid Sweden University, Faculty of Science, Technology and Media, Department of Computer and Electrical Engineering (2023-). RISE Research Institutes of Sweden AB, Stockholm/Gothenburg, Sweden. (Realistic3D)ORCID iD: 0000-0002-5913-3145
Mid Sweden University, Faculty of Science, Technology and Media, Department of Computer and Electrical Engineering (2023-). RISE Research Institutes of Sweden AB, Stockholm/Gothenburg, Sweden.ORCID iD: 0000-0001-5060-9402
RISE Research Institutes of Sweden AB, Stockholm/Gothenburg, Sweden.ORCID iD: 0000-0002-6307-1960
Mid Sweden University, Faculty of Science, Technology and Media, Department of Computer and Electrical Engineering (2023-).
2024 (English)In: Quality and User Experience, ISSN 2366-0139, E-ISSN 2366-0147, Vol. 9, no 4Article in journal (Refereed) Published
Abstract [en]

Thanks to the advent of telepresence applications, we can remotely take control and operate industrial machinery. Teleoperation removes operators from hazardous workplaces such asmining and plays an essential role in the safety of workers. In addition, augmented telepresence can introduce information that helps the user understand the remote scene. However, remote operation has challenges when the received information is more limited than what could be perceived on-site–e.g., judging depth. This study investigates how well operators interact with an Augmented Remote Operation Scaling System (AROSS) in a mining context when different computer-generated visual interfaces are provided. The system can achieve five augmented views: Disocclusion Augmentation using selective content removal; Novel Perspective view generation; Lidar view; Right field of view; and Left field of view. We performed two experiments in a mine-like laboratory. The first experiment was a feasibility test to obtain an understanding of what users need to accurately perceive depth. The second experiment was designed to evaluate the user’s experience with the different versions of AROSS. To analyze human interaction with the designed prototype, we employed a mixed research methodology that used interviews, observations, and questionnaires. This mixed methodology consisted of quality of experience methods to discover the users’requirements from a technological standpoint and user experience methods (i.e., user-centricapproaches). We investigated 10 and 11 users’ interactions in the two subjective experiments. The first experiment focused on the effects of in-view augmentations and interface distributions on perceiving wall patterns. The second focused on the effects of augmentations on the depth and understanding the 3D environment. Using these data, we analyzed both thequality of experience and user experience via evaluation criteria consisting of interface helpfulness, task performance, potential improvement, and user satisfaction. The feasibility test results were mainly used to structure the formative investigation. The overall conclusion from the formative testing shows that the remote operators preferred using natural views (Original) as this approach made it easier to understand the environment. Although the augmented computer-generated views do not look natural, they support 3D cues. In addition, the combination of Novel Perspective and Lidar interfaces as additional views in depth perception tasks seemed helpful. There was difficulty performing tasks when the robot arm was obscured during the Disocclusion Augmentation view and low video quality during the Novel Perspective view. However, participants found the Novel Perspective view useful for geometry and depth estimation.

Place, publisher, year, edition, pages
Springer, 2024. Vol. 9, no 4
Keywords [en]
User Experience (UX), Quality of Experience (QoE), Augmented Telepresence (AT), Intelligent Mining, Industrial remote controlling, UX and QoE, Mixed methodology
National Category
Engineering and Technology Computer and Information Sciences
Identifiers
URN: urn:nbn:se:miun:diva-50092DOI: 10.1007/s41233-024-00068-9OAI: oai:DiVA.org:miun-50092DiVA, id: diva2:1818772
Funder
Swedish Foundation for Strategic ResearchAvailable from: 2023-12-12 Created: 2023-12-12 Last updated: 2024-09-26Bibliographically approved

Open Access in DiVA

fulltext(2846 kB)25 downloads
File information
File name FULLTEXT01.pdfFile size 2846 kBChecksum SHA-512
797506af97d581dc1f40e4a0b22fb724d63931fb5c2809fc8d26a4ef39970933edb6ea1c6fc7523dc550db75dcbfea1420233857d832044a9c546724277c2460
Type fulltextMimetype application/pdf

Other links

Publisher's full text

Authority records

Rafiei, ShirinBrunnström, KjellSjöström, Mårten

Search in DiVA

By author/editor
Rafiei, ShirinBrunnström, KjellAndersson, JonasSjöström, Mårten
By organisation
Department of Computer and Electrical Engineering (2023-)
In the same journal
Quality and User Experience
Engineering and TechnologyComputer and Information Sciences

Search outside of DiVA

GoogleGoogle Scholar
Total: 25 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 101 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf