Hostname: page-component-78c5997874-s2hrs Total loading time: 0 Render date: 2024-11-10T17:05:23.323Z Has data issue: false hasContentIssue false
  • English
  • Français

Augmented reality for maritime navigation data visualisation: a systematic review, issues and perspectives

Published online by Cambridge University Press:  12 May 2021

Francesco Laera ,
Michele Fiorentino ,
Alessandro Evangelista ,
Antonio Boccaccio ,
Vito M. Manghisi ,
Joseph Gabbard ,
Michele Gattullo ,
Antonio E. Uva  and
Mario M. Foglia
Francesco Laera*
Affiliation:
Department of Mechanics, Mathematics and Management, Polytechnic University of Bari, Bari, BA, Italy.
Michele Fiorentino
Affiliation:
Department of Mechanics, Mathematics and Management, Polytechnic University of Bari, Bari, BA, Italy.
Alessandro Evangelista
Affiliation:
Department of Mechanics, Mathematics and Management, Polytechnic University of Bari, Bari, BA, Italy.
Antonio Boccaccio
Affiliation:
Department of Mechanics, Mathematics and Management, Polytechnic University of Bari, Bari, BA, Italy.
Vito M. Manghisi
Affiliation:
Department of Mechanics, Mathematics and Management, Polytechnic University of Bari, Bari, BA, Italy.
Joseph Gabbard
Affiliation:
Grado Department of Industrial and Systems Engineering, Virginia Polytechnic Institute and State University, Blacksburg, VA, USA
Michele Gattullo
Affiliation:
Department of Mechanics, Mathematics and Management, Polytechnic University of Bari, Bari, BA, Italy.
Antonio E. Uva
Affiliation:
Department of Mechanics, Mathematics and Management, Polytechnic University of Bari, Bari, BA, Italy.
Mario M. Foglia
Affiliation:
Department of Mechanics, Mathematics and Management, Polytechnic University of Bari, Bari, BA, Italy.
*
*Corresponding author. E-mail: francesco.laera@poliba.it
Get access Rights & Permissions [Opens in a new window]

Abstract

This study investigates the use of augmented reality technology (AR) in the field of maritime navigation and how researchers and designers have addressed AR data visualisation. The paper presents a systematic review analysing the publication type, the AR device, which information elements are visualised and how, the validation method and technological readiness. Eleven AR maritime solutions identified from scientific papers are studied and discussed in relation to previous navigation tools. It is found that primitive information such as course, compass degrees, boat speed and geographic coordinates continue to be fundamental information to be represented even with AR maritime solutions.

Keywords

augmented realitymaritimedata visualisationhuman-computer interaction
Type
Review Article
Information
The Journal of Navigation , Volume 74 , Issue 5 , September 2021 , pp. 1073 - 1090
Copyright
Copyright © The Author(s), 2021. Published by Cambridge University Press on behalf of The Royal Institute of Navigation

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Bergström, M., Hirdaris, S., Valdez Banda, O. A., Kujala, P., Thomas, G., Choy, K.-L., Nordby, K., Li, Z, Ringsberg, J. W., Lundh, M. and Stefenson, P. (2018). Towards holistic performance-based conceptual design of Arctic cargo ships. In: Kujala, and Lu, (eds.). Marine Design XIII. Vol. 2, London: Taylor & Francis Group, 831–839.Google Scholar
Booth, A., Sutton, A. and Papaioannou, D. (2016). Taking a systematic approach to your literature review. In: Systematic Approaches to a Successful Literature Review, London: SAGE Publications Ltd., 9–35.Google Scholar
C(2014)4995, C. D. (2014). Technology readiness levels (TRL). Available at: https://ec.europa.eu/research/participants/data/ref/h2020/wp/2014_2015/annexes/h2020-wp1415-annex-g-trl_en.pdf.Google Scholar
Cutting, J. E. and Vishton, P. M. (1995) Perceiving layout and knowing distances: The integration, relative potency, and contextual use of different information about depth. In: Epstein, W. and Rogers, S. J. (eds.). Handbook of Perception and Cognition, Perception of Space and Motion, San Diego: Academic Press, 69–117.Google Scholar
Evangelista, A., Ardito, L., Boccaccio, A., Fiorentino, M., Messeni Petruzzelli, A. and Uva, A. E. (2020). Unveiling the technological trends of augmented reality: A patent analysis. Computers in Industry. doi:10.1016/j.compind.2020.103221.CrossRefGoogle Scholar
Frydenberg, S., Nordby, K. and Eikenes, J. O. (2018). Exploring designs of augmented reality systems for ship bridges in Arctic waters. In: RINA, Human Factors 2018, London: Royal Institution of Naval Architects.Google Scholar
Gabbard, J. L., Fitch, G. M. and Kim, H. (2014). Behind the glass: Driver challenges and opportunities for AR automotive applications. Proceedings of the IEEE. doi:10.1109/JPROC.2013.2294642.CrossRefGoogle Scholar
Gattullo, M., Evangelista A., Uva, A. E., Fiorentino, M. and Gabbard, J. (2020). What, how, and why are visual assets used in industrial augmented reality? A systematic review and classification in maintenance, assembly, and training (from 1997 to 2019). IEEE Transactions on Visualization and Computer Graphics. doi:10.1109/tvcg.2020.3014614.CrossRefGoogle Scholar
Grabowski, M. (2015). Research on wearable, immersive augmented reality (WIAR) adoption in maritime navigation. Journal of Navigation. doi:10.1017/S0373463314000873.CrossRefGoogle Scholar
Hong, T. C., Andrew, H. S. Y. and Kenny, C. W. L. (2015). Assessing the Situation Awareness of Operators Using Maritime Augmented Reality System (MARS). Proceedings of the Human Factors and Ergonomics Society. doi:10.1177/1541931215591372.CrossRefGoogle Scholar
Jeon, M., Park, J. and Woo, J. (2019). Development of HHI's advanced navigation assistance system for safe voyage. IFAC-PapersOnLine. doi:10.1016/j.ifacol.2019.12.292.CrossRefGoogle Scholar
Laera, F., Foglia, M. M., Evangelista, A., Boccaccio, A., Gattullo, M., Manghisi, V. M., Gabbard, J., Uva, A. E. and Fiorentino, F. (2020). Towards Sailing Supported by Augmented Reality: Motivation, Methodology and Perspectives. Institute of Electrical and Electronics Engineers (IEEE), pp. 269–274. doi:10.1109/ismar-adjunct51615.2020.00076.Google Scholar
Lee, J. M., Lee, K. O., Nam, B. and Wu, Y. (2016). Study on Image-Based Ship Detection for AR Navigation. 2016 6th International Conference on IT Convergence and Security, ICITCS 2016. doi:10.1109/ICITCS.2016.7740373.CrossRefGoogle Scholar
Miller, G. A. (1956). The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review. doi:10.1037/h0043158.CrossRefGoogle ScholarPubMed
Moulis, G. and De Larminat, V. (2015). How Augmented Reality Can Be Fitted to Satisfy Maritime Domain Needs - The Case of VISIPROT® Demonstrator. ACM International Conference Proceeding Series. doi:10.1145/2806173.2806200.CrossRefGoogle Scholar
Nam, B. W., Lee, K. H. and Lee, J. M. (2017). A Study on Developing Image Processing for Smart Traffic Supporting System Based on AR. World Congress on Civil, Structural, and Environmental Engineering. doi:10.11159/icte17.111.CrossRefGoogle Scholar
Oh, J., Park, S. and Kwon, O.-S. (2016). Advanced navigation aids system based on augmented reality. International Journal of e-Navigation and Maritime Economy. doi:10.1016/j.enavi.2016.12.002.CrossRefGoogle Scholar
Okazaki, T., Takaseki, R., Shoji, R. and Matsubara, K. (2017). Development of Sea Route Display System by Using Augmented Reality. 2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017. doi:10.1109/SMC.2017.8123156.CrossRefGoogle Scholar
Ostendorp, M. C., Lenk, J. C. and Lüdtke, A. (2015). Smart glasses to support maritime pilots in harbor maneuvers. Procedia Manufacturing. doi:10.1016/j.promfg.2015.07.775.CrossRefGoogle Scholar
Rolls-Royce. (2016). Autonomous ship, the next step. Available at: https://www.rolls-royce.com/~/media/Files/R/Rolls-Royce/documents/customers/marine/ship-intel/rr-ship-intel-aawa-8pg.pdf (Accessed: 22 January 2021).Google Scholar
Takenaka, M., Nishizaki, C. and Okazaki, T. (2019). Development of Ship Collision Prevention Device with Augmented Reality Toolkit. Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics. doi:10.1109/SMC.2019.8914333.CrossRefGoogle Scholar