Hostname: page-component-78c5997874-8bhkd Total loading time: 0 Render date: 2024-11-10T12:56:59.283Z Has data issue: false hasContentIssue false
  • English
  • Français

Maritime navigational assistance by visual augmentation

Published online by Cambridge University Press:  29 October 2021

Bruno G. Leite ,
Helio T. Sinohara ,
Newton Maruyama  and
Eduardo A. Tannuri
Bruno G. Leite*
Affiliation:
Escola Politécnica, Universidade de São Paulo
Helio T. Sinohara
Affiliation:
Escola Politécnica, Universidade de São Paulo
Newton Maruyama
Affiliation:
Escola Politécnica, Universidade de São Paulo
Eduardo A. Tannuri
Affiliation:
Escola Politécnica, Universidade de São Paulo
*
*Corresponding author. E-mail: bruno.giordano.leite@usp.br
Get access Rights & Permissions [Opens in a new window]

Abstract

Several types of equipment have been developed over the years to assist ship operators with their tasks. Nowadays, navigational equipment typically provides an enormous volume of information. Thus, there is a corresponding need for efficiency in how such information is presented to ship operators. Augmented reality (AR) systems are being investigated for such efficient presentation of typical navigational information. The present work is particularly interested in an AR architecture commonly referred as monitor augmented reality (MAR).

In this context, the development of MAR systems is briefly summarised. The projection of three-dimensional elements into a camera scene is presented. Potential visual assets are proposed and exemplified with videos from a ship manoeuvring simulator and a real experiment. Enhanced scenes combining pertinent virtual elements are shown exemplifying potential assistance applications. The authors mean to contribute to the popularisation of MAR systems in maritime environments. Further research is suggested to define optimal combinations of visual elements for alternative maritime navigation scenarios. Note that there are still many challenges for the deployment of MAR tools in typical maritime operations.

Keywords

e-navigationnumerical simulationdisplaygraphic user interface (GUI)
Type
Research Article
Information
The Journal of Navigation , Volume 75 , Issue 1 , January 2022 , pp. 57 - 75
Check for updates
Copyright
Copyright © The Author(s), 2021. Published by Cambridge University Press on behalf of The Royal Institute of Navigation

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Azuma, R. T. (1997). A survey of augmented reality. Presence: Teleoperators & Virtual Environments, 6(4), 355–385.CrossRefGoogle Scholar
Bradski, G. (2000). The OpenCV library. Dr Dobb's J. Software Tools, 25, 120–125.Google Scholar
Hareide, O. and Ostnes, R. (2017). Maritime usability study by analysing eye tracking data. Journal of Navigation, 70(5), 927–943. doi:10.1017/S0373463317000182CrossRefGoogle Scholar
Hartley, R. and Zisserman, A. (2004). Multiple View Geometry in Computer Vision. 2nd ed. Cambridge: Cambridge University Press.CrossRefGoogle Scholar
Holder, E. and Pecota, S. (2011). Maritime head-up display: a preliminary evaluation. Journal of Navigation, 64(4), 573–594. doi:10.1017/S0373463311000191CrossRefGoogle Scholar
Hong, T. C., Andrew, H. S. Y. and Kenny, C. W. L. (2015). Assessing the situation awareness of operators using maritime augmented reality system (MARS). Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 59(1), 1722–1726. doi:10.1177/1541931215591372CrossRefGoogle Scholar
Kopacz, Z., Morgaś, W. and Urbański, J. (2001). The maritime safety system, its main components and elements. Journal of Navigation, 54(2), 199–211. doi:10.1017/S0373463301001205CrossRefGoogle Scholar
Kopacz, Z., Morgaś, W. and Urbański, J. (2004). The changes in maritime navigation and the competences of navigators. Journal of Navigation, 57(1), 73–83. doi:10.1017/S0373463303002522CrossRefGoogle Scholar
Laera, F., Fiorentino, M., Evangelista, A., Boccaccio, A., Manghisi, V., Gabbard, J. and Foglia, M. (2021). Augmented reality for maritime navigation data visualisation: a systematic review, issues and perspectives. Journal of Navigation, 74(5), 1073–1090. doi:10.1017/S0373463321000412CrossRefGoogle Scholar
Maglić, L. and Zec, D. (2020). The impact of bridge alerts on navigating officers. Journal of Navigation, 73(2), 421–432. doi:10.1017/S0373463319000687CrossRefGoogle Scholar
Mahmoudi, A., Sabzehparvar, M. and Mortazavi, M. (2021). A virtual environment for evaluation of computer vision algorithms under general airborne camera imperfections. Journal of Navigation, 74(4), 801–821. doi:10.1017/S0373463321000060CrossRefGoogle Scholar
Makiyama, H. S., Szilagyi, E., Pereira, G. H., Alves, L. R. R., Kodama, B. M., Taniguchi, D. and Tannuri, E. A. (2020). Computational Graphics and Immersive Technologies Applied to a Ship Maneuvering Simulator. 19th International Conference on Geometry and Graphics - ICGG, Sao Paulo, Brazil, 2020, 2021, 626–635.Google Scholar
Mihoc, A. and Cater, K. (2017). Augmenting Navigational Aids: The Development of an Assistive Maritime Navigation Application. In World Academy of Science, Engineering and Technology, International Science Index, Computer and Information Engineering. 1st ed., Vol. 3, pp. 2432. ICVAR 2017 : 19th International Conference on Virtual and Augmented Reality, Singapore, Singapore, 8/01/17. https://doi.org/10.1999/1307-6892/10007671. https://research-information.bris.ac.uk/en/publications/augmenting-navigationalaids-the-development-of-an-assistive-mariGoogle Scholar
Milgram, P., Takemura, H., Utsumi, A., Kishino, F. (1995). Augmented Reality: A Class of Displays on the Reality-Virtuality Continuum. In Proc. SPIE 2351, Telemanipulator and Telepresence Technologies, Boston, MA, United States, pp. 282–292. doi: 10.1117/12.197321.CrossRefGoogle Scholar
Morgère, J., Diguet, J. and Laurent, J. (2014). Electronic Navigational Chart Generator for a Marine Mobile Augmented Reality System. 2014 Oceans - St. John's, 2014, 1–9. Available at https://doi.org/10.1109/OCEANS.2014.7003021.CrossRefGoogle Scholar
Oh, J., Park, S. and Kwon, O.-S. (2016). Advanced navigation aids system based on augmented reality. International Journal of e-Navigation and Maritime Economy, 5, 21–31.CrossRefGoogle Scholar
Sanchez-Gonzalez, P. L., Díaz-Gutiérrez, D., Leo, T. J. and Núñez-Rivas, L. R. (2019). Toward digitalization of maritime transport? Sensors, 19(4), 926. doi:10.3390/s19040926CrossRefGoogle ScholarPubMed
Sutherland, I. E. (1968). A Head-Mounted Three-Dimensional Display. In Proceedings of the December 9–11, 1968, Fall Joint Computer Conference, Part I, San Francisco, CA, United States, 1968, 757–764.CrossRefGoogle Scholar
Tannuri, E. A., Rateiro, F., Fucatu, C. H., Ferreira, M. D., Masetti, I. Q. and Nishimoto, K. (2014). Modular Mathematical Model for a Low-Speed Maneuvering Simulator. Proceedings of the ASME 2014 33rd International Conference on Ocean, Offshore and Arctic Engineering. Volume 1B: Offshore Technology. San Francisco, California, USA, 2014. V01BT01A036. ASME. https://doi.org/10.1115/OMAE2014-24414.CrossRefGoogle Scholar
Zhang, Z. (2000). A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(11), 1330–1334.CrossRefGoogle Scholar