Level of motion sickness based on heart rate variability when reading inside a fully automated vehicle

Main Article Content

Juffrizal Karjanto
https://orcid.org/0000-0002-9309-7141
Nidzamuddin Md Yusof
https://orcid.org/0000-0002-1438-0150
Jacque Terken
https://orcid.org/0000-0002-6494-3230
Frank Delbressine
https://orcid.org/0000-0002-6567-9355
Matthias Rauterberg
https://orcid.org/0000-0002-2596-395X

Abstract

This study investigates the level of experienced motion sickness when performing reading while being driven in fully automated driving under three different conditions. One condition was without any intervention while the other two conditions were with the visual (VPIS) and haptic (HPIS) peripheral information system. Both systems provided the upcoming navigational information in the lateral direction three seconds before the turning/cornering was done. It was hypothesized that with the peripheral information systems, the experienced motion sickness would be reduced compared to the condition where a peripheral information system was not present. Eighteen participants with severe motion sickness susceptibility were carefully chosen to undergo the conditions using an instrumented vehicle with the Wizard-of-Oz approach. The participants were required to read from a tablet during the whole 15-minutes of automated driving. Results from the heart rate variability (beats per minute, root means square of successive differences, and high-frequency component) indicated no statistically significant changes (p < 0.05) in motion sickness found with the presence of HPIS and VPIS when performing reading when being driven in automated mode. However, results from this study were mixed and inconclusive, but overall findings indicated mild motion sickness was found in both VPIS and HPIS conditions.

Downloads

Download data is not yet available.

Article Details

Section
Articles

References

[1] J. Dokic, B. Müller, and G. Meyer, “European roadmap smart systems for automated driving,” European Technology Platform on Smart Systems Integration, vol. 39, 2015.
[2] M. Oonk and J. Svensson, Automation in Road Transport, no. October. 2012.
[3] C. Diels and J. E. Bos, “Self-driving carsickness,” Applied ergonomics, vol. 53, pp. 374–382, 2016.
[4] C. Diels, “Will autonomous vehicles make us sick,” Contemporary ergonomics and human factors, pp. 301–307, 2014.
[5] M. Turner and M. J. Griffin, “Motion sickness in public road transport: the relative importance of motion, vision and individual differences,” British Journal of Psychology, vol. 90, no. 4, pp. 519–530, 1999.
[6] S. Saruchi et al., “Lateral control strategy based on head movement responses for motion sickness mitigation in autonomous vehicle,” Journal of the Brazilian Society of Mechanical Sciences and Engineering, vol. 42, no. 5, pp. 1–14, 2020.
[7] S. A. Saruchi et al., “applied sciences Novel Motion Sickness Minimization Control via Fuzzy-PID Controller for Autonomous Vehicle,” Applied Sciences (Switzerland), 2020.
[8] C. Diels and J. Bos, “Great expectations: On the design of predictive motion cues to alleviate carsickness,” in International Conference on Human-Computer Interaction, 2021, pp. 240–251.
[9] O. X. Kuiper, J. E. Bos, C. Diels, and E. A. Schmidt, “Knowing what’s coming: Anticipatory audio cues can mitigate motion sickness,” Applied ergonomics, vol. 85, p. 103068, 2020.
[10] A. Löcken et al., “Towards adaptive ambient in-vehicle displays and interactions: Insights and design guidelines from the 2015 AutomotiveUI dedicated workshop,” in Automotive user interfaces, Springer, 2017, pp. 325–348.
[11] J. Mankoff, A. K. Dey, G. Hsieh, J. Kientz, S. Lederer, and M. Ames, “Heuristic evaluation of ambient displays,” in Proceedings of the SIGCHI conference on Human factors in computing systems, 2003, pp. 169–176.
[12] P. S. Cowings, K. H. Naifeh, and W. B. Toscano, “The stability of individual patterns of autonomic responses to motion sickness stimulation.,” Aviation, space, and environmental medicine, 1990.
[13] C. R. Gordon et al., “Seasickness susceptibility, personality factors, and salivation.,” Aviation, space, and environmental medicine, 1994.
[14] L. Alexandros and X. Michalis, “The physiological measurements as a critical indicator in users’ experience evaluation,” in Proceedings of the 17th Panhellenic Conference on Informatics - PCI ’13, 2013, pp. 258–263, doi: 10.1145/2491845.2491883.
[15] C.-T. Lin, C.-L. Lin, T.-W. Chiu, J.-R. Duann, and T.-P. Jung, “Effect of respiratory modulation on relationship between heart rate variability and motion sickness,” in 2011 Annual International Conference of the IEEE engineering in medicine and biology society, 2011, pp. 1921–1924.
[16] P. S. Cowings, S. Suter, W. B. Toscano, J. Kamiya, and K. Naifeh, “General autonomic components of motion sickness,” Psychophysiology, vol. 23, no. 5, pp. 542–551, 1986.
[17] S. Hu, W. F. Grant, R. M. Stern, and K. L. Koch, “Motion sickness severity and physiological correlates during repeated exposures to a rotating optokinetic drum.,” Aviation, space, and environmental medicine, 1991.
[18] L. T. LaCount et al., “Dynamic cardiovagal response to motion sickness: A point-process heart rate variability study,” Computers in Cardiology, vol. 36, pp. 49–52, 2009.
[19] E. R. Muth, “Motion and space sickness: intestinal and autonomic correlates,” Autonomic Neuroscience, vol. 129, no. 1–2, pp. 58–66, 2006.
[20] N. Isu, T. Hasegawa, I. Takeuchi, and A. Morimoto, “Quantitative analysis of time-course development of motion sickness caused by in-vehicle video watching,” Displays, vol. 35, no. 2, pp. 90–97, 2014.
[21] S. Laborde, E. Mosley, and J. F. Thayer, “Heart rate variability and cardiac vagal tone in psychophysiological research - Recommendations for experiment planning, data analysis, and data reporting,” Frontiers in Psychology, vol. 8, no. FEB, pp. 1–18, 2017, doi: 10.3389/fpsyg.2017.00213.
[22] D. S. Quintana and J. A. J. Heathers, “Considerations in the assessment of heart rate variability in biobehavioral research,” Frontiers in psychology, vol. 5, p. 805, 2014.
[23] A. of U. in T. Netherlands, “The Netherlands Code of Conduct for Academic Practice.” Association of Universities in the Netherlands (VSNU) The Hague, 2014.
[24] J. Karjanto, N. M. Yusof, J. Terken, F. Delbressine, M. Rauterberg, and M. Z. Hassan, “Development of On-Road Automated Vehicle Simulator for Motion Sickness Studies,” International Journal of Driving Science, vol. 1, no. 1, pp. 1–12, 2018, doi: 10.5334/ijds.8.
[25] J. Karjanto, N. Md. Yusof, J. Terken, F. Delbressine, M. Z. Hassan, and M. Rauterberg, “Simulating autonomous driving styles: Accelerations for three road profiles,” MATEC Web of Conferences, vol. 90, p. 1005, 2017, doi: 10.1051/matecconf/20179001005.
[26] N. M. Yusof, J. Karjanto, J. Terken, F. Delbressine, M. Z. Hassan, and M. Rauterberg, “The exploration of autonomous vehicle driving styles: Preferred longitudinal, lateral, and vertical accelerations,” AutomotiveUI 2016 - 8th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Proceedings, pp. 245–252, 2016, doi: 10.1145/3003715.3005455.
[27] N. M. Yusof, J. Karjanto, M. Z. Hassan, J. Terken, F. Delbressine, and M. Rauterberg, “Reading During Fully Automated Driving: A Study of the Effect of Peripheral Visual and Haptic Information on Situation Awareness and Mental Workload,” IEEE Transactions on Intelligent Transportation Systems, 2022.
[28] J. F. Golding, “Predicting individual differences in motion sickness susceptibility by questionnaire,” Personality and Individual differences, vol. 41, no. 2, pp. 237–248, 2006.
[29] J. F. Golding, “Motion sickness susceptibility questionnaire revised and its relationship to other forms of sickness,” Brain research bulletin, vol. 47, no. 5, pp. 507–516, 1998.
[30] K. Umetani, D. H. Singer, R. McCraty, and M. Atkinson, “Twenty-four hour time domain heart rate variability and heart rate: relations to age and gender over nine decades,” Journal of the American College of Cardiology, vol. 31, no. 3, pp. 593–601, 1998.
[31] D. S. Quintana, A. J. Guastella, I. S. McGregor, I. B. Hickie, and A. H. Kemp, “Moderate alcohol intake is related to increased heart rate variability in young adults: Implications for health and well‐being,” Psychophysiology, vol. 50, no. 12, pp. 1202–1208, 2013.
[32] A. Molfino, A. Fiorentini, L. Tubani, M. Martuscelli, F. R. Fanelli, and A. Laviano, “Body mass index is related to autonomic nervous system activity as measured by heart rate variability,” European journal of clinical nutrition, vol. 63, no. 10, pp. 1263–1265, 2009.
[33] S. Sowmya, T. Thomas, A. V. Bharathi, and S. Sucharita, “A body shape index and heart rate variability in healthy Indians with low body mass index,” Journal of nutrition and metabolism, vol. 2014, 2014.
[34] F. Shaffer and D. C. Combatalade, “Don’t add or miss a beat: A guide to cleaner heart rate variability recordings,” Biofeedback, vol. 41, no. 3, pp. 121–130, 2013.
[35] R. Digest, “Jokes Section,” https://www.rd.com/jokes/, 2018. .
[36] S. R. Holmes and M. J. Griffin, “Correlation between heart rate and the severity of motion sickness caused by optokinetic stimulation.,” Journal of Psychophysiology, vol. 15, no. 1, p. 35, 2001.
[37] J. F. Thayer and R. D. Lane, “A model of neurovisceral integration in emotion regulation and dysregulation,” Journal of affective disorders, vol. 61, no. 3, pp. 201–216, 2000.
[38] R. E. Kleiger, P. K. Stein, and J. T. Bigger Jr, “Heart rate variability: measurement and clinical utility,” Annals of Noninvasive Electrocardiology, vol. 10, no. 1, pp. 88–101, 2005.
[39] L. K. Hill, A. Siebenbrock, J. J. Sollers, and J. F. Thayer, “Are all measures created equal? Heart rate variability and respiration,” Biomedical Sciences Instrumentation, vol. 45, no. August, pp. 71–76, 2009.
[40] J. Penttilä et al., “Time domain, geometrical and frequency domain analysis of cardiac vagal outflow: effects of various respiratory patterns,” Clinical physiology, vol. 21, no. 3, pp. 365–376, 2001.
[41] N. Himi, T. Koga, E. Nakamura, M. Kobashi, M. Yamane, and K. Tsujioka, “Differences in autonomic responses between subjects with and without nausea while watching an irregularly oscillating video,” Autonomic Neuroscience, vol. 116, no. 1–2, pp. 46–53, 2004.
[42] C. S. Stout, W. B. Toscano, and P. S. Cowings, “Reliability of psychophysiological responses across multiple motion sickness stimulation tests.,” Journal of Vestibular Research : Equilibrium & Orientation, vol. 5, no. 1, pp. 25–33, 1995.
[43] A. J. Camm et al., “Heart rate variability. Standards of measurement, physiological interpretation, and clinical use,” 1996.
[44] M. Malik, “Guidelines Heart rate variability,” European Heart Journal, vol. 17, pp. 354–381, 1996, doi: 10.1161/01.CIR.93.5.1043.
[45] A. Mazloumi Gavgani, D. M. Hodgson, and E. Nalivaiko, “Effects of visual flow direction on signs and symptoms of cybersickness,” PloS one, vol. 12, no. 8, p. e0182790, 2017.
[46] A. Sjörs, J. Dahlman, T. Ledin, B. Gerdle, and T. Falkmer, “Effects of motion sickness on encoding and retrieval performance and on psychophysiological responses,” Journal of Ergonomics., vol. 4, no. 1, 2014.
[47] P. J. Gianaros, E. R. Muth, J. T. Mordkoff, M. E. Levine, and R. M. Stern, “A questionnaire for the assessment of the multiple dimensions of motion sickness,” Aviation Space and Environmental Medicine, vol. 72, no. 2, pp. 115–119, 2001.
[48] J. R. Lackner, “Motion sickness: more than nausea and vomiting,” Experimental brain research, vol. 232, no. 8, pp. 2493–2510, 2014.
[49] M. Foster, “The effects of low-frequency sinusoidal linear acceleration on skin sympathetic nerve activity in humans.” Western Sydney University (Australia), 2017.
[50] S. A. A. Naqvi, N. Badruddin, A. S. Malik, W. Hazabbah, and B. Abdullah, “Does 3D produce more symptoms of visually induced motion sickness?,” in 2013 35th annual international conference of the IEEE engineering in medicine and biology society (EMBC), 2013, pp. 6405–6408.
[51] N. Selvaraj, A. Jaryal, J. Santhosh, K. K. Deepak, and S. Anand, “Assessment of heart rate variability derived from finger-tip photoplethysmography as compared to electrocardiography,” Journal of medical engineering & technology, vol. 32, no. 6, pp. 479–484, 2008.
[52] G. E. Billman, “The LF/HF ratio does not accurately measure cardiac sympatho-vagal balance,” Frontiers in physiology, vol. 4. Frontiers Media SA, p. 26, 2013.
[53] G. G. Berntson, J. T. Cacioppo, and K. S. Quigley, “Autonomic determinism: the modes of autonomic control, the doctrine of autonomic space, and the laws of autonomic constraint.,” Psychological review, vol. 98, no. 4, p. 459, 1991.
[54] H. Zhang, M. Zhu, Y. Zheng, and G. Li, “Toward capturing momentary changes of heart rate variability by a dynamic analysis method,” PLoS One, vol. 10, no. 7, p. e0133148, 2015.

Most read articles by the same author(s)