Papers - Minamizawa, Kouta

Boiling Mind-A Dataset of Physiological Signals during an Exploratory Dance Performance

Z Fu, J Han, G Chernyshov, M Sugawa, D Zheng, D Hynds, T Furukawa, ...

Proceedings of the Augmented Humans International Conference 2021, 301-303    301 - 303 2021

　View Summary

The relationship between audience and performers is crucial to what makes live events so special. The aim of this work is to develop a new approach amplifying the link between audiences and performers. Specifically, we explore the use of wearable sensors in gathering real-time audience data to augment the visuals of a live dance performance. We used the J!NS MEME, smart glasses with integrated electrodes enabling eye movement analysis (e.g. blink detection) and inertial motion sensing of the head (e.g. nodding recognition). This data is streamed from the audience and visualised live on stage during a performance, alongside we also collected heart rate and eye gaze of selected audience. In this paper we present the recorded dataset, including accelerometer, electrooculography(EOG), and gyroscope data from 23 audience members.

• Access to Document (DOI)

Remote control system

YS MHD, T Sasaki, R MATSUMURA, K MINAMIZAWA, M Inami

US Patent App. 17/137,116  2021

身体とテクノロジーが融合する時代, 人の心はどう変わる?

南澤孝太

心理学ワールド/日本心理学会 編, 9-12  2021

CONTROL DEVICE, ROBOT CONTROL PROCESS AND ROBOT CONTROL SYSTEM

CL FERNANDO, S Tachi, G Sano, K MINAMIZAWA

 2021

Frisson Waves: Sharing Frisson to Create Collective Empathetic Experiences for Music Performances

Y He, G Chernyshov, D Zheng, J Han, R Thomsen, D Hynds, Y Yang, ...

SIGGRAPH Asia 2021 Emerging Technologies, 1-2  2021

Frisson Waves: Sharing Frisson to Create Collective Empathetic Experiences for Music Performances

He, Y; Chernyshov, G; Zheng, DD; Han, JW; Thomsen, R; Hynds, D; Yang, YH; Pai, YS; Kunze, K; Minamizawa, K

PROCEEDINGS OF SIGGRAPH ASIA 2021 EMERGING TECHNOLOGIES  2021

• Access to Document (DOI)

SIGGRAPH Asia 2021 Emerging Technologies

SJ Shiota, A Kimura, K Minamizawa

ACM  2021

超人スポーツ・グランドチャレンジ 2020

持丸正明， 村井昭彦， 田中孝之， 栗田雄一， 南澤孝太， 稲見昌彦

Journal of the Society of Biomechanisms (Society of Biomechanisms)  45 ( 2 ) 80 - 83 2021

ISSN  02850885

　View Summary

超人スポーツとは，人間の身体能力を補綴・拡張する人間拡張工学に基づき，人の身体能力を超える力を身につけ「人を超える」，あるいは年齢や障碍などの身体差により生じる「人と人のバリアを超える」ことによって生み出される新しいスポーツ競技である．拡張された超人同士がテクノロジーを自在に乗りこなし，競い合う「人機一体」の新たなスポーツを創造することを目指している．さらなる「人機一体」の技術の開発に向け，競技者同士が同一の技術（道具）を用い，その使いこなし方や身体能力，戦略で競い合う超人スポーツ競技ではなく，最先端の人間拡張工学と身体能力を競技者同士が自在に開発，適用して，独自技術と身体能力で競い合い，記録に挑戦するかたちの競技を新たに創り出すという目的で，3 つのグランドチャレンジを設定し，2020 年度の第 1 回グランドチャレンジを実施した．

• Access to Document (DOI)
• CiNii Research

KABUTO: Inducing Upper-Body Movements using a Head Mounted Haptic Display with Flywheels

T Tanichi, F Asada, K Matsuda, D Hynds, K Minamizawa

SIGGRAPH Asia 2020 Emerging Technologies, 1-2 (SIGGRAPH Asia 2020 Emerging Technologies, SA 2020)   2020.12

ISSN  9781450381109

　View Summary

As an alternative to enhance user's experience in VR contents, we propose KABUTO, a head mounted haptic display designed to induce upper-body movement by the application of kinesthetic feedback to the head. KABUTO can provide impact and resistance by using flywheels and brakes in response to various head movements, as extensive head movements lead to dynamic movement throughout the upper body. We have also designed an application which enables the user to become a rhinoceros beetle.The user can feel the weight of the swinging horn or the impact of the horn flinging object. In the demonstration of it, we observed that KABUTO makes users move their upper body aggressively.

• Access to Document (DOI)

Visuomotor Influence of Attached Robotic Neck Augmentation

L Shen, MHDY Saraiji, K Kunze, K Minamizawa, RL Peiris

Symposium on Spatial User Interaction, 1-10 (Proceedings - SUI 2020: ACM Symposium on Spatial User Interaction)   2020.10

ISSN  9781450379434

　View Summary

The combination of eye and head movements plays a major part in our visual process. The neck provides mobility for the head motion and also limits the range of visual motion in space. In this paper, a robotic neck augmentation system is designed to surmount the physical limitations of the neck. It applies in essential a visuomotor modification to the vision-neck relationship. We conducted two experiments to measure and verify the performance of the neck alternation. The multiple test results indicate the system has a positive effect to augment the motions of vision. Specifically, the robotic neck can enlarge the range of neck motion to 200%, and influence the response motion, by overall 22% less in time and 28% faster in speed.

• Access to Document (DOI)

Bubble Visualization Overlay in Online Communication for Increased Speed Awareness and Better Turn Taking

R Horii, Y Chandra, K Kunze, K Minamizawa

Adjunct Publication of the 33rd Annual ACM Symposium on User Interface … (UIST 2020 - Adjunct Publication of the 33rd Annual ACM Symposium on User Interface Software and Technology)     59 - 61 2020.10

ISSN  9781450375153

　View Summary

In this paper, we explore the use of a real-time speech visualization overlay to help native English speakers (NES) reflect on their speech speed and allow them to understand how English as a Foreign Language speakers (EFLS) perceive their speech. Our visual system generates a sequence of bubbles based on the speaking speed overlaid close to the user's mouth; the faster the speaking speed, the denser the bubble sequence, and vice versa. The results suggest that the presence of the speech visualization helps NES to understand their speech speed, and subsequently, it helps EFLS to feel comfortable speaking during the online group discussion.

• Access to Document (DOI)

Bubble Visualization Overlay in Online Communication for Increased Speed Awareness and Better Turn Taking

R Horii, Y Chandra, K Kunze, K Minamizawa

Adjunct Publication of the 33rd Annual ACM Symposium on User Interface … (UIST 2020 - Adjunct Publication of the 33rd Annual ACM Symposium on User Interface Software and Technology)     59 - 61 2020.10

ISSN  9781450375153

　View Summary

In this paper, we explore the use of a real-time speech visualization overlay to help native English speakers (NES) reflect on their speech speed and allow them to understand how English as a Foreign Language speakers (EFLS) perceive their speech. Our visual system generates a sequence of bubbles based on the speaking speed overlaid close to the user's mouth; the faster the speaking speed, the denser the bubble sequence, and vice versa. The results suggest that the presence of the speech visualization helps NES to understand their speech speed, and subsequently, it helps EFLS to feel comfortable speaking during the online group discussion.

• Access to Document (DOI)

SlideFusion: Surrogacy Wheelchair with Implicit Eyegaze Modality Sharing

R Ando, K Minamizawa, MHDY Saraiji

ACM SIGGRAPH 2020 Emerging Technologies, 1-2 (ACM SIGGRAPH 2020 Emerging Technologies, SIGGRAPH 2020)   2020.08

ISSN  9781450379670

　View Summary

For mobility-impaired people, the wheelchair is considered as a main navigation and accessibility device. However, due to the inherited design of the chair, the user is restricted to utilize his hand all the time during navigation resulting in a dual impairment. Our proposed system, SlideFusion, expands on previous work of collaborative and assistive technologies for accessibility scenarios. SlideFusion is focused on the remote collaboration of the mobility impaired person, that an operator can remotely access an avatar embedded into the wheelchair. To reduce the physical and cognitive overload on the wheelchair user, we propose the use of eye gaze modality sharing with the remote operator. The eye gaze modality enables implicit interactions that do not require the user to point or verbally say, thus leveraging indirect communication. By using this, not only accessibility can be provided to wheelchair users and their caregivers, but also hearing impairments and pronunciation disorders are applicable.

• Access to Document (DOI)

Sophroneo: Fear not. A VR Horror Game with Thermal Feedback and Physiological Signal Loop.

Ragozin K., Chernyshov G., Zheng D., Hynds D., Zhao J., Minamizawa K., Kunze K.

ACM SIGGRAPH 2020 Immersive Pavilion, SIGGRAPH 2020 (ACM SIGGRAPH 2020 Immersive Pavilion, SIGGRAPH 2020)   2020.08

ISSN  9781450379687

　View Summary

We present "Sophroneo: Fear not", a VR horror experience with thermal feedback interface. To emphasize the supernatural side of the experience we introduce several innovative approaches, such as long intense cold feedback, liminal audio and physiological feedback loops. We built a wearable thermal feedback setup with water-cooled Peltier TEC elements for long cold sensations to improve the immersion and to increase the sense of fear and unease. At several points of the experience the player will have to close their eyes and interact with the VR environment depending on their other senses alone.

• Access to Document (DOI)

SlideFusion: Surrogacy Wheelchair with Implicit Eyegaze Modality Sharing

R Ando, K Minamizawa, MHDY Saraiji

ACM SIGGRAPH 2020 Emerging Technologies, 1-2 (ACM SIGGRAPH 2020 Emerging Technologies, SIGGRAPH 2020)   2020.08

ISSN  9781450379670

　View Summary

For mobility-impaired people, the wheelchair is considered as a main navigation and accessibility device. However, due to the inherited design of the chair, the user is restricted to utilize his hand all the time during navigation resulting in a dual impairment. Our proposed system, SlideFusion, expands on previous work of collaborative and assistive technologies for accessibility scenarios. SlideFusion is focused on the remote collaboration of the mobility impaired person, that an operator can remotely access an avatar embedded into the wheelchair. To reduce the physical and cognitive overload on the wheelchair user, we propose the use of eye gaze modality sharing with the remote operator. The eye gaze modality enables implicit interactions that do not require the user to point or verbally say, thus leveraging indirect communication. By using this, not only accessibility can be provided to wheelchair users and their caregivers, but also hearing impairments and pronunciation disorders are applicable.

• Access to Document (DOI)

Sophroneo: Fear not. A VR Horror Game with Thermal Feedback and Physiological Signal Loop.

Ragozin K., Chernyshov G., Zheng D., Hynds D., Zhao J., Minamizawa K., Kunze K.

ACM SIGGRAPH 2020 Immersive Pavilion, SIGGRAPH 2020 (ACM SIGGRAPH 2020 Immersive Pavilion, SIGGRAPH 2020)   2020.08

ISSN  9781450379687

　View Summary

We present "Sophroneo: Fear not", a VR horror experience with thermal feedback interface. To emphasize the supernatural side of the experience we introduce several innovative approaches, such as long intense cold feedback, liminal audio and physiological feedback loops. We built a wearable thermal feedback setup with water-cooled Peltier TEC elements for long cold sensations to improve the immersion and to increase the sense of fear and unease. At several points of the experience the player will have to close their eyes and interact with the VR environment depending on their other senses alone.

• Access to Document (DOI)

Operation Identification by Shared Tactile Perception Based on Skin Vibration

T Katagiri, Y Tanaka, S Sugiura, K Minamizawa, J Watanabe, ...

2020 29th IEEE International Conference on Robot and Human Interactive … (29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020)     885 - 890 2020.08

ISSN  9781728160757

　View Summary

Tactile sensation contributes to sensory-motor control and facilitates skillful manipulation of objects. If the tactile sensation can be shared between two partners, the state of each partner can be partially observed by the other, and the possibilities for cooperative work may be expanded. Recently, examples of utilizing tactile sensation in human-robot cooperative work have been proposed. For cooperative work between people, it is necessary to investigate the basic ability of humans to identify other person's motions and operations by tactile presentation. To avoid hindering work performed with the hands and fingertips, the sensation must be presented elsewhere. This study investigates the possibility of identifying other person's tool operations by presenting tactile information induced on his/her finger with a wearable vibrator on the arm. A wearable skin vibration sensor was employed to acquire tactile information during an experiment in which five different tool operations were tested. This sensor measures skin vibration while directly touching the target. We proposed a non-linear signal processing function to adjust the intensity of the skin vibration to within the range of human sensitivity for tactile presentation. We compared vibrotactile stimulation between the non-linear and linear corrections, and then conducted experiments on identifying operations. The results showed that the non-linear correction increased small signals and enhanced the variance of large signals, and that operations were significantly identified by tactile presentation to the arm.

• Access to Document (DOI)

Operation Identification by Shared Tactile Perception Based on Skin Vibration

T Katagiri, Y Tanaka, S Sugiura, K Minamizawa, J Watanabe, ...

2020 29th IEEE International Conference on Robot and Human Interactive … (29th IEEE International Conference on Robot and Human Interactive Communication, RO-MAN 2020)     885 - 890 2020.08

ISSN  9781728160757

　View Summary

Tactile sensation contributes to sensory-motor control and facilitates skillful manipulation of objects. If the tactile sensation can be shared between two partners, the state of each partner can be partially observed by the other, and the possibilities for cooperative work may be expanded. Recently, examples of utilizing tactile sensation in human-robot cooperative work have been proposed. For cooperative work between people, it is necessary to investigate the basic ability of humans to identify other person's motions and operations by tactile presentation. To avoid hindering work performed with the hands and fingertips, the sensation must be presented elsewhere. This study investigates the possibility of identifying other person's tool operations by presenting tactile information induced on his/her finger with a wearable vibrator on the arm. A wearable skin vibration sensor was employed to acquire tactile information during an experiment in which five different tool operations were tested. This sensor measures skin vibration while directly touching the target. We proposed a non-linear signal processing function to adjust the intensity of the skin vibration to within the range of human sensitivity for tactile presentation. We compared vibrotactile stimulation between the non-linear and linear corrections, and then conducted experiments on identifying operations. The results showed that the non-linear correction increased small signals and enhanced the variance of large signals, and that operations were significantly identified by tactile presentation to the arm.

• Access to Document (DOI)

Discovering Narratives: Multi-sensory Approach Towards Designing with People with Dementia

E Czech, M Shibasaki, K Tsuchiya, RL Peiris, K Minamizawa

Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing … (Conference on Human Factors in Computing Systems - Proceedings)   2020.04

ISSN  9781450368193

　View Summary

Building off of previous Human-Computer Interaction research on reminiscent and art therapy, this case study examines using a multi-modal album to help older residents with dementia engage with others while sharing portions of their life story. The narratives contained within the album were designed in cooperation with assisted care home residents with dementia. However, due to the progression of their dementia, adaptions to standard interviewing processes for gathering the narratives were needed. Through the use of multi-sensory stimulates (visual and somatic), over time, we were able to understand our participants' narratives as well as their personhood. Furthermore, the adaptions led to questioning the importance of narrative accuracy and the ultimate purpose of building the albums. The next phase is to evaluate the long-term effects of the creation process and the albums themselves.

• Access to Document (DOI)

Discovering Narratives: Multi-sensory Approach Towards Designing with People with Dementia

E Czech, M Shibasaki, K Tsuchiya, RL Peiris, K Minamizawa

Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing … (Conference on Human Factors in Computing Systems - Proceedings)   2020.04

ISSN  9781450368193

　View Summary

Building off of previous Human-Computer Interaction research on reminiscent and art therapy, this case study examines using a multi-modal album to help older residents with dementia engage with others while sharing portions of their life story. The narratives contained within the album were designed in cooperation with assisted care home residents with dementia. However, due to the progression of their dementia, adaptions to standard interviewing processes for gathering the narratives were needed. Through the use of multi-sensory stimulates (visual and somatic), over time, we were able to understand our participants' narratives as well as their personhood. Furthermore, the adaptions led to questioning the importance of narrative accuracy and the ultimate purpose of building the albums. The next phase is to evaluate the long-term effects of the creation process and the albums themselves.

• Access to Document (DOI)