論文 - 藤代　一成

Synthesis of Enthusiastic Collective Audience NPCs in VR Live Concerts

Ishinuki T., Fujishiro I.

Proceedings 2024 International Conference on Cyberworlds Cw 2024 （IEEE CPS）     33 - 40 2024年10月

研究論文（国際会議プロシーディングス）, 最終著者, 責任著者, 査読有り,  ISSN  2642-3596

　概要を見る

Virtual reality (VR) live concerts have recently attracted much attention because of their various possibilities for future music entertainment in cyberworlds. However, it has been reported that current VR live experiences do not reach the levels of enthusiasm observed at actual live concerts, and achieving a sense of enthusiasm in VR live concerts is a challenge to offer enough engagement. According to studies in the field of social psychology, psychological interactions with the surrounding audience are crucial to generating a sense of enthusiasm at actual live events. In response, this paper proposes a method for synthesizing enthusiastic collective non-player characters (NPCs) for VR live concerts. The proposed method computes the psychological interactions among the audience members, including the viewer, according to two psychological parameters. The synthesized audience NPCs are affected by both the music and their psychological interactions according to the surrounding audience, including the viewer, and they exhibit the features of an enthusiastic collective crowd. As such, an empirical study was conducted to explore the psychological influence of the proposed audience NPCs on VR live experiences. The results indicate that the proposed method could give the impression of an enthusiastic crowd at VR live experiences. In addition, it was suggested that social sensations between the audience NPCs and the viewer should be enhanced to increase the level of enthusiasm portrayed during VR live experiences. What was further suggested is the need for a certain degree of individual difference and diversity in appearance and motions for a natural collective audience.

• Access to Document (DOI)

STMA: A fast visual field defect assessment method using quadtree and head mounted display

Chao Ge, Zhenyang Zhu, Kenji Kashiwagi, Masahiro Toyoura, Kentaro Go, Issei Fujishiro, Xiaoyang Mao

Proceedings of NICOGRAPH International 2024 （SAS）  2024年06月

研究論文（国際会議プロシーディングス）, 査読有り

　概要を見る

Individuals with eye diseases that cause optic nerve damage, such as glaucoma, suffer from visual field defects (VFDs), rendering the assessment of VFDs an essential step in medical treatment. In existing studies, various methods have been proposed for VFD area inspections. However, these methods present several problems, including long inspection times and the need to maintain a posture for extended periods, potentially placing significant physical and psychological burdens on patients and affecting the accuracy of the inspection result. Moreover, loose eye fixation constraints also decrease the reliability of the result. In response, we herein propose a novel approach for a fast VFD test, facilitated by the quadtree algorithm. To overcome the physical burden caused by posture constraints related to the testing area requirements and location of the stimulus, the proposed VFD test is implemented on a head-mounted display with a built-in eye tracker. To improve the accuracy of the inspection result further, variously sized noise fields were adopted as the stimuli shown to the examinees. In addition, to validate the performance of the proposed method, a mock experiment was conducted in this study, which involved volunteers with normal vision. The experimental results indicate that the proposed method demonstrates a competitive advantage in perimetric time compared to current state-of-the-art methods, and it exhibits advantages in terms of both accuracy and user comfort.

• Access to Document (DOI)

Frame-break: Enhancing stereoscopic effect of an anamorphosis based naked-eye 3D imaging system

Keita Tokunaga, Issei Fujishiro

Proceedings of The 8th IIEEJ International Conference on Image Electronics and Visual Computing (IEVC 2024) （IIEEJ）  2024年03月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 責任著者, 査読有り

VigNet: Semiautomatic generation of vignette illustrations from video

Mayu Namai, Issei Fujishiro

Proceedings of The 8th IIEEJ International Conference on Image Electronics and Visual Computing (IEVC 2024) （IIEEJ）  2024年03月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 責任著者, 査読有り

HomeShelf: Cultivating Individual Relationships with Digital Contents

Tanaka S., Fujishiro I.

Proceedings 2023 28th Asia Pacific Conference on Communications Apcc 2023 （IEEE）     369 - 374 2023年11月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 査読有り

　概要を見る

The digitization of material objects is rapidly advancing, progressively offering people an unprecedented level of convenience and accessibility. However, studies have shown that people feel a lesser attachment to digital contents than to material objects. In this paper, we focus on shelves, thought to be hubs for cultivating individual relationships with material objects in daily life. We thus propose HomeShelf, an application that accelerates interactions with digital contents and fosters deeper attachments to them. Further, we discuss the features to be added using new technologies and the impact on digitized material objects.

• Access to Document (DOI)

Topological Analysis and Approximate Identification of Leading Lines in Artworks Based on Discrete Morse Theory

Shibasaki F., Fujishiro I.

Proceedings 2023 IEEE Visualization Conference Short Papers Vis 2023 （IEEE Computer Society）     6 - 10 2023年10月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 責任著者, 査読有り

　概要を見る

Accomplished artists often incorporate leading lines into their compositions to guide the observer's attention. Although saliency maps are typically employed to locate attractive regions in still images, such scalar features do not express the trajectory of an observer's gaze. In this study, we propose a method for the visual analysis and approximate identification of leading lines based on maximum graphs, sparse subsets of Morse-Smale complexes, extracted from saliency maps. We provide empirical evidence substantiating the feasibility of our method through a comparison with actual observers' eye tracking results. Further, we investigate the limitations of our approach by employing it to analyze a variety of artworks with diverse styles.

• Access to Document (DOI)

Metamorphopsia Insepction System Based on Relevance Feedback

Zhu Z., Moritake K., Kashiwagi K., Toyoura M., Go K., Fujishiro I., Mao X.

Conference Proceedings IEEE International Conference on Systems Man and Cybernetics （IEEE）     4667 - 4674 2023年10月

研究論文（国際会議プロシーディングス）, 共著, 査読有り,  ISSN  1062922X

　概要を見る

People with metamorphopsia suffer from perceiving things in a distorted way. Various methods for examining metamorphopsia have been suggested in the current literature, with the most advanced techniques demonstrating the ability to yield quantitative measurements. However, these cutting-edge methods necessitate extended examination durations and impose challenging manipulations on patients. In this study, our objective is to enhance the time efficiency of the inspection process and alleviate the burden placed on the user. We propose a novel user-friendly quantitative inspection system which utilizes interactive reinforcement learning. Instead of having users directly operate the system, we ask them to evaluate the stimuli generated by the system. Based on their evaluations, the system gradually refines the deformation map representing the distortion perceived by the user. The reinforcement learning scheme is implemented using relevance feedback approach based on optimum-path forest classifier. To evaluate the effectiveness of the proposed system, subjective evaluation experiments involving simulated and real metamorphopsia participants were conducted in this study. The experimental findings reveal that, when compared to the state-of-the-art method, our proposed system yields comparable inspection out-comes while significantly reducing both the inspection duration and the mental workload.

• Access to Document (DOI)

Virtual Manipulation of Cultural Assets: An Initial Case Study with Single-Joint Articulated Models

Shinji S., Fujishiro I.

Proceedings SIGGRAPH 2023 Posters （ACM）     26:1 - 26:2 2023年08月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 査読有り

　概要を見る

Virtual space can eliminate the physical constraints of real space. Three-dimensional (3D) digital twins enable us to experience manipulation of cultural assets that are inaccessible in real space. However, most 3D models obtained using current reconstruction techniques are static; they cannot be manipulated dynamically. In this study, we reproduce a dynamic 3D model of a simple articulated object with a rotating joint from a static point cloud only with reference to a video of the motion and a manually added rotation axis. The reconstructed actual cultural asset is used for first-person experiences in an augmented reality environment.

• Access to Document (DOI)

Clustering, Universalities, and Evolutionary Schema Design

Fujishiro I., Sawada N., Uemura M.

Ceur Workshop Proceedings 3379 2023年03月

共著, 筆頭著者, 責任著者, 査読有り,  ISSN  1613-0073

　概要を見る

Exploring data features using visual clustering is a significant challenge of big data analytics. In this vision paper, we focus primarily on the relationship among visual data clustering, the discovery of universalities, and the design of an evolutionary database to propose an inter-disciplinary method for scientific data management. The feasibility of the proposed method is empirically proven through application to a practical visual analytics environment for time-varying multi-dimensional datasets of blazar observations.

CC-Glasses: Color Communication Support for People with Color Vision Deficiency Using Augmented Reality and Deep Learning

Zhu Z., Li J., Tang Y., Go K., Toyoura M., Kashiwagi K., Fujishiro I., Mao X.

ACM International Conference Proceeding Series （ACM）     190 - 199 2023年03月

研究論文（国際会議プロシーディングス）, 共著, 査読有り

　概要を見る

People who suffer from color vision deficiency (CVD) can face difficulties when communicating with others by failing to identify target objects referred by their color names. While most existing studies on CVD compensation have focused on the issue of color contrast loss. Although there are approaches can provide clues of color name to users, these techniques either require training, or cannot protect users' privacy, i.e., the fact of having CVD. In this paper, based on augmented reality (AR) and deep learning technologies, we propose a novel system to provide supporting information to users affected by CVD for color communication assistance. The state-of-the-art deep neural network (DNN) model for referring segmentation (RS) is adopted to generate supporting information, and AR glasses are utilized for information presentation. To improve the performance of the proposed system further, a new dataset is constructed based on a novel concept called Color-Object Noun Pair. The results of evaluation experiments show that the new dataset can enhance the performance of the adopted DNN model, and the proposed system can help users affected by CVD successfully identify target objects by their color names.

• Access to Document (DOI)

A Study on Contextual Task Performance of Simulated Homonymous Hemianopia Patients with Computational Glasses-based Compensation

Ge C., Zhu Z., Ichinose K., Fujishiro I., Toyoura M., Go K., Kashiwagi K., Mao X.

Proceedings Vrcai 2022 18th ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry （ACM）   （ 34 ） 1 - 8 2022年12月

査読有り

　概要を見る

People with Homonymous Hemianopia (HH) suffer from losing ipsilateral half side of visual field in both eyes, which results in failing to obtain visual information in the lost field. Making using of the remaining of the visual field, the state-of-the-art studies proposed Overlaid Overview Window (OOW) and Edge Indicator (EI) on the basis of Augmented-Reality (AR) glasses for compensation. However, experiments conducted in these studies investigate user performance with tasks involving events in lost field or remaining field singly. On the other hand, both studies recruited normal individuals for mock experiment, while their way to simulate HH, which requiring the participants to fix their view angles, were not practical to real HH patients. In this study, we conduct a contextual information experiment to investigate the user performance involving in the task requiring the information across both the visible and invisible sides of HH, with the compensation of OOW and Flicker-based EI (FEI). At the same time, we also recruit volunteers with normal vision for mock experiment, while the participants in our study are allowed to move their gaze freely, because we simulate the invisible field of HH on AR glasses with eye tracking. The experiment results showed that OOW is better for the task that related to move something from the remaining FoV to the lost FoV, while FEI is better for moving something from the lost FoV to the remaining FoV.

• Access to Document (DOI)

Affine-Transformed Ray Alignment for Fast Ray Traversal

Nishidate Y., Fujishiro I.

Proceedings SIGGRAPH Asia 2022 Technical Communications （ACM）     13:1 - 13:4 2022年12月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 査読有り

　概要を見る

In recent years, ray tracing has begun to be used for real-time rendering. However, the number of rays that can be emitted in real time is limited due to the high time complexity of ray tracing. In this paper, we propose affine-transformed ray alignment as a novel method of reducing time complexity. Using affine transformations, the proposed method aligns multiple rays to form a single ray while maintaining the intersection points obtained from the scene, thereby speeding up ray tracing without introducing errors. We also propose application of our method to the problems of primary ray traversal, stereo rendering, and multi-frame rendering and empirically prove that time complexity can be reduced by these simple implementations.

• Access to Document (DOI)

Anime-like motion transfer with optimal viewpoints

Yui Koroku, Issei Fujishiro

ACM SIGGRAPH Asia 2022 Posters Proceedings （ACM）     8:1 - 8:2 2022年12月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 査読有り

　概要を見る

In 3D character animation, the frame rate is often reduced to mimic hand-drawn animations, like anime (Japanese animation). However, anime with a low frame rate differs from real motions because it omits excessive movements and emphasizes speed by expressing motions with a small number of impressive poses. It is difficult to reproduce such motions only by downsampling mocap data. Thus, in this poster, we propose a method for converting mocap data into anime-like 2D motions by respecting production site techniques. The proposed method evaluates the characteristics of motion data using the time distributions of speeds and pose areas to select an appropriate sequence of viewpoints and extract effective poses for each viewpoint.

• Access to Document (DOI)

DVF: Toward Semiautomatic Composition of Perceptual Images of a Virtual Scene Through Hand Gesture Interface

Hoshikawa J., Fujishiro I.

Proceedings 2022 International Conference on Cyberworlds Cw 2022 （IEEE CPS）     169 - 170 2022年09月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 責任著者, 査読有り

　概要を見る

Human beings perceive scenes by enlarging an area of interest (AOI), whereas an ordinal camera captures the entire scene evenly. Therefore, it is not easy to share subjective impressions with others effectively only by sharing normal photos. Such challenges exist in cyberworlds as well. In this study, we design Digitus View Finder (DVF), a system that automatically outputs images close to the scenes a user perceives. A preliminary user study indicated that the DVF would be able to estimate a plausible scale factor of the AOI as a function of three parameters: the number of subjects in the AOI, the distance to the subjects, and a personal difference as a correction term.

• Access to Document (DOI)

FORSETI: A Provenance-aware Visual Analysis Environment for the Lifecycle Management of E-autopsy Reports

Wang B., Adachi N., Fujishiro I.

Ceur Workshop Proceedings 3135 2022年03月

研究論文（国際会議プロシーディングス）, 最終著者, 責任著者, 査読有り,  ISSN  16130073

　概要を見る

Autopsy reports are imperative for both medical and legal science. Medical examiners (MEs) and diagnostic radiologists (DRs) cross-reference autopsy findings, while judicial personnel derive legal documents. In a prior study, we proposed a visual analysis system named FORSETI (forensic autopsy system for e-court instruments) with x-LMML (extended legal medicine markup language) for MEs and DRs to author and review e-autopsy reports. In this paper, we outline our extended work in progress to introduce a provenance infrastructure for forensic data accountability to FORSETI, which can be characterized by two technical essences. The first is a provenance management mechanism that combines the forensic autopsy workflow management system (FAWfMS) and lmmlgit (a version control system for x-LMML files), allowing a large amount of provenance information about e-autopsy reports and their documented autopsy processes to be individually parsed. The second is authority management, which ensures the confidentiality of e-autopsy reports by deploying strict syntax-guided workflow controls and a custom-tailored tool.

SpiCa: Stereoscopic Effect Design with 3D Pottery Wheel-type Transparent Canvas

Ikeda R., Fujishiro I.

Proceedings SIGGRAPH Asia 2021 Technical Communications SA 2021 （ACM）     14:1 - 14:4 2021年12月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 査読有り

　概要を見る

Flow effects such as flames, smoke, and liquids play an important role in activating illustrations, but drawing these effects requires artistic expertise as well as a great deal of effort. In this paper, we propose a method for adding stereoscopic flow effects to character illustrations using various shapes of 3D pottery wheel-type transparent canvases. One approach to designing a flow effect to decorate a character relies on simple curved geometry to beautify its flow in an organized composition. We extend this approach to present a drawing system-SpiCa (spinning canvas), which enables users to use transparent surface of revolution canvases to design 3D flow effects. User evaluations showed that users were able to create such effects more easily and effectively and reduce their workload with SpiCa in comparison with an existing 2D illustration tool.

• Access to Document (DOI)

Illumination-Aware Digital Image Compositing for Full-length Human Figures

Ohkawara M., Fujishiro I.

Proceedings 2021 International Conference on Cyberworlds Cw 2021 （IEEE）     17 - 24 2021年09月

研究論文（国際会議プロシーディングス）, 共著, 査読有り

　概要を見る

In this paper, a novel compositor to realize illumination-Aware digital image compositing is proposed. Digital image compositing is a technique to re-synthesize a single image from multiple visual elements. Assembling separated visual elements leads to highly efficient content creation at risk of losing visual coherence. Visual coherence has two types: positional and illumination. Compositing while maintaining illumination coherence is considered a challenging task, because light transport information is needed to reproduce global illumination effects-color bleeding, soft shadows, caustics, and so on. The pipeline of the proposed compositor incorporates shape reconstruction, as well as global illumination simulation and relighting; thus, the compositor can reproduce background-To-foreground color bleeding and soft shadows. It is empirically evaluated that the proposed compositor compares favorably with rendering both in terms of quality and speed. Because it is in principle impossible to render the foreground and background elements together, the proposed compositor is inevitably selected to generate images with the two types of visual coherence. This leads to efficient construction of photorealistic cyberworlds.

• Access to Document (DOI)

THEMIS: Context-Sensitive Similarity Analysis for Wound Imagery Using Mathematical Model of Meaning

Asayama Y., Wang B., Nakayama M., Shohjoh H., Adachi N., Kiyoki Y., Fujishiro I.

Proceedings 2021 International Conference on Cyberworlds Cw 2021 （IEEE）     129 - 132 2021年09月

研究論文（国際会議プロシーディングス）, 共著, 査読有り

　概要を見る

Even when generated with the same weapon, a wound's appearance would be affected by its use and the assaulter's physique. In contrast, even if wounds look similar in shape and/or color, they could have a different wounding history. In this work, we strive to extract the features of shape and color from a given wound image and build on the mathematical model of meaning to create the associated semantics of the criminal act. We demonstrate that a system called THEMIS (theoretical estimation of the meaning of insults) provides a context-sensitive visual similarity analysis for wound imagery in computational forensics. The THEMIS system can help forensic doctors and e-court stakeholders potentially determine important aspects of a case through a comparison with wounds of corpses in past cases, in a way that is not currently possible.

• Access to Document (DOI)

Eye-Tracker-Free Compensation for Metamorphopsia

Moritake K., Zhu Z., Toyoura M., Go K., Kashiwagi K., Fujishiro I., Mao X.

Proceedings 2021 International Conference on Cyberworlds Cw 2021 （IEEE）     78 - 84 2021年09月

研究論文（国際会議プロシーディングス）, 共著, 査読有り

　概要を見る

Metamorphopsia is a symptom caused by abnormalities in the retina, and people with metamorphopsia experience distortions in their field of view. To compensate for this disorder, computer-based distortion assessment and compensation methods have been proposed. In the state-of-The-Art method, compensation is carried out by dynamically deforming the image with a manipulation map, which is bound to the symptom of an individual user with metamorphopsia, according to the user's gaze data captured by an eye tracker. However, this method suffers from the instability and inaccuracy of the eye tracker, which leads to a poor compensation effect. In this paper, we propose a novel method for metamorphopsia compensation without using an eye tracker. The proposed method generates a compensation image by simultaneously applying multiple manipulation maps to the input image. To evaluate the effectiveness of the proposed method, a preliminary subjective experiment using a reading task and involving 10 participants with normal vision was conducted. The evaluation results show that the proposed method can compensate for visual distortion during reading tasks.

• Access to Document (DOI)

3D distance field-based apparel modeling

Masanori Nakayama, Takami Yamamoto, Issei Fujishiro

Proceedings of IEVC 2021 （IIEEJ）  2021年09月

研究論文（国際会議プロシーディングス）, 共著, 査読有り

　概要を見る

This study aims to effectively design an apparel item by converting a polygon model of the human body obtained through 3D scan into a volume model. From the model, we can quickly generate a curved surface that retains a constant distance from the body surface, and thus design clothing material that ensures accurate “allowance” by defining the distance field for the body surface. Furthermore, by drawing a design line on the curved surface, the pattern required for actual sewing can be designed in three dimensions. A dynamics simulation is applied to smooth the curvatures so that the desired flat surface pattern can finally be obtained. As a result of actually sewing the virtually designed pattern and try-on, it was proven that we can generate clothes with the appropriate allowance and proportions.