論文 - 藤代　一成

Modeling audience NPC's diversity for enhanced illusionary sociality in collective VR concert experiences

Takehiro Ishinuki, Issei Fujishiro

ICAT-EGVE 2025 - International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments （Eurographics）  2025年12月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 責任著者, 査読有り,  ISSN  1727-530X

　概要を見る

Virtual reality (VR) live performances offer a novel style of experience through the deployment of three-dimensional cartoonlike performers and through spatiotemporally asynchronous participation. However, such experiences often lack the presence and atmospheric richness of physical live concerts. To address this gap, prior research has proposed audience non-player characters (NPCs) that emulate the collective characteristics of real-world audiences to enhance viewer engagement. In this study, we extend existing approaches by incorporating individual motion diversity to synthesize audience NPCs that form a heterogeneous and lifelike crowd. In addition to collective characteristics, such as music-driven motion changes and gradual synchronization, our modeling approach introduces agent-level diversity, even within the same motion categories. To assess the psychological impact of the proposed method, we developed a VR concert scenario featuring approximately 1,500 audience NPCs and conducted an empirical evaluation of the user experience. The findings indicate that enhanced motion heterogeneity can increase a viewer's sense of presence, engagement, perceived unity, and co-existence in a VR concert environment.

• Access to Document (DOI)

Identification of leading lines in artworks based on topological analysis of saliency maps

Fuminori Shibasaki, Issei Fujishiro

Proceedings of 2025 IEEE 18th Pacific Visualization Conference (PacificVis) （IEEE Computer Society）     369 - 374 2025年04月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 責任著者, 査読有り,  ISSN  21658765

　概要を見る

A key compositional technique, leading lines guide the observer's gaze across visual scenes. This study presents a novel approach to the visual analysis of leading lines in artworks by applying discrete Morse theory to saliency maps refined through persistent homology. The saliency map's gradient field is abstracted into a structured representation using the maximum graph, enabling the identification of both explicit and implicit leading lines. To enhance the analysis, texture gradient cues are incorporated to embed depth information into the saliency map. Our visual analysis system also features semiautomatic thresholding and tools to depict the direction of visual guidance. An experimental study with participants from an art university validated the system's feasibility by analyzing various Western paintings. This research contributes to the field of digital and public humanities and computational art analysis by offering an environment in which to explore visual composition.

• Access to Document (DOI)

3D fluid shape control by direct manipulation

Kohei Aoyama, Yuto Hayakawa, Issei Fujishiro

Advances in Visual Computing—19th International Symposium, ISVC 2024, Lake Tahoe, NV, USA, October 21–23, 2024, Proceedings, Part I （Springer LNCS）  16045   99 - 110 2025年01月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 責任著者, 査読有り,  ISSN  03029743

　概要を見る

In this paper, we propose a system for the intuitive control of fluid behavior through direct manipulation. The proposed system recognizes specific hand gesture commands to manage underlying 3D fluid simulation and adjust the parameters of fluid behavior. Thus, users are allowed to control the dynamics of fluid easily without detailed knowledge of physical simulation. The proposed system is expected to bring the benefits of 3D fluid simulations to a broader range of users.

• Access to Document (DOI)

An Efficient and Smooth Volume Shell Mapping by Nonlinear Ray Traversal of Hierarchical Structures

Kuwana M., Fujishiro I.

Proceedings SIGGRAPH Asia 2024 Technical Communications SA 2024 （ACM）     37:1 - 37:4 2024年12月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 責任著者, 査読有り

　概要を見る

Shell mapping is a method of representing microstructures on surfaces by mapping a three-dimensional texture space bijectively into a shell space. This paper introduces a volumetric texture to the texture space for the purpose of representing implicit surfaces and translucent materials. However, conventional approaches often generate artifacts at the boundaries of neighboring tetrahedra due to piecewise-linear approximate mapping. To achieve smooth mapping, we present an approach of mapping rays nonlinearly into the texture space, and we also address efficient sampling by using hierarchical volumetric textures.

• Access to Document (DOI)

Synthesis of Enthusiastic Collective Audience NPCs in VR Live Concerts

Ishinuki T., Fujishiro I.

Proceedings 2024 International Conference on Cyberworlds Cw 2024 （IEEE CPS）     33 - 40 2024年10月

研究論文（国際会議プロシーディングス）, 最終著者, 責任著者, 査読有り,  ISSN  2642-3596

　概要を見る

Virtual reality (VR) live concerts have recently attracted much attention because of their various possibilities for future music entertainment in cyberworlds. However, it has been reported that current VR live experiences do not reach the levels of enthusiasm observed at actual live concerts, and achieving a sense of enthusiasm in VR live concerts is a challenge to offer enough engagement. According to studies in the field of social psychology, psychological interactions with the surrounding audience are crucial to generating a sense of enthusiasm at actual live events. In response, this paper proposes a method for synthesizing enthusiastic collective non-player characters (NPCs) for VR live concerts. The proposed method computes the psychological interactions among the audience members, including the viewer, according to two psychological parameters. The synthesized audience NPCs are affected by both the music and their psychological interactions according to the surrounding audience, including the viewer, and they exhibit the features of an enthusiastic collective crowd. As such, an empirical study was conducted to explore the psychological influence of the proposed audience NPCs on VR live experiences. The results indicate that the proposed method could give the impression of an enthusiastic crowd at VR live experiences. In addition, it was suggested that social sensations between the audience NPCs and the viewer should be enhanced to increase the level of enthusiasm portrayed during VR live experiences. What was further suggested is the need for a certain degree of individual difference and diversity in appearance and motions for a natural collective audience.

• Access to Document (DOI)

STMA: A fast visual field defect assessment method using quadtree and head mounted display

Chao Ge, Zhenyang Zhu, Kenji Kashiwagi, Masahiro Toyoura, Kentaro Go, Issei Fujishiro, Xiaoyang Mao

Proceedings of NICOGRAPH International 2024 （SAS）  2024年06月

研究論文（国際会議プロシーディングス）, 査読有り

　概要を見る

Individuals with eye diseases that cause optic nerve damage, such as glaucoma, suffer from visual field defects (VFDs), rendering the assessment of VFDs an essential step in medical treatment. In existing studies, various methods have been proposed for VFD area inspections. However, these methods present several problems, including long inspection times and the need to maintain a posture for extended periods, potentially placing significant physical and psychological burdens on patients and affecting the accuracy of the inspection result. Moreover, loose eye fixation constraints also decrease the reliability of the result. In response, we herein propose a novel approach for a fast VFD test, facilitated by the quadtree algorithm. To overcome the physical burden caused by posture constraints related to the testing area requirements and location of the stimulus, the proposed VFD test is implemented on a head-mounted display with a built-in eye tracker. To improve the accuracy of the inspection result further, variously sized noise fields were adopted as the stimuli shown to the examinees. In addition, to validate the performance of the proposed method, a mock experiment was conducted in this study, which involved volunteers with normal vision. The experimental results indicate that the proposed method demonstrates a competitive advantage in perimetric time compared to current state-of-the-art methods, and it exhibits advantages in terms of both accuracy and user comfort.

• Access to Document (DOI)

Frame-break: Enhancing stereoscopic effect of an anamorphosis based naked-eye 3D imaging system

Keita Tokunaga, Issei Fujishiro

Proceedings of The 8th IIEEJ International Conference on Image Electronics and Visual Computing (IEVC 2024) （IIEEJ）  2024年03月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 責任著者, 査読有り

VigNet: Semiautomatic generation of vignette illustrations from video

Mayu Namai, Issei Fujishiro

Proceedings of The 8th IIEEJ International Conference on Image Electronics and Visual Computing (IEVC 2024) （IIEEJ）  2024年03月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 責任著者, 査読有り

HomeShelf: Cultivating Individual Relationships with Digital Contents

Tanaka S., Fujishiro I.

Proceedings 2023 28th Asia Pacific Conference on Communications Apcc 2023 （IEEE）     369 - 374 2023年11月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 査読有り

　概要を見る

The digitization of material objects is rapidly advancing, progressively offering people an unprecedented level of convenience and accessibility. However, studies have shown that people feel a lesser attachment to digital contents than to material objects. In this paper, we focus on shelves, thought to be hubs for cultivating individual relationships with material objects in daily life. We thus propose HomeShelf, an application that accelerates interactions with digital contents and fosters deeper attachments to them. Further, we discuss the features to be added using new technologies and the impact on digitized material objects.

• Access to Document (DOI)

Topological Analysis and Approximate Identification of Leading Lines in Artworks Based on Discrete Morse Theory

Shibasaki F., Fujishiro I.

Proceedings 2023 IEEE Visualization Conference Short Papers Vis 2023 （IEEE Computer Society）     6 - 10 2023年10月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 責任著者, 査読有り

　概要を見る

Accomplished artists often incorporate leading lines into their compositions to guide the observer's attention. Although saliency maps are typically employed to locate attractive regions in still images, such scalar features do not express the trajectory of an observer's gaze. In this study, we propose a method for the visual analysis and approximate identification of leading lines based on maximum graphs, sparse subsets of Morse-Smale complexes, extracted from saliency maps. We provide empirical evidence substantiating the feasibility of our method through a comparison with actual observers' eye tracking results. Further, we investigate the limitations of our approach by employing it to analyze a variety of artworks with diverse styles.

• Access to Document (DOI)

Metamorphopsia Insepction System Based on Relevance Feedback

Zhu Z., Moritake K., Kashiwagi K., Toyoura M., Go K., Fujishiro I., Mao X.

Conference Proceedings IEEE International Conference on Systems Man and Cybernetics （IEEE）     4667 - 4674 2023年10月

研究論文（国際会議プロシーディングス）, 共著, 査読有り,  ISSN  1062922X

　概要を見る

People with metamorphopsia suffer from perceiving things in a distorted way. Various methods for examining metamorphopsia have been suggested in the current literature, with the most advanced techniques demonstrating the ability to yield quantitative measurements. However, these cutting-edge methods necessitate extended examination durations and impose challenging manipulations on patients. In this study, our objective is to enhance the time efficiency of the inspection process and alleviate the burden placed on the user. We propose a novel user-friendly quantitative inspection system which utilizes interactive reinforcement learning. Instead of having users directly operate the system, we ask them to evaluate the stimuli generated by the system. Based on their evaluations, the system gradually refines the deformation map representing the distortion perceived by the user. The reinforcement learning scheme is implemented using relevance feedback approach based on optimum-path forest classifier. To evaluate the effectiveness of the proposed system, subjective evaluation experiments involving simulated and real metamorphopsia participants were conducted in this study. The experimental findings reveal that, when compared to the state-of-the-art method, our proposed system yields comparable inspection out-comes while significantly reducing both the inspection duration and the mental workload.

• Access to Document (DOI)

Virtual Manipulation of Cultural Assets: An Initial Case Study with Single-Joint Articulated Models

Shinji S., Fujishiro I.

Proceedings SIGGRAPH 2023 Posters （ACM）     26:1 - 26:2 2023年08月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 査読有り

　概要を見る

Virtual space can eliminate the physical constraints of real space. Three-dimensional (3D) digital twins enable us to experience manipulation of cultural assets that are inaccessible in real space. However, most 3D models obtained using current reconstruction techniques are static; they cannot be manipulated dynamically. In this study, we reproduce a dynamic 3D model of a simple articulated object with a rotating joint from a static point cloud only with reference to a video of the motion and a manually added rotation axis. The reconstructed actual cultural asset is used for first-person experiences in an augmented reality environment.

• Access to Document (DOI)

Clustering, Universalities, and Evolutionary Schema Design

Fujishiro I., Sawada N., Uemura M.

Ceur Workshop Proceedings 3379 2023年03月

共著, 筆頭著者, 責任著者, 査読有り,  ISSN  1613-0073

　概要を見る

Exploring data features using visual clustering is a significant challenge of big data analytics. In this vision paper, we focus primarily on the relationship among visual data clustering, the discovery of universalities, and the design of an evolutionary database to propose an inter-disciplinary method for scientific data management. The feasibility of the proposed method is empirically proven through application to a practical visual analytics environment for time-varying multi-dimensional datasets of blazar observations.

CC-Glasses: Color Communication Support for People with Color Vision Deficiency Using Augmented Reality and Deep Learning

Zhu Z., Li J., Tang Y., Go K., Toyoura M., Kashiwagi K., Fujishiro I., Mao X.

ACM International Conference Proceeding Series （ACM）     190 - 199 2023年03月

研究論文（国際会議プロシーディングス）, 共著, 査読有り

　概要を見る

People who suffer from color vision deficiency (CVD) can face difficulties when communicating with others by failing to identify target objects referred by their color names. While most existing studies on CVD compensation have focused on the issue of color contrast loss. Although there are approaches can provide clues of color name to users, these techniques either require training, or cannot protect users' privacy, i.e., the fact of having CVD. In this paper, based on augmented reality (AR) and deep learning technologies, we propose a novel system to provide supporting information to users affected by CVD for color communication assistance. The state-of-the-art deep neural network (DNN) model for referring segmentation (RS) is adopted to generate supporting information, and AR glasses are utilized for information presentation. To improve the performance of the proposed system further, a new dataset is constructed based on a novel concept called Color-Object Noun Pair. The results of evaluation experiments show that the new dataset can enhance the performance of the adopted DNN model, and the proposed system can help users affected by CVD successfully identify target objects by their color names.

• Access to Document (DOI)

A Study on Contextual Task Performance of Simulated Homonymous Hemianopia Patients with Computational Glasses-based Compensation

Ge C., Zhu Z., Ichinose K., Fujishiro I., Toyoura M., Go K., Kashiwagi K., Mao X.

Proceedings Vrcai 2022 18th ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry （ACM）   （ 34 ） 1 - 8 2022年12月

査読有り

　概要を見る

People with Homonymous Hemianopia (HH) suffer from losing ipsilateral half side of visual field in both eyes, which results in failing to obtain visual information in the lost field. Making using of the remaining of the visual field, the state-of-the-art studies proposed Overlaid Overview Window (OOW) and Edge Indicator (EI) on the basis of Augmented-Reality (AR) glasses for compensation. However, experiments conducted in these studies investigate user performance with tasks involving events in lost field or remaining field singly. On the other hand, both studies recruited normal individuals for mock experiment, while their way to simulate HH, which requiring the participants to fix their view angles, were not practical to real HH patients. In this study, we conduct a contextual information experiment to investigate the user performance involving in the task requiring the information across both the visible and invisible sides of HH, with the compensation of OOW and Flicker-based EI (FEI). At the same time, we also recruit volunteers with normal vision for mock experiment, while the participants in our study are allowed to move their gaze freely, because we simulate the invisible field of HH on AR glasses with eye tracking. The experiment results showed that OOW is better for the task that related to move something from the remaining FoV to the lost FoV, while FEI is better for moving something from the lost FoV to the remaining FoV.

• Access to Document (DOI)

Affine-Transformed Ray Alignment for Fast Ray Traversal

Nishidate Y., Fujishiro I.

Proceedings SIGGRAPH Asia 2022 Technical Communications （ACM）     13:1 - 13:4 2022年12月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 査読有り

　概要を見る

In recent years, ray tracing has begun to be used for real-time rendering. However, the number of rays that can be emitted in real time is limited due to the high time complexity of ray tracing. In this paper, we propose affine-transformed ray alignment as a novel method of reducing time complexity. Using affine transformations, the proposed method aligns multiple rays to form a single ray while maintaining the intersection points obtained from the scene, thereby speeding up ray tracing without introducing errors. We also propose application of our method to the problems of primary ray traversal, stereo rendering, and multi-frame rendering and empirically prove that time complexity can be reduced by these simple implementations.

• Access to Document (DOI)

Anime-like motion transfer with optimal viewpoints

Yui Koroku, Issei Fujishiro

ACM SIGGRAPH Asia 2022 Posters Proceedings （ACM）     8:1 - 8:2 2022年12月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 査読有り

　概要を見る

In 3D character animation, the frame rate is often reduced to mimic hand-drawn animations, like anime (Japanese animation). However, anime with a low frame rate differs from real motions because it omits excessive movements and emphasizes speed by expressing motions with a small number of impressive poses. It is difficult to reproduce such motions only by downsampling mocap data. Thus, in this poster, we propose a method for converting mocap data into anime-like 2D motions by respecting production site techniques. The proposed method evaluates the characteristics of motion data using the time distributions of speeds and pose areas to select an appropriate sequence of viewpoints and extract effective poses for each viewpoint.

• Access to Document (DOI)

DVF: Toward Semiautomatic Composition of Perceptual Images of a Virtual Scene Through Hand Gesture Interface

Hoshikawa J., Fujishiro I.

Proceedings 2022 International Conference on Cyberworlds Cw 2022 （IEEE CPS）     169 - 170 2022年09月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 責任著者, 査読有り

　概要を見る

Human beings perceive scenes by enlarging an area of interest (AOI), whereas an ordinal camera captures the entire scene evenly. Therefore, it is not easy to share subjective impressions with others effectively only by sharing normal photos. Such challenges exist in cyberworlds as well. In this study, we design Digitus View Finder (DVF), a system that automatically outputs images close to the scenes a user perceives. A preliminary user study indicated that the DVF would be able to estimate a plausible scale factor of the AOI as a function of three parameters: the number of subjects in the AOI, the distance to the subjects, and a personal difference as a correction term.

• Access to Document (DOI)

FORSETI: A Provenance-aware Visual Analysis Environment for the Lifecycle Management of E-autopsy Reports

Wang B., Adachi N., Fujishiro I.

Ceur Workshop Proceedings 3135 2022年03月

研究論文（国際会議プロシーディングス）, 最終著者, 責任著者, 査読有り,  ISSN  16130073

　概要を見る

Autopsy reports are imperative for both medical and legal science. Medical examiners (MEs) and diagnostic radiologists (DRs) cross-reference autopsy findings, while judicial personnel derive legal documents. In a prior study, we proposed a visual analysis system named FORSETI (forensic autopsy system for e-court instruments) with x-LMML (extended legal medicine markup language) for MEs and DRs to author and review e-autopsy reports. In this paper, we outline our extended work in progress to introduce a provenance infrastructure for forensic data accountability to FORSETI, which can be characterized by two technical essences. The first is a provenance management mechanism that combines the forensic autopsy workflow management system (FAWfMS) and lmmlgit (a version control system for x-LMML files), allowing a large amount of provenance information about e-autopsy reports and their documented autopsy processes to be individually parsed. The second is authority management, which ensures the confidentiality of e-autopsy reports by deploying strict syntax-guided workflow controls and a custom-tailored tool.

SpiCa: Stereoscopic Effect Design with 3D Pottery Wheel-type Transparent Canvas

Ikeda R., Fujishiro I.

Proceedings SIGGRAPH Asia 2021 Technical Communications SA 2021 （ACM）     14:1 - 14:4 2021年12月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 査読有り

　概要を見る

Flow effects such as flames, smoke, and liquids play an important role in activating illustrations, but drawing these effects requires artistic expertise as well as a great deal of effort. In this paper, we propose a method for adding stereoscopic flow effects to character illustrations using various shapes of 3D pottery wheel-type transparent canvases. One approach to designing a flow effect to decorate a character relies on simple curved geometry to beautify its flow in an organized composition. We extend this approach to present a drawing system-SpiCa (spinning canvas), which enables users to use transparent surface of revolution canvases to design 3D flow effects. User evaluations showed that users were able to create such effects more easily and effectively and reduce their workload with SpiCa in comparison with an existing 2D illustration tool.

• Access to Document (DOI)