論文 - 藤代　一成

STMA: A fast visual field defect assessment method using quadtree and head mounted display

Chao Ge, Zhenyang Zhu, Kenji Kashiwagi, Masahiro Toyoura, Kentaro Go, Issei Fujishiro, Xiaoyang Mao

Proceedings of NICOGRAPH International 2024 （SAS）  2024年06月

研究論文（国際会議プロシーディングス）, 査読有り

　概要を見る

Individuals with eye diseases that cause optic nerve damage, such as glaucoma, suffer from visual field defects (VFDs), rendering the assessment of VFDs an essential step in medical treatment. In existing studies, various methods have been proposed for VFD area inspections. However, these methods present several problems, including long inspection times and the need to maintain a posture for extended periods, potentially placing significant physical and psychological burdens on patients and affecting the accuracy of the inspection result. Moreover, loose eye fixation constraints also decrease the reliability of the result. In response, we herein propose a novel approach for a fast VFD test, facilitated by the quadtree algorithm. To overcome the physical burden caused by posture constraints related to the testing area requirements and location of the stimulus, the proposed VFD test is implemented on a head-mounted display with a built-in eye tracker. To improve the accuracy of the inspection result further, variously sized noise fields were adopted as the stimuli shown to the examinees. In addition, to validate the performance of the proposed method, a mock experiment was conducted in this study, which involved volunteers with normal vision. The experimental results indicate that the proposed method demonstrates a competitive advantage in perimetric time compared to current state-of-the-art methods, and it exhibits advantages in terms of both accuracy and user comfort.

• Access to Document (DOI)

Frame-break: Enhancing stereoscopic effect of an anamorphosis based naked-eye 3D imaging system

Keita Tokunaga, Issei Fujishiro

Proceedings of The 8th IIEEJ International Conference on Image Electronics and Visual Computing (IEVC 2024) （IIEEJ）  2024年03月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 責任著者, 査読有り

VigNet: Semiautomatic generation of vignette illustrations from video

Mayu Namai, Issei Fujishiro

Proceedings of The 8th IIEEJ International Conference on Image Electronics and Visual Computing (IEVC 2024) （IIEEJ）  2024年03月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 責任著者, 査読有り

HomeShelf: Cultivating Individual Relationships with Digital Contents

Sota Tanaka, Issei Fujishiro

2023 28th Asia Pacific Conference on Communications (APCC) （IEEE）     369 - 374 2023年11月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 査読有り

　概要を見る

The digitization of material objects is rapidly advancing, progressively offering people an unprecedented level of convenience and accessibility. However, studies have shown that people feel a lesser attachment to digital contents than to material objects. In this paper, we focus on shelves, thought to be hubs for cultivating individual relationships with material objects in daily life. We thus propose HomeShelf, an application that accelerates interactions with digital contents and fosters deeper attachments to them. Further, we discuss the features to be added using new technologies and the impact on digitized material objects.

• Access to Document (DOI)

Topological analysis and approximate identification of leading lines in artworks based on discrete Morse theory

Fumimori Shibasaki, Issei Fujishiro

Proceedings of IEEE VIS 2023 （IEEE Computer Society）  2023年10月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 責任著者, 査読有り

　概要を見る

Accomplished artists often incorporate leading lines into their compositions to guide the observer’s attention. Although saliency maps are typically employed to locate attractive regions in still images, such scalar features do not express the trajectory of an observer’s gaze. In this study, we propose a method for the visual analysis and approximate identification of leading lines based on maximum graphs, sparse subsets of Morse–Smale complexes, extracted from saliency maps. We provide empirical evidence substantiating the feasibility of our method through a comparison with actual observers’ eye tracking results. Further, we investigate the limitations of our approach by employing it to analyze a variety of artworks with diverse styles.

• Access to Document (DOI)

Metamorphopsia inspection system based on relevance feedback

Zhenyang Zhu, Masahiro Toyoura, Kentaro Go, Issei Fujishiro, Xiaoyang Mao

2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC) （IEEE）     4667 - 4674 2023年10月

研究論文（国際会議プロシーディングス）, 共著, 査読有り

　概要を見る

People with metamorphopsia suffer from perceiving things in a distorted way. Various methods for examining metamorphopsia have been suggested in the current literature, with the most advanced techniques demonstrating the ability to yield quantitative measurements. However, these cutting-edge methods necessitate extended examination durations and impose challenging manipulations on patients. In this study, our objective is to enhance the time efficiency of the inspection process and alleviate the burden placed on the user. We propose a novel user-friendly quantitative inspection system which utilizes interactive reinforcement learning. Instead of having users directly operate the system, we ask them to evaluate the stimuli generated by the system. Based on their evaluations, the system gradually refines the deformation map representing the distortion perceived by the user. The reinforcement learning scheme is implemented using relevance feedback approach based on optimum-path forest classifier. To evaluate the effectiveness of the proposed system, subjective evaluation experiments involving simulated and real metamorphopsia participants were conducted in this study. The experimental findings reveal that, when compared to the state-of-the-art method, our proposed system yields comparable inspection out-comes while significantly reducing both the inspection duration and the mental workload.

• Access to Document (DOI)

Virtual manipulation of cultural assets: An initial case study with single-joint articulated models

Sakura Shinji, Issei Fujishiro

ACM SIGGRAPH 2023 Posters Proceedings （ACM）     26:1 - 26:2 2023年08月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 査読有り

　概要を見る

Virtual space can eliminate the physical constraints of real space. Three-dimensional (3D) digital twins enable us to experience manipulation of cultural assets that are inaccessible in real space. However, most 3D models obtained using current reconstruction techniques are static; they cannot be manipulated dynamically. In this study, we reproduce a dynamic 3D model of a simple articulated object with a rotating joint from a static point cloud only with reference to a video of the motion and a manually added rotation axis. The reconstructed actual cultural asset is used for first-person experiences in an augmented reality environment.

• Access to Document (DOI)

Clustering, universalities, and evolutionary schema design

Issei Fujishiro, Naoko Sawada, Makoto Uemura

CEUR Workshop Proceedings 3379 2023年03月

共著, 筆頭著者, 責任著者, 査読有り,  ISSN  1613-0073

　概要を見る

Exploring data features using visual clustering is a significant challenge of big data analytics. In this vision paper, we focus primarily on the relationship among visual data clustering, the discovery of universalities, and the design of an evolutionary database to propose an inter-disciplinary method for scientific data management. The feasibility of the proposed method is empirically proven through application to a practical visual analytics environment for time-varying multi-dimensional datasets of blazar observations.

CC-Glasses: Color communication support for people with color vision deficiency using augmented reality and deep learning

Zhenyang Zhu, Jiyi Li, Ying Tang, Kentaro Go, Masahiro Toyoura, Kenji Kashiwagi, Issei Fujishiro, Xiaoyang Mao:

Proceedings of the Augmented Humans International Conference 2023 （ACM）     190 - 199 2023年03月

研究論文（国際会議プロシーディングス）, 共著, 査読有り

• Access to Document (DOI)

A study on contextual task performance of simulated homonymous hemianopia patients with computational glasses-based compensation

Chao Ge, Zhenyang Zhu, Keisuke Ichinose, Issei Fujishiro, Masahiro Toyoura, Kentaro Go, Kenji Kashiwagi, Xiaoyang Mao

Proceedings of ACM VRCAI 2022 （ACM）   （ 34 ） 1 - 8 2022年12月

査読有り

　概要を見る

People with Homonymous Hemianopia (HH) suffer from losing ipsilateral half side of visual field in both eyes, which results in failing to obtain visual information in the lost field. Making using of the remaining of the visual field, the state-of-the-art studies proposed Overlaid Overview Window (OOW) and Edge Indicator (EI) on the basis of Augmented-Reality (AR) glasses for compensation. However, experiments conducted in these studies investigate user performance with tasks involving events in lost field or remaining field singly. On the other hand, both studies recruited normal individuals for mock experiment, while their way to simulate HH, which requiring the participants to fix their view angles, were not practical to real HH patients. In this study, we conduct a contextual information experiment to investigate the user performance involving in the task requiring the information across both the visible and invisible sides of HH, with the compensation of OOW and Flicker-based EI (FEI). At the same time, we also recruit volunteers with normal vision for mock experiment, while the participants in our study are allowed to move their gaze freely, because we simulate the invisible field of HH on AR glasses with eye tracking. The experiment results showed that OOW is better for the task that related to move something from the remaining FoV to the lost FoV, while FEI is better for moving something from the lost FoV to the remaining FoV.

• Access to Document (DOI)

Affine-transformed ray alignment for fast ray traversal

Yuki Nishidate, Issei Fujishiro

ACM SIGGRAPH Asia 2022 Technical Communications Proceedings （ACM）     13:1 - 13:4 2022年12月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 査読有り

　概要を見る

In recent years, ray tracing has begun to be used for real-time rendering. However, the number of rays that can be emitted in real time is limited due to the high time complexity of ray tracing. In this paper, we propose affine-transformed ray alignment as a novel method of reducing time complexity. Using affine transformations, the proposed method aligns multiple rays to form a single ray while maintaining the intersection points obtained from the scene, thereby speeding up ray tracing without introducing errors. We also propose application of our method to the problems of primary ray traversal, stereo rendering, and multi-frame rendering and empirically prove that time complexity can be reduced by these simple implementations.

• Access to Document (DOI)

Anime-like motion transfer with optimal viewpoints

Yui Koroku, Issei Fujishiro

ACM SIGGRAPH Asia 2022 Posters Proceedings （ACM）     8:1 - 8:2 2022年12月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 査読有り

　概要を見る

In 3D character animation, the frame rate is often reduced to mimic hand-drawn animations, like anime (Japanese animation). However, anime with a low frame rate differs from real motions because it omits excessive movements and emphasizes speed by expressing motions with a small number of impressive poses. It is difficult to reproduce such motions only by downsampling mocap data. Thus, in this poster, we propose a method for converting mocap data into anime-like 2D motions by respecting production site techniques. The proposed method evaluates the characteristics of motion data using the time distributions of speeds and pose areas to select an appropriate sequence of viewpoints and extract effective poses for each viewpoint.

• Access to Document (DOI)

DVF: Toward semiautomatic composition of perceptual images of a virtual scene through hand gesture interface

Jun Hoshikawa, Issei Fujishiro

Proceedings of Cyberworlds 2022 （IEEE CPS）     169 - 170 2022年09月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 責任著者, 査読有り

　概要を見る

Human beings perceive scenes by enlarging an area of interest (AOI), whereas an ordinal camera captures the entire scene evenly. Therefore, it is not easy to share subjective impressions with others effectively only by sharing normal photos. Such challenges exist in cyberworlds as well. In this study, we design Digitus View Finder (DVF), a system that automatically outputs images close to the scenes a user perceives. A preliminary user study indicated that the DVF
would be able to estimate a plausible scale factor of the AOI as a function of three parameters: the number of subjects in the AOI, the distance to the subjects, and a personal difference as a correction term.

• Access to Document (DOI)

FORSETI: A provenance-aware visual analysis environment for the lifecycle management of e-autopsy reports

Baoqing Wang, Noboru Adachi, Issei Fujishiro

CEUR Workshop Proceedings 3135 2022年03月

研究論文（国際会議プロシーディングス）, 最終著者, 責任著者, 査読有り

　概要を見る

Autopsy reports are imperative for both medical and legal science. Medical examiners (MEs) and diagnostic radiologists (DRs) cross-reference autopsy findings, while judicial personnel derive legal documents. In a prior study, we proposed a visual analysis system named FORSETI (forensic autopsy system for e-court instruments) with x-LMML (extended legal medicine markup language) for MEs and DRs to author and review e-autopsy reports. In this paper, we outline our extended work in progress to introduce a provenance infrastructure for forensic data accountability to FORSETI, which can be characterized by two technical essences. The first is a provenance management mechanism that combines the forensic autopsy workflow management system (FAWfMS) and lmmlgit (a version control system for x-LMML files), allowing a large amount of provenance information about e-autopsy reports and their documented autopsy processes to be individually parsed. The second is authority management, which ensures the confidentiality of e-autopsy reports by deploying strict syntax-guided workflow controls and a custom-tailored tool.

SpiCa: Stereoscopic effect design with 3D pottery wheel-type transparent canvas

Riwano Ikeda, Issei Fujishiro

ACM SIGGRAPH Asia 2021 Technical Communications （ACM）     14:1 - 14:4 2021年12月

研究論文（国際会議プロシーディングス）, 共著, 最終著者, 査読有り

　概要を見る

Flow effects such as flames, smoke, and liquids play an important role in activating illustrations, but drawing these effects requires artistic expertise as well as a great deal of effort. In this paper, we propose a method for adding stereoscopic effects to character illustrations using various shapes of 3D pottery wheel-type transparent canvases. One approach to designing a flow effect to decorate a character relies on simple curved geometry to beautify its flowin an organized composition.We extend this approach to present a drawing system—SpiCa (spinning canvas), which enables users to use rotatable transparent canvases to design 3D flow effects. User evaluations show that users can create such effects more easily and effectively and reduce their workload with SpiCa in comparison with an existing 2D illustration tool.

• Access to Document (DOI)

Illumination-aware digital image compositing for full-length human figures

Masaru Ohkawara, Issei Fujishiro

Proceedings of Cyberworlds 2021 （IEEE）     17 - 24 2021年09月

研究論文（国際会議プロシーディングス）, 共著, 査読有り

　概要を見る

In this paper, a novel compositor to realize illumination-aware digital image compositing is proposed. Digital image compositing is a technique to re-synthesize a single image from multiple visual elements. Assembling separated visual elements leads to highly efficient content creation at risk of losing visual coherence. Visual coherence has two types: positional and illumination. Compositing while maintaining illumination coherence is considered a challenging task, because light transport information is needed to reproduce global illumination effects—color bleeding, soft shadows, caustics, and so on. The pipeline of the proposed compositor incorporates shape reconstruction, as well as global illumination simulation and relighting; thus, the compositor can reproduce background-to-foreground color bleeding and soft shadows. It is empirically evaluated that the proposed compositor compares favorably with rendering both in terms of quality and speed. Because it is in principle impossible to render the foreground and background elements together, the proposed compositor is inevitably selected to generate images with the two types of visual coherence. This leads to efficient construction of photorealistic cyberworlds.

• Access to Document (DOI)

THEMIS: Context-sensitive similarity analysis for wound imagery using mathematical model of meaning

Masaru Ohkawara, Issei FujishiroYume Asayama, Baoqing Wang, Masanori Nakayama, Hideki Shojo, Noboru Adachi, Yasushi Kiyoki, Issei Fujishiro

Proceedings of Cyberworlds 2021 （IEEE）     129 - 132 2021年09月

研究論文（国際会議プロシーディングス）, 共著, 査読有り

　概要を見る

Even when generated with the same weapon, a　wound's appearance would be affected by its use and the assaulter’s physique. In contrast, even if wounds look similar in shape and/or color, they could have a different wounding history. In this work, we strive to extract the features of shape and color from a given wound image and build on the mathematical model of meaning to create the associated semantics of the criminal act. We demonstrate that a system called THEMIS (theoretical estimation of the meaning of insults) provides a context-sensitive visual similarity analysis for wound imagery in computational forensics. The THEMIS system can help forensic doctors and e-court stakeholders potentially determine important aspects of a case through a comparison with wounds of corpses in past cases, in a way that is not currently possible.

• Access to Document (DOI)

Eye-tracker-free compensation for metamorphopsia

Masaru Ohkawara, Issei FujishiroKatsuhito Moritake, Zhenyang Zhu, Masahiro Toyoura, Kentaro Go, Kenji Kashiwagi, Issei Fujishiro, Xiaoyang Mao

Proceedings of Cyberworlds 2021 （IEEE）     78 - 84 2021年09月

研究論文（国際会議プロシーディングス）, 共著, 査読有り

　概要を見る

Metamorphopsia is a symptom caused by abnormalities in the retina, and people with metamorphopsia experience distortions in their field of view. To compensate for this disorder, computer-based distortion assessment and compensation methods have been proposed. In the state-of-theart method, compensation is carried out by dynamically deforming the image with a manipulation map, which is bound to the symptom of an individual user with metamorphopsia, according to the user’s gaze data captured by an eye tracker. However, this method suffers from the instability and inaccuracy of the eye tracker, which leads to a poor compensation effect. In this paper, we propose a novel method for metamorphopsia compensation without using an eye tracker. The proposed method generates a compensation image by simultaneously applying multiple manipulation maps to the input image. To evaluate the effectiveness of the proposed method, a preliminary subjective experiment using a reading task and involving 10 participants with normal vision was conducted. The evaluation results show that the proposed method can compensate for visual distortion during reading tasks.

• Access to Document (DOI)

3D distance field-based apparel modeling

Masanori Nakayama, Takami Yamamoto, Issei Fujishiro

Proceedings of IEVC 2021 （IIEEJ）  2021年09月

研究論文（国際会議プロシーディングス）, 共著, 査読有り

　概要を見る

This study aims to effectively design an apparel item by converting a polygon model of the human body obtained through 3D scan into a volume model. From the model, we can quickly generate a curved surface that retains a constant distance from the body surface, and thus design clothing material that ensures accurate “allowance” by defining the distance field for the body surface. Furthermore, by drawing a design line on the curved surface, the pattern required for actual sewing can be designed in three dimensions. A dynamics simulation is applied to smooth the curvatures so that the desired flat surface pattern can finally be obtained. As a result of actually sewing the virtually designed pattern and try-on, it was proven that we can generate clothes with the appropriate allowance and proportions.

Adjusting control parameters of topology-accentuated transfer functions for volume raycasting

Yuriko Takeshima, Shigeo Takahashi, Issei Fujishiro

Topological Methods in Data Analysis and Visualization V: Theory, Algorithms, and Applications （Springer International Publishing）     71 - 86 2020年12月

研究論文（国際会議プロシーディングス）, 共著, 査読有り

　概要を見る

The design of automatic transfer functions for volume rendering is a perennial problem in volume visualization. Over the last three decades, a variety of design methodologies have been proposed. However, sensitive adjustment of related control parameters remains entrusted to users, because rendering conditions,such as the thickness of emphasized subvolumes in the ray direction and the size of a target dataset, differ on a case-by-case basis. Our group previously proposed one-dimensional transfer functions to accentuate topological changes in the scalar field of the target dataset. However, the method forces us to determine the actual control parameter values for the transfer functions in an empirical manner. In this paper, we propose a supplementary mechanism with which to judiciously define an appropriate profile of the opacity values. More specifically, the height and width of the hat opacity transfer functions that accentuate feature isosurfaces are determined according to the number of voxels belonging to the relevant topologically equivalent scalar field interval. The feasibility of the proposed method is evaluated by its application to five kinds of volume datasets.

• Access to Document (DOI)