Details of a Researcher - Ohtsuki, Tomoaki

Papers - Ohtsuki, Tomoaki

Division display 81 - 100 of about 414 ／ All the affair displays >>

Multi-Person Position Estimation Based on Correlation between Received Signals Using MIMO FMCW Radar

Endo K., Ishikawa T., Yamamoto K., Ohtsuki T.

IEEE Access (IEEE Access) 11 2610 - 2620 2023

By using Multiple-Input Multiple-Output (MIMO) Frequency Modulated Continuous Wave (FMCW) radar, a range-Angle map can be obtained that displays the signal strength in two dimensions with respect to distance and angular directions. In this process, a threshold algorithm such as Constant False Alarm Rate (CFAR) is used to detect positions where the signal strength exceeds a certain threshold value, enabling position estimation of targets. Furthermore, a method has been proposed to use the curve length of the trajectory of the I/Q signal to emphasize the signal of the person's position on the range angle map. However, the conventional CFAR may cause false alarms when noise and clutter signals are strong. In this paper, we propose a new method for human location estimation using the MIMO FMCW radar. Comparing the reflected signals from people and clutter, we see that I/Q signal variations associated with human motion have little correlation with clutter from stationary objects or noise, and I/Q signal variations associated with clutter often have high correlation with signals at other positions. We focus on the fact that there are many positions where the clutter component signal has a high correlation, compared to the signal caused by a person. Using the correlation map that expresses the correlation between the received I/Q signals on the range-Angle plane, we evaluated the characteristics of noise and clutter components from walls on the correlation map by standard deviation. As a result, we can remove strong noise and clutter components caused from near walls, thus improving the accuracy of object location estimation.

Access to Document (DOI)

Max-Min Fair 3D Trajectory Design and Transmission Scheduling for Solar-Powered Fixed-Wing UAV-Assisted Data Collection

Sun C., Xiong X., Zhai Z., Ni W., Ohtsuki T., Wang X.

IEEE Transactions on Wireless Communications (IEEE Transactions on Wireless Communications) 2023

ISSN 15361276

This paper presents a new three-dimensional (3D) trajectory design approach for a solar-powered, fixed-wing unmanned aerial vehicle (UAV) to harvest solar energy and collect data from multiple smart devices (SDs). The trajectory is optimized based on max-min fairness to balance the total amount of uploaded data and the fairness among the SDs. The key idea is that we develop non-trivial variable substitution and successive convex approximation (SCA) techniques to convexify data transmission, UAV energy consumption and mobility, and energy harvesting constraints under a persistent round-robin transmission schedule of the SDs. The resulting algorithm guarantees a locally optimal trajectory satisfying the Karush-Kuhn-Tucker (KKT) conditions. Another important aspect is that we further jointly optimize the transmission schedule along with the trajectory, and prove that absolute fairness in terms of uploaded data can be achieved among the SDs under the max-min fairness. The new algorithms apply to both line-of-sight (LoS)-dominant and probabilistic SD-UAV channels. Numerical results show that a 3D trajectory increases the uploaded data by 111%, compared to a two-dimensional (2D) trajectory. The proposed algorithms can balance the energy harvesting and data collection, and achieve fairness in both LoS-dominant and probabilistic SD-UAV channels.

Access to Document (DOI)

Investigation of Data Leakage in Deep Learning-based Blood Pressure Estimation using Photoplethysmogram/ Electrocardiogram

Yoshizawa R., Yamamoto K., Ohtsuki T.

IEEE Sensors Journal (IEEE Sensors Journal) 2023

ISSN 1530437X

Cuff-less blood pressure (BP) estimation methods using a deep learning model from photoplethysmogram (PPG) or electrocardiogram (ECG) have been actively studied in recent years. However, we found that most previous studies incur data leakage, where segments or records measured from the same subject appear in both the training and test datasets. Furthermore, many previous studies are suspected to have misinterpreted a record in the public dataset used for their evaluations as a subject. To investigate data leakage in BP estimation methods, this paper first organizes previous studies in terms of data leakage. We then quantitatively evaluate the effect of data leakage caused by the segment-level and the record-level train-test split using the public dataset, Cuff-Less Blood Pressure Estimation Data Set. Our experimental results showed that the segment-level split and record-level split erroneously improved the estimation accuracy of mean blood pressure from the (quasi-)subject-level split by the Pearson’s correlation coefficient of 0.56 and 0.40 when using PPG, and 0.82 and 0.69 when using ECG, respectively. These results confirmed that the train-test split used in many previous studies, including the one that described its evaluation as causing no data leakage, causes a high level of data leakage, and that a record in the Cuff-Less Blood Pressure Estimation Data Set, often misinterpreted as a subject in previous studies, is not a subject and that a high level of data leakage occurs when the record is considered as a subject.

Access to Document (DOI)

Intelligent Cellular Offloading with VLC-enabled Unmanned Aerial Vehicles

Panahi F.H., Panahi F.H., Ohtsuki T.

IEEE Internet of Things Journal (IEEE Internet of Things Journal) 2023

This paper discusses a cellular network assisted by an energy-and spectral-efficient unmanned aerial vehicle (UAV), in which the UAV is deployed to serve mobile users in the cellular network and enable mobile data offloading from a ground base station (GBS) by taking a circular flight route. We explore a visible light communication (VLC)-enabled UAV, in which a light-emitting diode (LED) is mounted on a rotary-wing UAV to offer communications to the users. Our aim is to simultaneously optimize both energy efficiency (EE) and spectral efficiency (SE) of the VLC-enabled UAV by jointly optimizing the common throughput of all users as well as the UAV’s trajectory and flying speed. We employ a unified metric, called resource efficiency (RE), and explore the RE optimization to obtain an adaptive EE-SE tradeoff. The problem posed is seen in a complex and non-convex shape, making it hard to solve. Motivated by the enormous achievement of deep reinforcement learning (DRL) in solving complex control problems, we propose a DRL-based approach to handle this non-convex and complicated optimization. The findings of the simulation reveal that the developed framework achieves a substantial performance in terms of the solution convergence as well as the promising quality of the solutions.

Access to Document (DOI)

Evaluation of Source Data Selection for DTL Based CSI Feedback Method in FDD Massive MIMO Systems

Inoue M., Ohtsuki T., Yamamoto K., Gui G.

Proceedings - IEEE Consumer Communications and Networking Conference, CCNC (Proceedings - IEEE Consumer Communications and Networking Conference, CCNC) 2023-January 182 - 187 2023

ISSN 23319860

In frequency division duplexing (FDD) massive multiple-input multiple-output (MIMO), the downlink channel state information (CSI) feedback method based on deep transfer learning (DTL) has been proposed to obtain the downlink CSI at the Base Station (BS). In the CSI feedback method based on DTL, a target model for one channel environment is obtained by fine-tuning the parameters of a source model trained on a large number of the CSI dataset (source data) of another channel environment. The fine-tuning is done with a small number of the CSI dataset (target data) of the target channel environment. Thus, a target model can be obtained at a low learning cost. However, the performance of the target model could highly depend on the source data. In this paper, we investigate two metrics as criteria for selecting source data to obtain a target model with a high CSI reconstruction performance: (i) Jensen-Shannon Divergence (JSD), which represents the similarity between target and source data, and (ii) entropy, which represents the diversity of source data. The simulation results showed when the target channel model is non line-of-sight (NLOS), the source data with high entropy and low JSD tend to provide higher CSI reconstruction performance of the target model. These results indicate that the JSD and the entropy could be a source data selection metric.

Access to Document (DOI)

Communication Efficient Heterogeneous Federated Learning based on Model Similarity

Li Z., Ohtsuki T., Gui G.

IEEE Wireless Communications and Networking Conference, WCNC (IEEE Wireless Communications and Networking Conference, WCNC) 2023-March 2023

ISSN 15253511

Federated Learning is now widely used to train neural networks under distributed datasets. One of the main challenges in Federated Learning is to address network training under local data heterogeneity. Existing work proposes that taking similarity into account as an influence factor in federated learning can improve the speed of model aggregation. We propose a novel approach that introduces Centered Kernel Alignment (CKA) into loss function to compute the similarity of feature maps in the output layer. Compared to existing methods, our method enables fast model aggregation and improves global model accuracy in non-IID scenario by using Resnet50.

Access to Document (DOI)

SAR Image Change Detection in Spatial-Frequency Domain Based on Attention Mechanism and Gated Linear Unit

Zhao C., Ma L., Wang L., Ohtsuki T., Mathiopoulos P.T., Wang Y.

IEEE Geoscience and Remote Sensing Letters (IEEE Geoscience and Remote Sensing Letters) 20 2023

ISSN 1545598X

Change detection based on synthetic aperture radar (SAR) images is an important application in the remote-sensing technology field. However, the lack of labeled data has been a difficult problem in SAR image detection, especially for pixel-level change detection. In this letter, we propose a novel unsupervised change detection algorithm, which improves the detection accuracy by exploring features from both spatial and frequency domains of SAR images. In particular, first clustering is used as preclassification to obtain pseudo-labels and then by incorporating classifiers and pseudo-labels in terms of feature learning, a novel unsupervised detection algorithm is proposed. To improve the sensitivity of the algorithm to changed details and enhance the antinoise ability of the change detection network, the attention mechanism (AM) is integrated into the network to fully extract important spatial structure information. Moreover, a multidomain fusion module is proposed to integrate spatial and frequency domain features into complementary feature representations. This module contains multiregion features weighted by the channel-spatial AM and deep features filtered out by the gated linear units (GLUs) in the frequency domain. To verify the effectiveness of the proposed algorithm, it is compared against the other four SAR image change detection algorithms using three real datasets. The experimental results show that the proposed method outperforms the other four algorithms in terms of percent correct classification (PCC) and Kappa coefficient (KC).

Access to Document (DOI)

Intelligent Cellular Offloading with VLC-enabled Unmanned Aerial Vehicles

F. H. Panahi, F. H. Panahi, and T. Ohtsuki

IEEE Internet of Things Journal 2023

Research paper (scientific journal), Last author

Detecting Dementia from Face-Related Features with Automated Computational Methods," Bioengineering

C. Zheng, M. Bouazizi,T. Ohtsuki, M. Kitazawa, T. Horigome, and T. Kishimoto

Bioengineering 2023

Research paper (scientific journal), Corresponding author

Edge Device Identification Based on Federated Learning and Network Traffic Feature Engineering

He Z., Yin J., Wang Y., Gui G., Adebisi B., Ohtsuki T., Gacanin H., Sari H.

IEEE Transactions on Cognitive Communications and Networking (IEEE Transactions on Cognitive Communications and Networking) 8 ( 4 ) 1898 - 1909 2022.12

With the ubiquitous deployment and applications of Internet of Things (IoT), security issues pose a critical challenge to IoT devices. External attackers often utilize vulnerable IoT devices to invade the target's internal network and then further cause a security threat to the whole network. To prevent such attacks, it is necessary to develop a security mechanism to control the access of suspicious IoT devices and manage the internal devices. In recent years, deep learning (DL) algorithm has been widely used in the field of edge device identification (EDI), and has made great achievements. However, these previous methods are essentially centralized learning-based EDI (CentEDI) that trains all data together, which can not guarantee data security and not conducive to deployment on edge devices. To address this problem, we introduce a federated learning-based EDI (FedeEDI) method via network traffic to automatically identify edge devices connected to the whole network. Experimental results show that the training efficiency of our proposed FedeEDI method is much higher than that of the CentEDI method, although its classification accuracy is slightly reduced. In contrast to the CentEDI method, the proposed FedeEDI method has two main advantages: faster training speed and safer training process.

Access to Document (DOI)

Make Smart Decisions Faster: Deciding D2D Resource Allocation via Stackelberg Game Guided Multi-Agent Deep Reinforcement Learning

Shi D., Li L., Ohtsuki T., Pan M., Han Z., Poor H.V.

IEEE Transactions on Mobile Computing (IEEE Transactions on Mobile Computing) 21 ( 12 ) 4426 - 4438 2022.12

ISSN 15361233

Device-to-Device (D2D) communication enabling direct data transmission between two mobile users has emerged as a vital component for 5G cellular networks to improve spectrum utilization and enhance system capacity. A critical issue for realizing these benefits in D2D-enabled networks is to properly allocate radio resources while coordinating the co-channel interference in a time-varying communication environment. In this paper, we propose a Stackelberg game (SG) guided multi-agent deep reinforcement learning (MADRL) approach, which allows D2D users to make smart power control and channel allocation decisions in a distributed manner. In particular, we define a crucial Stackelberg Q-value (ST-Q) to guide the learning direction, which can be calculated based on the equilibrium achieved in the Stackelberg game. With the guidance of the Stackelberg equilibrium, our approach converges faster with fewer iterations than the general MADRL method and thereby exhibits better performance in handling the network dynamics. After the initial training, each agent can infer timely D2D resource allocation strategies with distributed execution. Extensive simulations are conducted to validate the efficacy of our proposed scheme in developing timely resource allocation strategies. The results also show that our method outperforms the general MADRL based approach in terms of the average utility, channel capacity, and training time.

Access to Document (DOI)

A Denoising Method Using Deep Image Prior to Human-Target Detection Using MIMO FMCW Radar

Endo K., Yamamoto K., Ohtsuki T.

Sensors (Sensors) 22 ( 23 ) 2022.12

ISSN 14248220

A Multiple-Input Multiple-Output (MIMO) Frequency-Modulated Continuous Wave (FMCW) radar can provide a range-angle map that expresses the signal power against each range and angle. It is possible to estimate object locations by detecting the signal power that exceeds a threshold using an algorithm, such as Constant False Alarm Rate (CFAR). However, noise and multipath components often exist over the range-angle map, which could produce false alarms for an undesired location depending on the threshold setting. In other words, the threshold setting is sensitive in noisy range-angle maps. Therefore, if the noise is reduced, the threshold can be easily set to reduce the number of false alarms. In this paper, we propose a method that improves the CFAR threshold tolerance by denoising a range-angle map using Deep Image Prior (DIP). DIP is an unsupervised deep-learning technique that enables image denoising. In the proposed method, DIP is applied to the range-angle map calculated by the Curve-Length (CL) method, and then the object location is detected over the denoised range-angle map based on Cell-Averaging CFAR (CA-CFAR), which is a typical threshold setting algorithm. Through the experiments to estimate human locations in indoor environments, we confirmed that the proposed method with DIP reduced the number of false alarms and estimated the human location accurately while improving the tolerance of the threshold setting, compared to the method without DIP.

Access to Document (DOI)

Constructing Mobile Crowdsourced COVID-19 Vulnerability Map With Geo-Indistinguishability

Chen R., Li L., Ma Y., Gong Y., Guo Y., Ohtsuki T., Pan M.

IEEE Internet of Things Journal (IEEE Internet of Things Journal) 9 ( 18 ) 17403 - 17416 2022.09

Preventing COVID-19 disease from spreading in communities will require proactive and effective healthcare resource allocations, such as vaccinations. A fine-grained COVID-19 vulnerability map will be essential to detect the high-risk communities and guild the effective vaccine policy. A mobile-crowdsourcing-based self-reporting approach is a promising solution. However, an accurate mobile-crowdsourcing-based map construction requests participants to report their actual locations, raising serious privacy concerns. To address this issue, we propose a novel approach to effectively construct a reliable community-level COVID-19 vulnerability map based on mobile crowdsourced COVID-19 self-reports without compromising participants' location privacy. We design a geo-perturbation scheme where participants can locally obfuscate their locations with the geo-indistinguishability guarantee to protect their location privacy against any adversaries' prior knowledge. To minimize the data utility loss caused by location perturbation, we first design an unbiased vulnerability estimator and formulate the location perturbation probability generation into a convex optimization. Its objective is to minimize the estimation error of the direct vulnerability estimator under the constraints of geo-indistinguishability. Given the perturbed locations, we integrate the perturbation probabilities with the spatial smoothing method to obtain reliable community-level vulnerability estimations that are robust to a small-sampling-size problem incurred by location perturbation. Considering the fast-spreading nature of coronavirus, we integrate the vulnerability estimates into the modified susceptible-infected-removed (SIR) model with vaccination for building a future trend map. It helps to provide a guideline for vaccine allocation when supply is limited. Extensive simulations based on real-world data demonstrate the proposed scheme superiority over the peer designs satisfying geo-indistinguishability in terms of estimation accuracy and reliability.

Access to Document (DOI)

Wi-Fi-Based Fall Detection Using Spectrogram Image of Channel State Information

Nakamura T., Bouazizi M., Yamamoto K., Ohtsuki T.

IEEE Internet of Things Journal (IEEE Internet of Things Journal) 9 ( 18 ) 17220 - 17234 2022.09

Wi-Fi channel state information (CSI)-based fall detection systems have a great potential compared with other alternatives since they are nonintrusive and nonspace limited. However, in the conventional work on Wi-Fi CSI-based fall detection, a phenomenon is commonly observed: the classification performance degrades when data in different environments are used for learning and testing. Nonetheless, when the signal-to-noise-power ratio (SNR) is small, the conventional methods cannot capture features of motion and cannot segment signals accurately. Therefore, there is a need to address these problems in order to build a robust fall detection system. In this article, we propose a spectrogram-image-based fall detection using Wi-Fi CSI. Unlike the conventional method, CSI is segmented with a certain sliding-time window, and then the classifier detects fall by using the spectrogram image generated from the segmented CSI. We use a pretrained convolutional neural network (CNN) optimized for binary classification of the spectrogram images of the fall and nonfall motions. We carried out experiments to evaluate the classification performance of our proposed method against the conventional one by using motion data in two different rooms for learning and testing. As a result, we confirmed that our proposed method outperforms the conventional one and reaches over 0.92 accuracy. In addition, compared with the conventional method, the fall detection performance of our method does not degrade even when using different environment data for learning and testing.

Access to Document (DOI)

Sub-GHz Two-Way Ranging Based on Phase Detection for Remote Keyless Entry Systems

Seto I., Otaka S., Yoshida H., Nonin K., Nishikawa M., Kato T., Nito Y., Ishiwata H., Otsuki T.

IEEE Transactions on Vehicular Technology (IEEE Transactions on Vehicular Technology) 71 ( 9 ) 9705 - 9720 2022.09

ISSN 00189545

Remote keyless entry systems have penetrated the vehicular market due to its convenience. However, its vulnerability against relay attacks exploiting the wireless channel is a serious threat. One of the prominent countermeasures is radio ranging between the key fob and the vehicle. Taking into account radio regulations, usability and power consumption among other things, a suitable approach is necessary to devise. This article proposes sub-GHz two-way ranging based on phase detection which offers high tolerance against reference clock offset between a pair of transceiver devices and a novel compensation scheme against multipath effects. We present the operation principle and theoretical performance under a two-path model of radio propagation and additive white Gaussian noise. In field experiments with prototype devices, the ranging accuracy is validated. We show that the proposed ranging produces sufficient performance for remote keyless entry systems, confirming if the key fob is within a few meters of the vehicle.

Access to Document (DOI)

Inter-User Distance Estimation Based on a New Type of Fingerprint in Massive MIMO System for COVID-19 Contact Detection

Yang S., Bouazizi M., Cao Y., Ohtsuki T.

Sensors (Sensors) 22 ( 16 ) 2022.08

ISSN 14248220

In this paper, we address the challenging task of estimating the distance between different users in a Millimeter Wave (mmWave) massive Multiple-Input Multiple-Output (mMIMO) system. The conventional Time of Arrival (ToA) and Angle of Arrival (AoA) based methods need users under the Line-of-Sight (LoS) scenario. Under the Non-LoS (NLoS) scenario, the fingerprint-based method can extract the fingerprint that includes the location information of users from the channel state information (CSI). However, high accuracy CSI estimation involves a huge overhead and high computational complexity. Thus, we design a new type of fingerprint generated by beam sweeping. In other words, we do not have to know the CSI to generate fingerprint. In general, each user can record the Received Signal Strength Indicator (RSSI) of the received beams by performing beam sweeping. Such measured RSSI values, formatted in a matrix, could be seen as beam energy image containing the angle and location information. However, we do not use the beam energy image as the fingerprint directly. Instead, we use the difference between two beam energy images as the fingerprint to train a Deep Neural Network (DNN) that learns the relationship between the fingerprints and the distance between these two users. Because the proposed fingerprint is rich in terms of the users’ location information, the DNN can easily learn the relationship between the difference between two beam energy images and the distance between those two users. We term it as the DNN-based inter-user distance (IUD) estimation method. Nonetheless, we investigate the possibility of using a super-resolution network to reduce the involved beam sweeping overhead. Using super-resolution to increase the resolution of low-resolution beam energy images obtained by the wide beam sweeping for IUD estimation can facilitate considerate improvement in accuracy performance. We evaluate the proposed DNN-based IUD estimation method by using original images of resolution 4 × 4, 8 × 8, and 16 × 16. Simulation results show that our method can achieve an average distance estimation error equal to 0.13 m for a coverage area of 60 × 30 m2. Moreover, our method outperforms the state-of-the-art IUD estimation methods that rely on users’ location information.

Access to Document (DOI)

2-D LIDAR-Based Approach for Activity Identification and Fall Detection

Bouazizi M., Ye C., Ohtsuki T.

IEEE Internet of Things Journal (IEEE Internet of Things Journal) 9 ( 13 ) 10872 - 10890 2022.07

Activity detection is a key task in the monitoring of elderly people living alone. This is because it helps locate them and identify any accident that might occur to them. In this article, we propose a novel approach that uses 2-D light detection and ranging (LIDAR) and deep learning to perform activity detection. In a first step, our approach processes and interpolates the data collected using the 2-D LIDAR following an algorithm we propose to locate the person and identify the useful data points. In the next steps, the data are transformed into two types of representations: 1) a time-series type and 2) an image type. The time-series data are used to train different long short-term memory (LSTM) networks to identify the person and to recognize his/her activity, while the image type is used to fine-tune a convolutional neural network (CNN) for fall detection. Throughout our experiments, we show that our approach allows for the identification of people from their gait, and the detection of unsteady gait or unstable walk (i.e., when the person is about to fall or feeling dizzy) as well as the detection of up to four activities: 1) walking; 2) standing; 3) sitting; and 4) falling. The results obtained from our experiment show that the proposed method reaches an accuracy equal to 94.1% for multiclass activity detection, 98.6% for fall detection, 93.2% for person identification (for three different people), and 92.5% for unsteady walk detection.

Access to Document (DOI)

A Novel Intrusion Detection Method Based on Lightweight Neural Network for Internet of Things

Zhao R., Gui G., Xue Z., Yin J., Ohtsuki T., Adebisi B., Gacanin H.

IEEE Internet of Things Journal (IEEE Internet of Things Journal) 9 ( 12 ) 9960 - 9972 2022.06

The purpose of a network intrusion detection (NID) is to detect intrusions in the network, which plays a critical role in ensuring the security of the Internet of Things (IoT). Recently, deep learning (DL) has achieved a great success in the field of intrusion detection. However, the limited computing capabilities and storage of IoT devices hinder the actual deployment of DL-based high-complexity models. In this article, we propose a novel NID method for IoT based on the lightweight deep neural network (LNN). In the data preprocessing stage, to avoid high-dimensional raw traffic features leading to high model complexity, we use the principal component analysis (PCA) algorithm to achieve feature dimensionality reduction. Besides, our classifier uses the expansion and compression structure, the inverse residual structure, and the channel shuffle operation to achieve effective feature extraction with low computational cost. For the multiclassification task, we adopt the NID loss that acts as a better loss function to replace the standard cross-entropy loss for dealing with the problem of uneven distribution of samples. The results of experiments on two real-world NID data sets demonstrate that our method has excellent classification performance with low model complexity and small model size, and it is suitable for classifying the IoT traffic of normal and attack scenarios.

Access to Document (DOI)

Fully Convolutional Neural Network-Based CSI Limited Feedback for FDD Massive MIMO Systems

Fan G., Sun J., Gui G., Gacanin H., Adebisi B., Ohtsuki T.

IEEE Transactions on Cognitive Communications and Networking (IEEE Transactions on Cognitive Communications and Networking) 8 ( 2 ) 672 - 682 2022.06

Due to the lack of channel reciprocity in frequency division duplexity (FDD) massive multiple-input multiple-output (MIMO) systems, it is impossible to infer the downlink channel state information (CSI) directly from its reciprocal uplink CSI. Hence, the estimated downlink CSI needs to be continuously fed back to the base station (BS) from the user equipment (UE), consuming valuable bandwidth resources. This is exacerbated, in massive MIMO, with the increase of the antennas at the BS. This paper propose a fully convolutional neural network (FullyConv) to compress and decompress the downlink CSI. FullyConv will improve the reconstruction accuracy of downlink CSI and reduce the training parameters and computational resources. Besides, we add a quantization module in the encoder and a dequantization module in the decoder of the FullyConv to simulate a real feedback scenario. Experimental results demonstrate that the proposed FullyConv is better than the baseline on reconstruction performance and reduction of the storage and computational overhead. Furthermore, the FullyConv added quantization and dequantization modules is robust to quantization error in real feedback scenarios.

Access to Document (DOI)

An Infrared Array Sensor-Based Approach for Activity Detection, Combining Low-Cost Technology with Advanced Deep Learning Techniques

Arumugasamy M.K., Bouazizi M., Ohtsuki T.

Sensors (Sensors) 22 ( 10 ) 2022.05

ISSN 14248220

In this paper, we propose an activity detection system using a 24 × 32 resolution infrared array sensor placed on the ceiling. We first collect the data at different resolutions (i.e., 24 × 32, 12 × 16, and 6 × 8) and apply the advanced deep learning (DL) techniques of Super-Resolution (SR) and denoising to enhance the quality of the images. We then classify the images/sequences of images depending on the activities the subject is performing using a hybrid deep learning model combining a Convolutional Neural Network (CNN) and a Long Short-Term Memory (LSTM). We use data augmentation to improve the training of the neural networks by incorporating a wider variety of samples. The process of data augmentation is performed by a Conditional Generative Adversarial Network (CGAN). By enhancing the images using SR, removing the noise, and adding more training samples via data augmentation, our target is to improve the classification accuracy of the neural network. Through experiments, we show that employing these deep learning techniques to low-resolution noisy infrared images leads to a noticeable improvement in performance. The classification accuracy improved from 78.32% to 84.43% (for images with 6 × 8 resolution), and from 90.11% to 94.54% (for images with 12 × 16 resolution) when we used the CNN and CNN + LSTM networks, respectively.

Access to Document (DOI)

　 Previous page - Next page 　