論文 - 丹上　結乃純

Human Behavior Segmentation and Recognition Using a Single-camera 査読有り 国際誌

Jing Cao, Yui Tanjo

The 2024 International Conference on Artificial Life and Robotics ( Robot Artificial Life Society )   969 - 973   2024年02月

　詳細を見る

担当区分：責任著者   記述言語：英語   掲載種別：研究論文（国際会議プロシーディングス）

Japan   Oita   2024年02月22日  -  2024年02月25日

In recent years, elderly people living alone account for a large proportion of the elderly population, and the issue of safety has also been a matter of great concern for the public. Considering the importance of monitoring the behavior and activities of the elderly and detecting abnormal movements, this paper proposes a method that can segment human behavior into each action and identify the action from the videos taken by a single camera. It uses features that can represent the shape of the human area in the depth direction, as well as the features such as motion direction and speed. The performance and effectiveness of the method are verified by experiments. Keywords: Behavior segmentation, Motion recognition, Optical flows, TMRIs, Ex-HOOF, MHI

Kyutacar

A Method of Recognizing Body Movements Based on a Self-viewpoint Video 査読有り 国際誌

Iichirou Moribe,Yui Tanjo

The 2024 International Conference on Artificial Life and Robotics ( Robot Artificial Life Society )   979 - 982   2024年02月

　詳細を見る

担当区分：責任著者   記述言語：英語   掲載種別：研究論文（国際会議プロシーディングス）

Japan   Oita   2024年02月22日  -  2024年02月25日

The most critical human sensory function resides in vision. This paper focuses on utilizing visual information, specifically self-perspective footage, to identify individual movements. Existing researches require third-party filming to recognize human body movements and states. The proposed method, on the other hand, simply attaches a camera to the human head and enables the recognition of the subject's actions. Consequently, it becomes easier to monitor daily movements of a human and gather his/her data on body kinetics. This approach would be beneficial in scenarios involving individuals engaging in risky behavior or, during a certain emergency, providing valuable assistance. Keywords: My VISION, Posture estimation, Optical flow, HSV conversion

Kyutacar

Supporting Safe Walk of a Visually Impaired Person at a Station Platform Based on MY VISION 査読有り 国際誌

Shintaro Yamada, Yui Tanjo, Seiji Ishikawa

The 2024 International Conference on Artificial Life and Robotics ( Robot Artificial Life Society )   983 - 986   2024年02月

　詳細を見る

担当区分：責任著者   記述言語：英語   掲載種別：研究論文（国際会議プロシーディングス）

Japan   Oita   2024年02月22日  -  2024年02月25日

When individuals with visual impairment go out, public transportation such as trains and buses is commonly used. However, many of them experience accidents, such as falling from train platforms or tripping due to unexpected contact with other passengers. To solve this problem, we propose a method using the MY VISION system which detects obstacles that may pose risks to individuals with visual impairment. The proposed method detects obstacles such as passengers’ pillars and platform edges at train stations. We employ an RGB-D camera for capturing frontal views of a user, use depth images to detect the edge of obstacles and level differences, and give warning to the visually impaired user based on the distance between him/her and the detected obstacle. Experimental results show satisfactory performance of the method.

Keywords: Visually impaired, Safety, Train station platform, Obstacles detection, MY VISION

Kyutacar

A Method of Improving the QOL of the People with Visual Impairment by MY VISION 査読有り 国際誌

Kitazumi S., Tanjo Y.

Proceedings of International Conference on Artificial Life and Robotics   964 - 968   2024年02月

　詳細を見る

担当区分：最終著者,　責任著者   記述言語：英語   掲載種別：研究論文（国際会議プロシーディングス）

Visually impaired people face several difficulties in indoor activities, such as spending excessive time in locating objects. This paper proposes a method for assisting object acquisition by detecting desired objects and guiding users to them. The method requests a user to express the object he/she wants to acquire verbally and utilizes speech recognition to detect the specified object. Subsequently, the system guides in voice the user's hand to the location of the desired object. The performance of the method is experimentally shown. The method contributes to enhancing the comfort of indoor activities of visually impaired and, in this way, improves their quality of life.

DOI： 10.5954/icarob.2024.gs2-4

Scopus

その他リンク： https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85190244511&origin=inward

Supporting Safe Walk of a Visually Impaired Person at a Station Platform Based on MY VISION 査読有り

Yamada S., Tanjo Y., Isihkawa S.

Proceedings of International Conference on Artificial Life and Robotics   983 - 986   2024年01月

　詳細を見る

担当区分：責任著者   記述言語：英語   掲載種別：研究論文（国際会議プロシーディングス）

When individuals with visual impairment go out, public transportation such as trains and buses is commonly used. However, many of them experience accidents, such as falling from train platforms or tripping due to unexpected contact with other passengers. To solve this problem, we propose a method using the MY VISION system which detects obstacles that may pose risks to individuals with visual impairment. The proposed method detects obstacles such as passengers’ pillars and platform edges at train stations. We employ an RGB-D camera for capturing frontal views of a user, use depth images to detect the edge of obstacles and level differences, and give warning to the visually impaired user based on the distance between him/her and the detected obstacle. Experimental results show satisfactory performance of the method.

Scopus

その他リンク： https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85190300416&origin=inward

Human Motion Recognition from Multiple Directions and Its Gait Cycles Analysis 査読有り

Ooba M., Tanjo Y.

Proceedings of International Conference on Artificial Life and Robotics   955 - 963   2024年01月

　詳細を見る

担当区分：最終著者,　責任著者   記述言語：英語   掲載種別：研究論文（国際会議プロシーディングス）

It is crucial for individuals to keep walking and stay healthy to prevent receiving nursing care. This paper proposes a method of recognizing walk motions and analyzing the gait cycle of a human focusing on his/her posture. We use 43structural features defined from human joint coordinates obtained using Open Pose and 18 figural features from human domain images and their difference images. The feature vector containing these 61 features is used for the recognition of walk motion by Random Forest. In the experiment, we applied the method to recognizing six types of motions and analyzed the walk gait cycles of five persons, and obtained satisfactory results.

Scopus

その他リンク： https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85190284561&origin=inward

Human Behavior Segmentation and Recognition Using a Single-camera 査読有り

Cao J., Tanjo Y.

Proceedings of International Conference on Artificial Life and Robotics   969 - 973   2024年01月

　詳細を見る

担当区分：最終著者,　責任著者   記述言語：英語   掲載種別：研究論文（国際会議プロシーディングス）

In recent years, elderly people living alone account for a large proportion of the elderly population, and the issue of safety has also been a matter of great concern for the public. Considering the importance of monitoring the behaviour and activities of the elderly and detecting abnormal movements, this paper proposes a method that can segment human behavior into each action and identify the action from the videos taken by a single camera. It uses features that can represent the shape of the human area in the depth direction, as well as the features such as motion direction and speed. The performance and effectiveness of the method are verified by experiments.

DOI： 10.5954/icarob.2024.gs2-5

Scopus

その他リンク： https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85190262285&origin=inward

A Method of Recognizing Body Movements Based on a Self-viewpoint Video 査読有り

Moribe I., Tanjo Y.

Proceedings of International Conference on Artificial Life and Robotics   979 - 982   2024年01月

　詳細を見る

担当区分：最終著者,　責任著者   記述言語：英語   掲載種別：研究論文（国際会議プロシーディングス）

The most critical human sensory function resides in vision. This paper focuses on utilizing visual information, specifically self-perspective footage, to identify individual movements. Existing researches require third-party filming to recognize human body movements and states. The proposed method, on the other hand, simply attaches a camera to the human head and enables the recognition of the subject's actions. Consequently, it becomes easier to monitor daily movements of a human and gather his/her data on body kinetics. This approach would be beneficial in scenarios involving individuals engaging in risky behavior or, during a certain emergency, providing valuable assistance.

Scopus

その他リンク： https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85190274181&origin=inward

3D Point Cloud Registration and Segmentation of Reflective Metal Objects Using Go-ICP and Improved RANSAC 査読有り 国際誌

Kairi Morita, Ziyue Liu, Jing Cao, Joo Kooi Tan

The 2023 International Conference on Artificial Life and Robotics ( Robot Artificial Life Society )   880 - 885   2023年02月

　詳細を見る

担当区分：責任著者   記述言語：英語   掲載種別：研究論文（国際会議プロシーディングス）

Japan   Oita   2023年02月09日  -  2023年02月12日

Registration and segmentation of 3D data are necessary in many fields, such as factory automation, automated driving, or even in the medical field. However, the technique is generally applied to non-metal objects. One of the problems of registration of a metal object is that the point clouds representing a metal object contain many outliers and missing points because of its reflective nature. This makes the accuracy of the registration and segmentation degrade. In this paper, we propose registration and segmentation techniques that are robust to outliers. For registration, we use the globally optimal Go-ICP (Global optimal - Iterative Closest Point) algorithm considering the goodness of a combination of point cloud sets to escape from convergence to a local solution. In segmentation, we address the problem of RANSAC generating false segments consisting of nearly identical multiple planar points and introduce an improved RANSAC. We use three kinds of the metal tray to show the effectiveness of the proposed technique.

Development of a Safe Walking Assistance System for Visually Impaired Persons Using MY VISION ― Estimation of a Safe Passage from Sidewalk Information Based on Transfer Learning of VGG-16 Network 査読有り 国際誌

Takumi Yokote, Joo Kooi Tan

The 2023 International Conference on Artificial Life and Robotics ( Robot Artificial Life Society )   886 - 889   2023年02月

　詳細を見る

担当区分：責任著者   記述言語：英語   掲載種別：研究論文（国際会議プロシーディングス）

Japan   Oita   2023年02月09日  -  2023年02月12日

In recent years, the number of visually impaired persons has been increasing year by year, and outdoor accidents have also been increasing when they go out. It is difficult to detect hazards on sidewalks even with a currently popular technique, such as a semantic segmentation technique or YOLO, because sidewalk situations are complicated and change frequently. For this reason, we propose a method of recognizing sidewalk situations from a self-viewpoint video called MY VISION. Conventional methods detect objects surrounding the sidewalk by learning the objects’ features beforehand and guiding visually impaired persons according to the position/direction of the detected object. The proposed method neither learns objects nor detects objects. We focus on sidewalk situations and use a multi-class classification technique based on transfer learning of VGG-16 to guide visually impaired persons’ walk according to three kinds of sidewalk information to ensure more safety. The effectiveness of the proposed method was confirmed by experiments.

Kyutacar

Detection of Fallen Persons and Person Shadows from Drone Images 査読有り 国際誌

Taisei Ono, Haruka Egawa, Yuta Ono, Seiji Ishikawa, Joo Kooi Tan

The 2023 International Conference on Artificial Life and Robotics ( Robot Artificial Life Society )   890 - 894   2023年02月

　詳細を見る

担当区分：責任著者   記述言語：英語   掲載種別：研究論文（国際会議プロシーディングス）

Japan   Oita   2023年02月09日  -  2023年02月12日

In recent years, the development of automatic search methods based on aerial images taken by drones has been attracting attention in order to prevent secondary disasters and to perform rescue operations quickly in the search for victims of natural disasters. Although various methods exist for automatic person detection for search, they are based on the assumption that the background area of a person captured by a drone camera is a uniform ground in which only those persons who require rescue exist without any shadows or trees. In this paper, we propose a method of automatic detection of both fallen persons and person shadows, or trees on the ground. The method is combination of Ri-HOG and Ri-LBP features to search for fallen persons. These features are robust to rotation. We then employ GrabCut and brightness values to detect shadows. The effectiveness of the proposed method was verified by experiment.

Kyutacar

Recognition of Human Walking Motion Using a Wearable Camera 査読有り 国際誌

Ziyue Liu, Tomoyuki Kurosaki, Joo Kooi Tan

ACM Proceedings of the 2022 International Conference on Computing and Pattern Recognition ( Association for Computing Machinery(ACM) )   7 - 13   2022年10月

　詳細を見る

担当区分：責任著者   記述言語：英語   掲載種別：研究論文（国際会議プロシーディングス）

China   Beijing   2022年11月17日  -  2022年11月19日

Supporting Safe Walk of a Visually Impaired Person at a Railway Station Platform Based on MY VISION 査読有り 国際誌

Yuki Kawaguchi, Seiji Ishikawa,Takashi Shinimiya Joo Kooi Tan

Proc. of The 2022 International Conference on Artificial Life and Robotics (ICAROB2022) ( Artificial Life and Robotics (ICAROB) )   1 - 4   2022年01月

　詳細を見る

担当区分：責任著者   記述言語：英語   掲載種別：研究論文（国際会議プロシーディングス）

Japan   Online   2022年01月21日  -  2022年01月23日

For a visually impaired person, platforms of railway station are places where there is a risk of falling. This paper proposes a system that prevents fall of a visually impaired person from the platform by use of self-viewpoint images provided from MY VISION, an ego camera system attached to a user. The edges of the platform are detected by region segmentation and line segment detection on the self-viewpoint images. The performance of the proposed system was experimentally examined and satisfactory results were obtained.

Kyutacar

Detecting a Pedestrian’s Walk Direction Using MY VISION for Supporting Safe Walk of a Visually Impaired Person 査読有り 国際誌

Shinya Iizumi, Joo Kooi Tan, others

Proceedings of the 2022 International Conference on Artificial Life and Robotics   1 - 4   2022年01月

　詳細を見る

担当区分：責任著者   記述言語：英語   掲載種別：研究論文（学術雑誌）

In this paper, we propose a method of recognizing multiple objects using MSC-HOG (Multiple-Scale-Cell Histograms of Oriented Gradients) features and intensity models of both pedestrians and bicyclists. We also propose a method of detecting approaching passersby using different discriminators without using time-series information such as Optical Flow. The effectiveness of the proposed method is verified by experiments.

A Method of Navigating a Visually Impaired Person Using MY VISION 査読有り 国際誌

Tan Joo Kooi, Kitagawa Kohei

Journal of Robotics, Networking and Artificial Life ( 株式会社 ALife Robotics )   9 ( 1 )   25 - 30   2022年01月

　詳細を見る

担当区分：筆頭著者,　責任著者   記述言語：英語   掲載種別：研究論文（学術雑誌）

This paper describes a method of navigating a visually impaired person who walks on a sidewalk and goes through a pedestrian crossing by the use of an ego-camera system named MY VISION. The proposed method finds a walkable region on the sidewalk. Thus, at a pedestrian crossing, it finds a traffic light and judges an appropriate timing to cross the road by analyzing the color and flashing status of the signal. The walkable region is found employing Graph- Based Segmentation (GBS), and once a pedestrian crossing is reached through the use of a GPS signal, a traffic light is detected by use of the HOG feature and Random Forest. The effectiveness of the proposed method was verified by experiments. This implies usefulness of a MY VISION system

DOI： 10.57417/jrnal.9.1_25

Scopus

CiNii Research

その他リンク： https://kyutech.repo.nii.ac.jp/records/7705

3-D recovery of a non-rigid object from a single camera view by piecewise recovery and synthesis 査読有り

Ishikawa S., Tan J. K., Kim H., Ishikawa S.

Proc. of the 21st Int. Conf. on Pattern Recognition (ICPR2012)   1443 - 1446   2012年11月

　詳細を見る

担当区分：責任著者   記述言語：英語   掲載種別：研究論文（国際会議プロシーディングス）

Japan   Tsukuba   2012年11月11日  -  2012年11月15日

Obstacles extraction using a moving camera 査読有り

Qian S., Tan J. K., Kim H., Ishikawa S.

Proc. of Asian Conf. on Computer Vision (ACCV2012)   USB:1 - USB:12   USB: 12Pages   2012年11月

　詳細を見る

担当区分：責任著者   記述言語：英語   掲載種別：研究論文（国際会議プロシーディングス）

Korea   Daejeon   2012年11月05日  -  2012年11月09日

DOI： 10.1007/978-3-642-37484-5_36

Scopus

Motion history image: Its variants and applications 査読有り

Ahad, M.A.R, Tan, J. K., Kim, H., Ishikawa S

Machine Vision and Applications, SpringerLink   23 ( 2 )   255 - 281   2012年03月

　詳細を見る

担当区分：責任著者   記述言語：英語   掲載種別：研究論文（学術雑誌）

DOI： 10.1007/s00138-010-0298-4

Scopus

Moving objects segmentation at a traffic junction from vehicular vision 査読有り 国際誌

Joo Kooi Tan,Seiji Ishikawa,Shin-ichiro Sonoda,Makoto Miyoshi,Takashi Morie

ECTI Transactions on Computer and Information Technology   5 ( 2 )   73 - 88   2011年11月

　詳細を見る

担当区分：責任著者   記述言語：英語   掲載種別：研究論文（学術雑誌）

Kyutacar

Development of a Safe Walking Assistance System for Visually Impaired Persons Using MY VISION ― Estimation of a Safe Passage from Sidewalk Information Based on Transfer Learning of VGG-16 Network 査読有り

Yokote T., Tan J.K.

Proceedings of International Conference on Artificial Life and Robotics   894 - 898   2023年01月

　詳細を見る

担当区分：最終著者,　責任著者   記述言語：英語   掲載種別：研究論文（国際会議プロシーディングス）

In recent years, the number of visually impaired persons has been increasing year by year, and outdoor accidents have also been increasing when they go out. It is difficult to detect hazards on sidewalks even with a currently popular technique, such as a semantic segmentation technique or YOLO, because sidewalk situations are complicated and change frequently. For this reason, we propose a method of recognizing sidewalk situations from a self-viewpoint video called MY VISION. Conventional methods detect objects surrounding the sidewalk by learning the objects’ features beforehand and guiding visually impaired persons according to the position/direction of the detected object. The proposed method neither learns objects nor detects objects. We focus on sidewalk situations and use a multi-class classification technique based on transfer learning of VGG-16 to guide visually impaired persons’ walk according to three kinds of sidewalk information to ensure more safety. The effectiveness of the proposed method was confirmed by experiments.

Scopus

その他リンク： https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85149473680&origin=inward