Welcome!

News Feed Item

Fujitsu Develops Technology to Recognize Patient Status Using a Camera

Lightens nursing workload in hospitals and care facilities

Tokyo, May 13, 2014 - (JCN Newswire) - Fujitsu Laboratories Ltd. announced the development of a technology that uses a camera to accurately recognize the status of patients, detecting activities such as sitting up in bed, getting out of bed, or moving in bed.

There are instances in which patients in hospitals or care facilities get out of bed to walk around without nurses realizing it, then slipping and falling. They may also be in too much pain to sleep, which nurses might be late to recognize. An existing technique that uses sensors to detect the pressure of bodyweight does not always work well, giving a false alarm response to a patient just turning over while sleeping. Therefore it requires nurses to make frequent checks.

Fujitsu Laboratories has developed a technology that recognizes and tracks the patient's head with a camera, accurately recognizing when the patient sits up or gets out of bed, and also a technology that visualizes patient behavior that demands wa nurse's attention.

These technologies help hospitals and care facilities provide a high level of patient protection while lightening the workload on nurses.

These technologies are being exhibited at Fujitsu Forum 2014, running May 15-16 at the Tokyo International Forum in Tokyo. Details of this technology are being presented at the SSII2014 Image Sensing Symposium, opening June 11 at Pacifico Yokohama.

Background
A nurse will typically conduct rounds to check on patients at hospitals or care facilities, but patients can get out of bed and go wandering or slip and fall when the nurse's attention is focused elsewhere, or may be in too much pain to sleep. Sometimes it can take time before the nurse notices any of these situations.

The existing technique to detect when a patient has sat up or gotten out of bed relies on sensors that detect the pressure of bodyweight. But this approach has some problems. Sometimes patients will intentionally avoid the sensor so that it does not react when they get out of bed. In addition, the sensor cannot distinguish when the patient is turning over while sleeping, or when movements by the nurse are triggering it, resulting in false alarms as the sensor cannot identify the patient's actual status. Even with these sensors, nurses still need to make frequent checks, and if anything their workload may be higher.

Issues

Other than sensors that detect pressure and movement, one possible method is to use a camera to capture images of a patient, use existing object-recognition technologies to recognize the patient's head, recognize when the patient sits up or gets out of bed based on the head's position, and calculate the scale of movements on the bed to detect when the patient can sleep or not, or other movements. This could lighten the nurse's workload while providing 24-hour monitoring, but it presents the following issues.

1. Overlooking patient sitting up or getting out of bed due to poor head-recognition accuracy

Typical object-recognition technology is programmed with data on multiple heads as learned data so that it can recognize heads with different shapes, hairstyles, orientations, and expressions. The captured image of a head is compared to the learned data to pick the head out of the image, but in many cases, these technologies will mistakenly identify pillows and the like as heads, and overlook the patient sitting up or getting out of bed.

2. Unable to quickly apprise nurse of behaviors demanding attention (sleeplessness, restiveness)

Normal patient behavior will include movements like turning over while sleeping. Existing technology does not do a good job of distinguishing normal patient behaviors from those demanding a nurse's attention.

About the Technology

Fujitsu Laboratories has developed two technologies that, combined, make it possible to monitor patients visually. The first is a sensing technology that recognizes the patient's head and tracks it to recognize when the patient sits up or gets out of bed, which can be precursors to actions such as wandering or slipping or falling. The second is a technology that detects and visualizes conditions such as restiveness or sleeplessness, which demand further attention.
Increasing the detection accuracy of movements such as sitting up and getting out of bed, and of behaviors that demand attention, has made it possible to quickly grasp the patient's condition and lighten the nurse's workload.

Key features of the technologies are as follows

1. Selects learned data depending on patient states

The technology categorizes the state of a patient in bed into five categories depending on posture, and has defined a state-transition diagram that relates them. The appearance of the patient's head depends on which state the patient is in, so Fujitsu Laboratories defined the head detection area for each state, and generated learned data limited to the appearance of the head in those positions (such as orientation and size).

The recognition process also uses learned data where the next likely states are limited by the current state, based on the state-transition diagram. Selecting the learned data used in the recognition process in response to the patient's state results in highly accurate head recognition.

2. Reduces false positives using motion information

Even with the selection of learned data based on patient status, the potential remains to incorrectly recognize pillows as heads. To correct for that, the technology observes points that will always move when the patient sits up or stands up, and will identify multiple regions in the image that might be the head. It will then confirm if it really is the patient's head or not when its movement is considered to be sitting up or standing up. If the candidate never moves or the movement stops after confirmation, the process will return to what it considers to be the patient's head and continue measuring all items that are candidates for the head. This way, even if a pillow is incorrectly identified as a head, the fact that it will move in ways that differ from sitting up or standing up will quickly rule it out as a head, and when the patient moves, the correct candidate will be recognized.

3. Visualizes patient behaviors demanding attention
With advice from medical practitioners, Fujitsu Laboratories defined ordinary behaviors and those demanding attention as follows.

These two kinds of behavior are identified based on such factors as the magnitude and frequency of the patient's movements.

The visualization displays those patient movements that are judged to be departures from normal sleeping motions with dots, using color to indicate the magnitude of the movements from great to small, and increasing the size of the dot to indicate the frequency of the detected movement over a fixed period of time. This makes it easier to understand those patient behaviors demanding attention.

Results

With the cooperation of Tamagawa Hospital(1) and the consent of patients and their families, Fujitsu Laboratories conducted a field trial to detect movements and visualize behaviors using this technology.

To test sensing of sitting up and getting out of bed, two patients were observed for four days each. Rising movements were observed over a total of 184 hours of observation using both the conventional pressure sensors and the new technology. The new technology was found to perform better.

For behavior visualization, three patients were observed over a total of 176 hours. The visualization of behaviors demanding attention was found to perform with 91% accuracy.

Results of this behavior visualization were displayed at the nursing station, allowing nurses to easily monitor patient movements without going on rounds, resulting in a high standard of patient protection for the hospital or care facility while lightening the workload on nurses.

Future Plans

Fujitsu Laboratories is working to link the patient-monitoring system to an emergency-alert system for nurses and electronic medical record system with a goal of commercial implementation in fiscal 2015. The company is also continuing to develop this technology with the aim of expanding its scope of application to include residential services for the elderly and other in-residence nursing and care.

Notes:
(1) Tamagawa Hospital:
Official name "Nissan Tamagawa Hospital." Director: Akira Nakashima. Located in Setagaya-ku, Tokyo.

About Fujitsu Limited

Fujitsu is the leading Japanese information and communication technology (ICT) company offering a full range of technology products, solutions and services. Approximately 170,000 Fujitsu people support customers in more than 100 countries. We use our experience and the power of ICT to shape the future of society with our customers. Fujitsu Limited (TSE: 6702) reported consolidated revenues of 4.4 trillion yen (US$47 billion) for the fiscal year ended March 31, 2013 For more information, please see www.fujitsu.com.



Source: Fujitsu Limited

Contact:
Fujitsu Limited
Public and Investor Relations
www.fujitsu.com/global/news/contacts/
+81-3-3215-5259


Copyright 2014 JCN Newswire. All rights reserved. www.japancorp.net

More Stories By JCN Newswire

Copyright 2008 JCN Newswire. All rights reserved. Republication or redistribution of JCN Newswire content is expressly prohibited without the prior written consent of JCN Newswire. JCN Newswire shall not be liable for any errors or delays in the content, or for any actions taken in reliance thereon.

Latest Stories
"We are an all-flash array storage provider but our focus has been on VM-aware storage specifically for virtualized applications," stated Dhiraj Sehgal of Tintri in this SYS-CON.tv interview at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Internet of @ThingsExpo has announced today that Chris Matthieu has been named tech chair of Internet of @ThingsExpo 2017 New York The 7th Internet of @ThingsExpo will take place on June 6-8, 2017, at the Javits Center in New York City, New York. Chris Matthieu is the co-founder and CTO of Octoblu, a revolutionary real-time IoT platform recently acquired by Citrix. Octoblu connects things, systems, people and clouds to a global mesh network allowing users to automate and control design flo...
In addition to all the benefits, IoT is also bringing new kind of customer experience challenges - cars that unlock themselves, thermostats turning houses into saunas and baby video monitors broadcasting over the internet. This list can only increase because while IoT services should be intuitive and simple to use, the delivery ecosystem is a myriad of potential problems as IoT explodes complexity. So finding a performance issue is like finding the proverbial needle in the haystack.
Between 2005 and 2020, data volumes will grow by a factor of 300 – enough data to stack CDs from the earth to the moon 162 times. This has come to be known as the ‘big data’ phenomenon. Unfortunately, traditional approaches to handling, storing and analyzing data aren’t adequate at this scale: they’re too costly, slow and physically cumbersome to keep up. Fortunately, in response a new breed of technology has emerged that is cheaper, faster and more scalable. Yet, in meeting these new needs they...
Data is the fuel that drives the machine learning algorithmic engines and ultimately provides the business value. In his session at 20th Cloud Expo, Ed Featherston, director/senior enterprise architect at Collaborative Consulting, will discuss the key considerations around quality, volume, timeliness, and pedigree that must be dealt with in order to properly fuel that engine.
According to Forrester Research, every business will become either a digital predator or digital prey by 2020. To avoid demise, organizations must rapidly create new sources of value in their end-to-end customer experiences. True digital predators also must break down information and process silos and extend digital transformation initiatives to empower employees with the digital resources needed to win, serve, and retain customers.
When it comes to cloud computing, the ability to turn massive amounts of compute cores on and off on demand sounds attractive to IT staff, who need to manage peaks and valleys in user activity. With cloud bursting, the majority of the data can stay on premises while tapping into compute from public cloud providers, reducing risk and minimizing need to move large files. In his session at 18th Cloud Expo, Scott Jeschonek, Director of Product Management at Avere Systems, discussed the IT and busin...
The WebRTC Summit New York, to be held June 6-8, 2017, at the Javits Center in New York City, NY, announces that its Call for Papers is now open. Topics include all aspects of improving IT delivery by eliminating waste through automated business models leveraging cloud technologies. WebRTC Summit is co-located with 20th International Cloud Expo and @ThingsExpo. WebRTC is the future of browser-to-browser communications, and continues to make inroads into the traditional, difficult, plug-in web co...
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
Get deep visibility into the performance of your databases and expert advice for performance optimization and tuning. You can't get application performance without database performance. Give everyone on the team a comprehensive view of how every aspect of the system affects performance across SQL database operations, host server and OS, virtualization resources and storage I/O. Quickly find bottlenecks and troubleshoot complex problems.
The Internet of Things (IoT) promises to simplify and streamline our lives by automating routine tasks that distract us from our goals. This promise is based on the ubiquitous deployment of smart, connected devices that link everything from industrial control systems to automobiles to refrigerators. Unfortunately, comparatively few of the devices currently deployed have been developed with an eye toward security, and as the DDoS attacks of late October 2016 have demonstrated, this oversight can ...
What happens when the different parts of a vehicle become smarter than the vehicle itself? As we move toward the era of smart everything, hundreds of entities in a vehicle that communicate with each other, the vehicle and external systems create a need for identity orchestration so that all entities work as a conglomerate. Much like an orchestra without a conductor, without the ability to secure, control, and connect the link between a vehicle’s head unit, devices, and systems and to manage the ...
"Once customers get a year into their IoT deployments, they start to realize that they may have been shortsighted in the ways they built out their deployment and the key thing I see a lot of people looking at is - how can I take equipment data, pull it back in an IoT solution and show it in a dashboard," stated Dave McCarthy, Director of Products at Bsquare Corporation, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Unsecured IoT devices were used to launch crippling DDOS attacks in October 2016, targeting services such as Twitter, Spotify, and GitHub. Subsequent testimony to Congress about potential attacks on office buildings, schools, and hospitals raised the possibility for the IoT to harm and even kill people. What should be done? Does the government need to intervene? This panel at @ThingExpo New York brings together leading IoT and security experts to discuss this very serious topic.
"We are the public cloud providers. We are currently providing 50% of the resources they need for doing e-commerce business in China and we are hosting about 60% of mobile gaming in China," explained Yi Zheng, CPO and VP of Engineering at CDS Global Cloud, in this SYS-CON.tv interview at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.