Click here to close now.


News Feed Item

Fujitsu Develops Technology to Recognize Patient Status Using a Camera

Lightens nursing workload in hospitals and care facilities

Tokyo, May 13, 2014 - (JCN Newswire) - Fujitsu Laboratories Ltd. announced the development of a technology that uses a camera to accurately recognize the status of patients, detecting activities such as sitting up in bed, getting out of bed, or moving in bed.

There are instances in which patients in hospitals or care facilities get out of bed to walk around without nurses realizing it, then slipping and falling. They may also be in too much pain to sleep, which nurses might be late to recognize. An existing technique that uses sensors to detect the pressure of bodyweight does not always work well, giving a false alarm response to a patient just turning over while sleeping. Therefore it requires nurses to make frequent checks.

Fujitsu Laboratories has developed a technology that recognizes and tracks the patient's head with a camera, accurately recognizing when the patient sits up or gets out of bed, and also a technology that visualizes patient behavior that demands wa nurse's attention.

These technologies help hospitals and care facilities provide a high level of patient protection while lightening the workload on nurses.

These technologies are being exhibited at Fujitsu Forum 2014, running May 15-16 at the Tokyo International Forum in Tokyo. Details of this technology are being presented at the SSII2014 Image Sensing Symposium, opening June 11 at Pacifico Yokohama.

A nurse will typically conduct rounds to check on patients at hospitals or care facilities, but patients can get out of bed and go wandering or slip and fall when the nurse's attention is focused elsewhere, or may be in too much pain to sleep. Sometimes it can take time before the nurse notices any of these situations.

The existing technique to detect when a patient has sat up or gotten out of bed relies on sensors that detect the pressure of bodyweight. But this approach has some problems. Sometimes patients will intentionally avoid the sensor so that it does not react when they get out of bed. In addition, the sensor cannot distinguish when the patient is turning over while sleeping, or when movements by the nurse are triggering it, resulting in false alarms as the sensor cannot identify the patient's actual status. Even with these sensors, nurses still need to make frequent checks, and if anything their workload may be higher.


Other than sensors that detect pressure and movement, one possible method is to use a camera to capture images of a patient, use existing object-recognition technologies to recognize the patient's head, recognize when the patient sits up or gets out of bed based on the head's position, and calculate the scale of movements on the bed to detect when the patient can sleep or not, or other movements. This could lighten the nurse's workload while providing 24-hour monitoring, but it presents the following issues.

1. Overlooking patient sitting up or getting out of bed due to poor head-recognition accuracy

Typical object-recognition technology is programmed with data on multiple heads as learned data so that it can recognize heads with different shapes, hairstyles, orientations, and expressions. The captured image of a head is compared to the learned data to pick the head out of the image, but in many cases, these technologies will mistakenly identify pillows and the like as heads, and overlook the patient sitting up or getting out of bed.

2. Unable to quickly apprise nurse of behaviors demanding attention (sleeplessness, restiveness)

Normal patient behavior will include movements like turning over while sleeping. Existing technology does not do a good job of distinguishing normal patient behaviors from those demanding a nurse's attention.

About the Technology

Fujitsu Laboratories has developed two technologies that, combined, make it possible to monitor patients visually. The first is a sensing technology that recognizes the patient's head and tracks it to recognize when the patient sits up or gets out of bed, which can be precursors to actions such as wandering or slipping or falling. The second is a technology that detects and visualizes conditions such as restiveness or sleeplessness, which demand further attention.
Increasing the detection accuracy of movements such as sitting up and getting out of bed, and of behaviors that demand attention, has made it possible to quickly grasp the patient's condition and lighten the nurse's workload.

Key features of the technologies are as follows

1. Selects learned data depending on patient states

The technology categorizes the state of a patient in bed into five categories depending on posture, and has defined a state-transition diagram that relates them. The appearance of the patient's head depends on which state the patient is in, so Fujitsu Laboratories defined the head detection area for each state, and generated learned data limited to the appearance of the head in those positions (such as orientation and size).

The recognition process also uses learned data where the next likely states are limited by the current state, based on the state-transition diagram. Selecting the learned data used in the recognition process in response to the patient's state results in highly accurate head recognition.

2. Reduces false positives using motion information

Even with the selection of learned data based on patient status, the potential remains to incorrectly recognize pillows as heads. To correct for that, the technology observes points that will always move when the patient sits up or stands up, and will identify multiple regions in the image that might be the head. It will then confirm if it really is the patient's head or not when its movement is considered to be sitting up or standing up. If the candidate never moves or the movement stops after confirmation, the process will return to what it considers to be the patient's head and continue measuring all items that are candidates for the head. This way, even if a pillow is incorrectly identified as a head, the fact that it will move in ways that differ from sitting up or standing up will quickly rule it out as a head, and when the patient moves, the correct candidate will be recognized.

3. Visualizes patient behaviors demanding attention
With advice from medical practitioners, Fujitsu Laboratories defined ordinary behaviors and those demanding attention as follows.

These two kinds of behavior are identified based on such factors as the magnitude and frequency of the patient's movements.

The visualization displays those patient movements that are judged to be departures from normal sleeping motions with dots, using color to indicate the magnitude of the movements from great to small, and increasing the size of the dot to indicate the frequency of the detected movement over a fixed period of time. This makes it easier to understand those patient behaviors demanding attention.


With the cooperation of Tamagawa Hospital(1) and the consent of patients and their families, Fujitsu Laboratories conducted a field trial to detect movements and visualize behaviors using this technology.

To test sensing of sitting up and getting out of bed, two patients were observed for four days each. Rising movements were observed over a total of 184 hours of observation using both the conventional pressure sensors and the new technology. The new technology was found to perform better.

For behavior visualization, three patients were observed over a total of 176 hours. The visualization of behaviors demanding attention was found to perform with 91% accuracy.

Results of this behavior visualization were displayed at the nursing station, allowing nurses to easily monitor patient movements without going on rounds, resulting in a high standard of patient protection for the hospital or care facility while lightening the workload on nurses.

Future Plans

Fujitsu Laboratories is working to link the patient-monitoring system to an emergency-alert system for nurses and electronic medical record system with a goal of commercial implementation in fiscal 2015. The company is also continuing to develop this technology with the aim of expanding its scope of application to include residential services for the elderly and other in-residence nursing and care.

(1) Tamagawa Hospital:
Official name "Nissan Tamagawa Hospital." Director: Akira Nakashima. Located in Setagaya-ku, Tokyo.

About Fujitsu Limited

Fujitsu is the leading Japanese information and communication technology (ICT) company offering a full range of technology products, solutions and services. Approximately 170,000 Fujitsu people support customers in more than 100 countries. We use our experience and the power of ICT to shape the future of society with our customers. Fujitsu Limited (TSE: 6702) reported consolidated revenues of 4.4 trillion yen (US$47 billion) for the fiscal year ended March 31, 2013 For more information, please see

Source: Fujitsu Limited

Fujitsu Limited
Public and Investor Relations

Copyright 2014 JCN Newswire. All rights reserved.

More Stories By JCN Newswire

Copyright 2008 JCN Newswire. All rights reserved. Republication or redistribution of JCN Newswire content is expressly prohibited without the prior written consent of JCN Newswire. JCN Newswire shall not be liable for any errors or delays in the content, or for any actions taken in reliance thereon.

Latest Stories
Just over a week ago I received a long and loud sustained applause for a presentation I delivered at this year’s Cloud Expo in Santa Clara. I was extremely pleased with the turnout and had some very good conversations with many of the attendees. Over the next few days I had many more meaningful conversations and was not only happy with the results but also learned a few new things. Here is everything I learned in those three days distilled into three short points.
As organizations realize the scope of the Internet of Things, gaining key insights from Big Data, through the use of advanced analytics, becomes crucial. However, IoT also creates the need for petabyte scale storage of data from millions of devices. A new type of Storage is required which seamlessly integrates robust data analytics with massive scale. These storage systems will act as “smart systems” provide in-place analytics that speed discovery and enable businesses to quickly derive meaningf...
DevOps is about increasing efficiency, but nothing is more inefficient than building the same application twice. However, this is a routine occurrence with enterprise applications that need both a rich desktop web interface and strong mobile support. With recent technological advances from Isomorphic Software and others, rich desktop and tuned mobile experiences can now be created with a single codebase – without compromising functionality, performance or usability. In his session at DevOps Su...
In his General Session at 17th Cloud Expo, Bruce Swann, Senior Product Marketing Manager for Adobe Campaign, explored the key ingredients of cross-channel marketing in a digital world. Learn how the Adobe Marketing Cloud can help marketers embrace opportunities for personalized, relevant and real-time customer engagement across offline (direct mail, point of sale, call center) and digital (email, website, SMS, mobile apps, social networks, connected objects).
The buzz continues for cloud, data analytics and the Internet of Things (IoT) and their collective impact across all industries. But a new conversation is emerging - how do companies use industry disruption and technology enablers to lead in markets undergoing change, uncertainty and ambiguity? Organizations of all sizes need to evolve and transform, often under massive pressure, as industry lines blur and merge and traditional business models are assaulted and turned upside down. In this new da...
In his General Session at DevOps Summit, Asaf Yigal, Co-Founder & VP of Product at, explored the value of Kibana 4 for log analysis and provided a hands-on tutorial on how to set up Kibana 4 and get the most out of Apache log files. He examined three use cases: IT operations, business intelligence, and security and compliance. Asaf Yigal is co-founder and VP of Product at log analytics software company In the past, he was co-founder of social-trading platform Currensee, which...
Two weeks ago (November 3-5), I attended the Cloud Expo Silicon Valley as a speaker, where I presented on the security and privacy due diligence requirements for cloud solutions. Cloud security is a topical issue for every CIO, CISO, and technology buyer. Decision-makers are always looking for insights on how to mitigate the security risks of implementing and using cloud solutions. Based on the presentation topics covered at the conference, as well as the general discussions heard between sessi...
The Internet of Everything is re-shaping technology trends–moving away from “request/response” architecture to an “always-on” Streaming Web where data is in constant motion and secure, reliable communication is an absolute necessity. As more and more THINGS go online, the challenges that developers will need to address will only increase exponentially. In his session at @ThingsExpo, Todd Greene, Founder & CEO of PubNub, exploreed the current state of IoT connectivity and review key trends and t...
Continuous processes around the development and deployment of applications are both impacted by -- and a benefit to -- the Internet of Things trend. To help better understand the relationship between DevOps and a plethora of new end-devices and data please welcome Gary Gruver, consultant, author and a former IT executive who has led many large-scale IT transformation projects, and John Jeremiah, Technology Evangelist at Hewlett Packard Enterprise (HPE), on Twitter at @j_jeremiah. The discussion...
Too often with compelling new technologies market participants become overly enamored with that attractiveness of the technology and neglect underlying business drivers. This tendency, what some call the “newest shiny object syndrome” is understandable given that virtually all of us are heavily engaged in technology. But it is also mistaken. Without concrete business cases driving its deployment, IoT, like many other technologies before it, will fade into obscurity.
In today's enterprise, digital transformation represents organizational change even more so than technology change, as customer preferences and behavior drive end-to-end transformation across lines of business as well as IT. To capitalize on the ubiquitous disruption driving this transformation, companies must be able to innovate at an increasingly rapid pace. Traditional approaches for driving innovation are now woefully inadequate for keeping up with the breadth of disruption and change facin...
The Internet of Things is clearly many things: data collection and analytics, wearables, Smart Grids and Smart Cities, the Industrial Internet, and more. Cool platforms like Arduino, Raspberry Pi, Intel's Galileo and Edison, and a diverse world of sensors are making the IoT a great toy box for developers in all these areas. In this Power Panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists discussed what things are the most important, which will have the most profound...
With all the incredible momentum behind the Internet of Things (IoT) industry, it is easy to forget that not a single CEO wakes up and wonders if “my IoT is broken.” What they wonder is if they are making the right decisions to do all they can to increase revenue, decrease costs, and improve customer experience – effectively the same challenges they have always had in growing their business. The exciting thing about the IoT industry is now these decisions can be better, faster, and smarter. Now ...
PubNub has announced the release of BLOCKS, a set of customizable microservices that give developers a simple way to add code and deploy features for realtime apps.PubNub BLOCKS executes business logic directly on the data streaming through PubNub’s network without splitting it off to an intermediary server controlled by the customer. This revolutionary approach streamlines app development, reduces endpoint-to-endpoint latency, and allows apps to better leverage the enormous scalability of PubNu...
I recently attended and was a speaker at the 4th International Internet of @ThingsExpo at the Santa Clara Convention Center. I also had the opportunity to attend this event last year and I wrote a blog from that show talking about how the “Enterprise Impact of IoT” was a key theme of last year’s show. I was curious to see if the same theme would still resonate 365 days later and what, if any, changes I would see in the content presented.