Welcome!

News Feed Item

Fujitsu Develops Data-Transfer Acceleration Technology

Applicable to various types of network environments; data deduplication and compression enable up to 10 times improvement of throughput with only software

Tokyo, Apr 8, 2014 - (JCN Newswire) - Fujitsu Laboratories Ltd. today announced the development of a technology for accelerating data transfer speeds that can be applied to various types of network environments used for cloud, mobile applications and other services.

Companies are today increasingly positioning their business systems in the cloud and consolidating their servers into datacenters. This is driving rapid growth in data transfer volume between multiple datacenters as well as datacenters and end-user equipment. While specialized hardware or network upgrades could speed up transfers, these are expensive approaches and cannot be easily deployed in cloud, virtual or mobile environments.

Fujitsu Laboratories has now developed a technology that uses data deduplication and compression to reduce the volume of data transfers, enabling dramatically greater data transfer speeds with only software. This technology can increase effective data-transfer rates by 10 times without the added cost of network upgrades, and can boost transfer speeds in a wide range of network environments between cloud datacenters and end-user equipment.

This technology will be exhibited at Fujitsu Forum 2014, running May 15-16 at Tokyo International Forum in Tokyo.

Background

The popularity of cloud services and mobile devices is leading to ever-more applications available over networks that use a variety of communications environments. Every day, companies use datacenters for file transfers, file sharing, backups, and distributing data to mobile devices. Given that the volume of data transfers is expanding daily, there is a growing need to inexpensively accelerate data speeds without network upgrades or deployment of specialized equipment.

Issues

Previously, Fujitsu Laboratories conducted R&D on high-speed protocols as a way to accelerate data transfers. This is an effective method when a network's bandwidth is not being used to its full capacity. However, when bandwidth is fully utilized, solving problems such as network delays required network upgrades.

In order to accelerate transfers without upgrading networks, another effective approach is to reduce the volume of data being transferred. There are two techniques for doing this. One is data deduplication, where both sender and recipient save copies of data so that duplicated data transmission can be eliminated. The other is to compress data using file-compression technology. Data deduplication and compression technologies are already used in storage systems and specialized hardware for accelerating data transfers, and are effective in accelerating transfer rates. But implementing these technologies in software so that they can be used with mobile devices, for example, poses the following problems:

- Data deduplication relies on both sender and recipient to save copies of data, and this is difficult to implement on mobile devices that have limited storage capacity.
- Both deduplication and compression are processor-intensive, and on mobile devices that have limited CPU power, these techniques can slow down effective transfer rates.

About the Technology

Fujitsu has now developed high-speed data transfer technology that can effectively boost data transfer speeds even on mobile devices, using software to cut data volumes, leveraging data deduplication and compression technologies. Features of the technology are as follows.

1. High deduplication performance by minimizing storage requirement

Fujitsu Laboratories has developed a technology that selects data that appears with high statistical frequency on the network and prioritizes it for saving. This maintains high deduplication performance while reducing the volume of low-frequency data being saved, so that the limited memory on mobile devices can be used more effectively. In internal testing, this was found to reduce the volume of duplicate data saved in the mobile device's storage by as much as 80%.

2. Lightweight data compression technology

Fujitsu Laboratories has developed a technology that reduces the CPU load imposed by the compression process to as little as one-fourth the level of conventional technologies. This technology searches for repeating patterns that appear within the data. When no pattern is found, it searches at longer intervals. When a pattern is found, data in close proximity is searched in particular detail. This results in efficient searching overall, while greatly reducing the time required for compression.

3. Automatic selection technology for operational improvements

Deduplication and compression of transfer data will at times lower data transfer rates when the size of data to be transferred is small and duplication is rarely found on the data. The net effectiveness of these techniques depends on data size, available network bandwidth, and CPU power. This technology will therefore periodically evaluate these parameters, assess the acceleration benefits, and determine whether deduplication or compression will be effective in practice. This frees system administrators from needing to configure settings for every deployed environment and improves operations.

Results

This newly developed technology is expected to lead to easier use of a variety of network applications in the cloud, and in virtual and mobile environments that are anticipated to continue to become more prevalent. This technology being available as software means that it can be integrated into existing servers and operating systems to bring its benefits to notebook computers, tablets, smartphones, and other mobile devices.

In one possible scenario, a salesman visiting Company A would download sales materials for Company A from headquarters, and then when visiting Company B would download slightly different sales materials for Company B. The parts of these materials that are the same would not need to be re-downloaded, effectively increasing download speeds. Over a 10 Mbps connection of available bandwidth, this has been shown to increase effective transfer rates 10 times.

Future Plans

Fujitsu Laboratories will be conducting practical testing of this technology with the goal of commercializing during fiscal 2014. This will contribute to greater quality with everything from datacenters on wide-area networks to end users on mobile devices.

About Fujitsu Limited

Fujitsu is the leading Japanese information and communication technology (ICT) company offering a full range of technology products, solutions and services. Approximately 170,000 Fujitsu people support customers in more than 100 countries. We use our experience and the power of ICT to shape the future of society with our customers. Fujitsu Limited (TSE: 6702) reported consolidated revenues of 4.4 trillion yen (US$47 billion) for the fiscal year ended March 31, 2013 For more information, please see www.fujitsu.com.



Source: Fujitsu Limited

Contact:
Fujitsu Limited
Public and Investor Relations
www.fujitsu.com/global/news/contacts/
+81-3-3215-5259


Copyright 2014 JCN Newswire. All rights reserved. www.japancorp.net

More Stories By JCN Newswire

Copyright 2008 JCN Newswire. All rights reserved. Republication or redistribution of JCN Newswire content is expressly prohibited without the prior written consent of JCN Newswire. JCN Newswire shall not be liable for any errors or delays in the content, or for any actions taken in reliance thereon.

Latest Stories
Get deep visibility into the performance of your databases and expert advice for performance optimization and tuning. You can't get application performance without database performance. Give everyone on the team a comprehensive view of how every aspect of the system affects performance across SQL database operations, host server and OS, virtualization resources and storage I/O. Quickly find bottlenecks and troubleshoot complex problems.
"Dice has been around for the last 20 years. We have been helping tech professionals find new jobs and career opportunities," explained Manish Dixit, VP of Product and Engineering at Dice, in this SYS-CON.tv interview at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
An IoT product’s log files speak volumes about what’s happening with your products in the field, pinpointing current and potential issues, and enabling you to predict failures and save millions of dollars in inventory. But until recently, no one knew how to listen. In his session at @ThingsExpo, Dan Gettens, Chief Research Officer at OnProcess, discussed recent research by Massachusetts Institute of Technology and OnProcess Technology, where MIT created a new, breakthrough analytics model for ...
Internet of @ThingsExpo has announced today that Chris Matthieu has been named tech chair of Internet of @ThingsExpo 2017 New York The 7th Internet of @ThingsExpo will take place on June 6-8, 2017, at the Javits Center in New York City, New York. Chris Matthieu is the co-founder and CTO of Octoblu, a revolutionary real-time IoT platform recently acquired by Citrix. Octoblu connects things, systems, people and clouds to a global mesh network allowing users to automate and control design flo...
SYS-CON Events has announced today that Roger Strukhoff has been named conference chair of Cloud Expo and @ThingsExpo 2017 New York. The 20th Cloud Expo and 7th @ThingsExpo will take place on June 6-8, 2017, at the Javits Center in New York City, NY. "The Internet of Things brings trillions of dollars of opportunity to developers and enterprise IT, no matter how you measure it," stated Roger Strukhoff. "More importantly, it leverages the power of devices and the Internet to enable us all to im...
Rapid innovation, changing business landscapes, and new IT demands force businesses to make changes quickly. In the eyes of many, containers are at the brink of becoming a pervasive technology in enterprise IT to accelerate application delivery. In this presentation, attendees learned about the: The transformation of IT to a DevOps, microservices, and container-based architecture What are containers and how DevOps practices can operate in a container-based environment A demonstration of how ...
"At ROHA we develop an app called Catcha. It was developed after we spent a year meeting with, talking to, interacting with senior citizens watching them use their smartphones and talking to them about how they use their smartphones so we could get to know their smartphone behavior," explained Dave Woods, Chief Innovation Officer at ROHA, in this SYS-CON.tv interview at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
DevOps is being widely accepted (if not fully adopted) as essential in enterprise IT. But as Enterprise DevOps gains maturity, expands scope, and increases velocity, the need for data-driven decisions across teams becomes more acute. DevOps teams in any modern business must wrangle the ‘digital exhaust’ from the delivery toolchain, "pervasive" and "cognitive" computing, APIs and services, mobile devices and applications, the Internet of Things, and now even blockchain. In this power panel at @...
Effectively SMBs and government programs must address compounded regulatory compliance requirements. The most recent are Controlled Unclassified Information and the EU's GDPR have Board Level implications. Managing sensitive data protection will likely result in acquisition criteria, demonstration requests and new requirements. Developers, as part of the pre-planning process and the associated supply chain, could benefit from updating their code libraries and design by incorporating changes. In...
"Venafi has a platform that allows you to manage, centralize and automate the complete life cycle of keys and certificates within the organization," explained Gina Osmond, Sr. Field Marketing Manager at Venafi, in this SYS-CON.tv interview at DevOps at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
"ReadyTalk is an audio and web video conferencing provider. We've really come to embrace WebRTC as the platform for our future of technology," explained Dan Cunningham, CTO of ReadyTalk, in this SYS-CON.tv interview at WebRTC Summit at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Financial Technology has become a topic of intense interest throughout the cloud developer and enterprise IT communities. Accordingly, attendees at the upcoming 20th Cloud Expo at the Javits Center in New York, June 6-8, 2017, will find fresh new content in a new track called FinTech.
Keeping pace with advancements in software delivery processes and tooling is taxing even for the most proficient organizations. Point tools, platforms, open source and the increasing adoption of private and public cloud services requires strong engineering rigor – all in the face of developer demands to use the tools of choice. As Agile has settled in as a mainstream practice, now DevOps has emerged as the next wave to improve software delivery speed and output. To make DevOps work, organization...
"Qosmos has launched L7Viewer, a network traffic analysis tool, so it analyzes all the traffic between the virtual machine and the data center and the virtual machine and the external world," stated Sebastien Synold, Product Line Manager at Qosmos, in this SYS-CON.tv interview at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.
Whether your IoT service is connecting cars, homes, appliances, wearable, cameras or other devices, one question hangs in the balance – how do you actually make money from this service? The ability to turn your IoT service into profit requires the ability to create a monetization strategy that is flexible, scalable and working for you in real-time. It must be a transparent, smoothly implemented strategy that all stakeholders – from customers to the board – will be able to understand and comprehe...