Welcome!

News Feed Item

Fujitsu Develops Data-Transfer Acceleration Technology

Applicable to various types of network environments; data deduplication and compression enable up to 10 times improvement of throughput with only software

Tokyo, Apr 8, 2014 - (JCN Newswire) - Fujitsu Laboratories Ltd. today announced the development of a technology for accelerating data transfer speeds that can be applied to various types of network environments used for cloud, mobile applications and other services.

Companies are today increasingly positioning their business systems in the cloud and consolidating their servers into datacenters. This is driving rapid growth in data transfer volume between multiple datacenters as well as datacenters and end-user equipment. While specialized hardware or network upgrades could speed up transfers, these are expensive approaches and cannot be easily deployed in cloud, virtual or mobile environments.

Fujitsu Laboratories has now developed a technology that uses data deduplication and compression to reduce the volume of data transfers, enabling dramatically greater data transfer speeds with only software. This technology can increase effective data-transfer rates by 10 times without the added cost of network upgrades, and can boost transfer speeds in a wide range of network environments between cloud datacenters and end-user equipment.

This technology will be exhibited at Fujitsu Forum 2014, running May 15-16 at Tokyo International Forum in Tokyo.

Background

The popularity of cloud services and mobile devices is leading to ever-more applications available over networks that use a variety of communications environments. Every day, companies use datacenters for file transfers, file sharing, backups, and distributing data to mobile devices. Given that the volume of data transfers is expanding daily, there is a growing need to inexpensively accelerate data speeds without network upgrades or deployment of specialized equipment.

Issues

Previously, Fujitsu Laboratories conducted R&D on high-speed protocols as a way to accelerate data transfers. This is an effective method when a network's bandwidth is not being used to its full capacity. However, when bandwidth is fully utilized, solving problems such as network delays required network upgrades.

In order to accelerate transfers without upgrading networks, another effective approach is to reduce the volume of data being transferred. There are two techniques for doing this. One is data deduplication, where both sender and recipient save copies of data so that duplicated data transmission can be eliminated. The other is to compress data using file-compression technology. Data deduplication and compression technologies are already used in storage systems and specialized hardware for accelerating data transfers, and are effective in accelerating transfer rates. But implementing these technologies in software so that they can be used with mobile devices, for example, poses the following problems:

- Data deduplication relies on both sender and recipient to save copies of data, and this is difficult to implement on mobile devices that have limited storage capacity.
- Both deduplication and compression are processor-intensive, and on mobile devices that have limited CPU power, these techniques can slow down effective transfer rates.

About the Technology

Fujitsu has now developed high-speed data transfer technology that can effectively boost data transfer speeds even on mobile devices, using software to cut data volumes, leveraging data deduplication and compression technologies. Features of the technology are as follows.

1. High deduplication performance by minimizing storage requirement

Fujitsu Laboratories has developed a technology that selects data that appears with high statistical frequency on the network and prioritizes it for saving. This maintains high deduplication performance while reducing the volume of low-frequency data being saved, so that the limited memory on mobile devices can be used more effectively. In internal testing, this was found to reduce the volume of duplicate data saved in the mobile device's storage by as much as 80%.

2. Lightweight data compression technology

Fujitsu Laboratories has developed a technology that reduces the CPU load imposed by the compression process to as little as one-fourth the level of conventional technologies. This technology searches for repeating patterns that appear within the data. When no pattern is found, it searches at longer intervals. When a pattern is found, data in close proximity is searched in particular detail. This results in efficient searching overall, while greatly reducing the time required for compression.

3. Automatic selection technology for operational improvements

Deduplication and compression of transfer data will at times lower data transfer rates when the size of data to be transferred is small and duplication is rarely found on the data. The net effectiveness of these techniques depends on data size, available network bandwidth, and CPU power. This technology will therefore periodically evaluate these parameters, assess the acceleration benefits, and determine whether deduplication or compression will be effective in practice. This frees system administrators from needing to configure settings for every deployed environment and improves operations.

Results

This newly developed technology is expected to lead to easier use of a variety of network applications in the cloud, and in virtual and mobile environments that are anticipated to continue to become more prevalent. This technology being available as software means that it can be integrated into existing servers and operating systems to bring its benefits to notebook computers, tablets, smartphones, and other mobile devices.

In one possible scenario, a salesman visiting Company A would download sales materials for Company A from headquarters, and then when visiting Company B would download slightly different sales materials for Company B. The parts of these materials that are the same would not need to be re-downloaded, effectively increasing download speeds. Over a 10 Mbps connection of available bandwidth, this has been shown to increase effective transfer rates 10 times.

Future Plans

Fujitsu Laboratories will be conducting practical testing of this technology with the goal of commercializing during fiscal 2014. This will contribute to greater quality with everything from datacenters on wide-area networks to end users on mobile devices.

About Fujitsu Limited

Fujitsu is the leading Japanese information and communication technology (ICT) company offering a full range of technology products, solutions and services. Approximately 170,000 Fujitsu people support customers in more than 100 countries. We use our experience and the power of ICT to shape the future of society with our customers. Fujitsu Limited (TSE: 6702) reported consolidated revenues of 4.4 trillion yen (US$47 billion) for the fiscal year ended March 31, 2013 For more information, please see www.fujitsu.com.



Source: Fujitsu Limited

Contact:
Fujitsu Limited
Public and Investor Relations
www.fujitsu.com/global/news/contacts/
+81-3-3215-5259


Copyright 2014 JCN Newswire. All rights reserved. www.japancorp.net

More Stories By JCN Newswire

Copyright 2008 JCN Newswire. All rights reserved. Republication or redistribution of JCN Newswire content is expressly prohibited without the prior written consent of JCN Newswire. JCN Newswire shall not be liable for any errors or delays in the content, or for any actions taken in reliance thereon.

Latest Stories
"The Striim platform is a full end-to-end streaming integration and analytics platform that is middleware that covers a lot of different use cases," explained Steve Wilkes, Founder and CTO at Striim, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
SYS-CON Events announced today that Calligo, an innovative cloud service provider offering mid-sized companies the highest levels of data privacy and security, has been named "Bronze Sponsor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Calligo offers unparalleled application performance guarantees, commercial flexibility and a personalised support service from its globally located cloud plat...
IoT is at the core or many Digital Transformation initiatives with the goal of re-inventing a company's business model. We all agree that collecting relevant IoT data will result in massive amounts of data needing to be stored. However, with the rapid development of IoT devices and ongoing business model transformation, we are not able to predict the volume and growth of IoT data. And with the lack of IoT history, traditional methods of IT and infrastructure planning based on the past do not app...
SYS-CON Events announced today that DXWorldExpo has been named “Global Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Digital Transformation is the key issue driving the global enterprise IT business. Digital Transformation is most prominent among Global 2000 enterprises and government institutions.
SYS-CON Events announced today that Datera, that offers a radically new data management architecture, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Datera is transforming the traditional datacenter model through modern cloud simplicity. The technology industry is at another major inflection point. The rise of mobile, the Internet of Things, data storage and Big...
With tough new regulations coming to Europe on data privacy in May 2018, Calligo will explain why in reality the effect is global and transforms how you consider critical data. EU GDPR fundamentally rewrites the rules for cloud, Big Data and IoT. In his session at 21st Cloud Expo, Adam Ryan, Vice President and General Manager EMEA at Calligo, will examine the regulations and provide insight on how it affects technology, challenges the established rules and will usher in new levels of diligence...
In his session at @ThingsExpo, Sudarshan Krishnamurthi, a Senior Manager, Business Strategy, at Cisco Systems, discussed how IT and operational technology (OT) work together, as opposed to being in separate siloes as once was traditional. Attendees learned how to fully leverage the power of IoT in their organization by bringing the two sides together and bridging the communication gap. He also looked at what good leadership must entail in order to accomplish this, and how IT managers can be the ...
DX World EXPO, LLC., a Lighthouse Point, Florida-based startup trade show producer and the creator of "DXWorldEXPO® - Digital Transformation Conference & Expo" has announced its executive management team. The team is headed by Levent Selamoglu, who has been named CEO. "Now is the time for a truly global DX event, to bring together the leading minds from the technology world in a conversation about Digital Transformation," he said in making the announcement.
As businesses adopt functionalities in cloud computing, it’s imperative that IT operations consistently ensure cloud systems work correctly – all of the time, and to their best capabilities. In his session at @BigDataExpo, Bernd Harzog, CEO and founder of OpsDataStore, presented an industry answer to the common question, “Are you running IT operations as efficiently and as cost effectively as you need to?” He then expounded on the industry issues he frequently came up against as an analyst, and ...
Everything run by electricity will eventually be connected to the Internet. Get ahead of the Internet of Things revolution and join Akvelon expert and IoT industry leader, Sergey Grebnov, in his session at @ThingsExpo, for an educational dive into the world of managing your home, workplace and all the devices they contain with the power of machine-based AI and intelligent Bot services for a completely streamlined experience.
SYS-CON Events announced today that SkyScale will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. SkyScale is a world-class provider of cloud-based, ultra-fast multi-GPU hardware platforms for lease to customers desiring the fastest performance available as a service anywhere in the world. SkyScale builds, configures, and manages dedicated systems strategically located in maximum-securit...
"Outscale was founded in 2010, is based in France, is a strategic partner to Dassault Systémes and has done quite a bit of work with divisions of Dassault," explained Jackie Funk, Digital Marketing exec at Outscale, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
In the enterprise today, connected IoT devices are everywhere – both inside and outside corporate environments. The need to identify, manage, control and secure a quickly growing web of connections and outside devices is making the already challenging task of security even more important, and onerous. In his session at @ThingsExpo, Rich Boyer, CISO and Chief Architect for Security at NTT i3, discussed new ways of thinking and the approaches needed to address the emerging challenges of security i...
"With Digital Experience Monitoring what used to be a simple visit to a web page has exploded into app on phones, data from social media feeds, competitive benchmarking - these are all components that are only available because of some type of digital asset," explained Leo Vasiliou, Director of Web Performance Engineering at Catchpoint Systems, in this SYS-CON.tv interview at DevOps Summit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"We were founded in 2003 and the way we were founded was about good backup and good disaster recovery for our clients, and for the last 20 years we've been pretty consistent with that," noted Marc Malafronte, Territory Manager at StorageCraft, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.