Welcome!

News Feed Item

Fujitsu Develops Data-Transfer Acceleration Technology

Applicable to various types of network environments; data deduplication and compression enable up to 10 times improvement of throughput with only software

Tokyo, Apr 8, 2014 - (JCN Newswire) - Fujitsu Laboratories Ltd. today announced the development of a technology for accelerating data transfer speeds that can be applied to various types of network environments used for cloud, mobile applications and other services.

Companies are today increasingly positioning their business systems in the cloud and consolidating their servers into datacenters. This is driving rapid growth in data transfer volume between multiple datacenters as well as datacenters and end-user equipment. While specialized hardware or network upgrades could speed up transfers, these are expensive approaches and cannot be easily deployed in cloud, virtual or mobile environments.

Fujitsu Laboratories has now developed a technology that uses data deduplication and compression to reduce the volume of data transfers, enabling dramatically greater data transfer speeds with only software. This technology can increase effective data-transfer rates by 10 times without the added cost of network upgrades, and can boost transfer speeds in a wide range of network environments between cloud datacenters and end-user equipment.

This technology will be exhibited at Fujitsu Forum 2014, running May 15-16 at Tokyo International Forum in Tokyo.

Background

The popularity of cloud services and mobile devices is leading to ever-more applications available over networks that use a variety of communications environments. Every day, companies use datacenters for file transfers, file sharing, backups, and distributing data to mobile devices. Given that the volume of data transfers is expanding daily, there is a growing need to inexpensively accelerate data speeds without network upgrades or deployment of specialized equipment.

Issues

Previously, Fujitsu Laboratories conducted R&D on high-speed protocols as a way to accelerate data transfers. This is an effective method when a network's bandwidth is not being used to its full capacity. However, when bandwidth is fully utilized, solving problems such as network delays required network upgrades.

In order to accelerate transfers without upgrading networks, another effective approach is to reduce the volume of data being transferred. There are two techniques for doing this. One is data deduplication, where both sender and recipient save copies of data so that duplicated data transmission can be eliminated. The other is to compress data using file-compression technology. Data deduplication and compression technologies are already used in storage systems and specialized hardware for accelerating data transfers, and are effective in accelerating transfer rates. But implementing these technologies in software so that they can be used with mobile devices, for example, poses the following problems:

- Data deduplication relies on both sender and recipient to save copies of data, and this is difficult to implement on mobile devices that have limited storage capacity.
- Both deduplication and compression are processor-intensive, and on mobile devices that have limited CPU power, these techniques can slow down effective transfer rates.

About the Technology

Fujitsu has now developed high-speed data transfer technology that can effectively boost data transfer speeds even on mobile devices, using software to cut data volumes, leveraging data deduplication and compression technologies. Features of the technology are as follows.

1. High deduplication performance by minimizing storage requirement

Fujitsu Laboratories has developed a technology that selects data that appears with high statistical frequency on the network and prioritizes it for saving. This maintains high deduplication performance while reducing the volume of low-frequency data being saved, so that the limited memory on mobile devices can be used more effectively. In internal testing, this was found to reduce the volume of duplicate data saved in the mobile device's storage by as much as 80%.

2. Lightweight data compression technology

Fujitsu Laboratories has developed a technology that reduces the CPU load imposed by the compression process to as little as one-fourth the level of conventional technologies. This technology searches for repeating patterns that appear within the data. When no pattern is found, it searches at longer intervals. When a pattern is found, data in close proximity is searched in particular detail. This results in efficient searching overall, while greatly reducing the time required for compression.

3. Automatic selection technology for operational improvements

Deduplication and compression of transfer data will at times lower data transfer rates when the size of data to be transferred is small and duplication is rarely found on the data. The net effectiveness of these techniques depends on data size, available network bandwidth, and CPU power. This technology will therefore periodically evaluate these parameters, assess the acceleration benefits, and determine whether deduplication or compression will be effective in practice. This frees system administrators from needing to configure settings for every deployed environment and improves operations.

Results

This newly developed technology is expected to lead to easier use of a variety of network applications in the cloud, and in virtual and mobile environments that are anticipated to continue to become more prevalent. This technology being available as software means that it can be integrated into existing servers and operating systems to bring its benefits to notebook computers, tablets, smartphones, and other mobile devices.

In one possible scenario, a salesman visiting Company A would download sales materials for Company A from headquarters, and then when visiting Company B would download slightly different sales materials for Company B. The parts of these materials that are the same would not need to be re-downloaded, effectively increasing download speeds. Over a 10 Mbps connection of available bandwidth, this has been shown to increase effective transfer rates 10 times.

Future Plans

Fujitsu Laboratories will be conducting practical testing of this technology with the goal of commercializing during fiscal 2014. This will contribute to greater quality with everything from datacenters on wide-area networks to end users on mobile devices.

About Fujitsu Limited

Fujitsu is the leading Japanese information and communication technology (ICT) company offering a full range of technology products, solutions and services. Approximately 170,000 Fujitsu people support customers in more than 100 countries. We use our experience and the power of ICT to shape the future of society with our customers. Fujitsu Limited (TSE: 6702) reported consolidated revenues of 4.4 trillion yen (US$47 billion) for the fiscal year ended March 31, 2013 For more information, please see www.fujitsu.com.



Source: Fujitsu Limited

Contact:
Fujitsu Limited
Public and Investor Relations
www.fujitsu.com/global/news/contacts/
+81-3-3215-5259


Copyright 2014 JCN Newswire. All rights reserved. www.japancorp.net

More Stories By JCN Newswire

Copyright 2008 JCN Newswire. All rights reserved. Republication or redistribution of JCN Newswire content is expressly prohibited without the prior written consent of JCN Newswire. JCN Newswire shall not be liable for any errors or delays in the content, or for any actions taken in reliance thereon.

Latest Stories
Interested in leveling up on your Cloud Foundry skills? Join IBM for Cloud Foundry Days on June 7 at Cloud Expo New York at the Javits Center in New York City. Cloud Foundry Days is a free half day educational conference and networking event. Come find out why Cloud Foundry is the industry's fastest-growing and most adopted cloud application platform.
For financial firms, the cloud is going to increasingly become a crucial part of dealing with customers over the next five years and beyond, particularly with the growing use and acceptance of virtual currencies. There are new data storage paradigms on the horizon that will deliver secure solutions for storing and moving sensitive financial data around the world without touching terrestrial networks. In his session at 20th Cloud Expo, Cliff Beek, President of Cloud Constellation Corporation, w...
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm. In his Day 3 Keynote at 20th Cloud Expo, Chris Brown, a Solutions Marketing Manager at Nutanix, will explore t...
As enterprise cloud becomes the norm, businesses and government programs must address compounded regulatory compliance related to data privacy and information protection. The most recent, Controlled Unclassified Information and the EU’s GDPR have board level implications and companies still struggle with demonstrating due diligence. Developers and DevOps leaders, as part of the pre-planning process and the associated supply chain, could benefit from updating their code libraries and design by in...
Regardless of what business you’re in, it’s increasingly a software-driven business. Consumers’ rising expectations for connected digital and physical experiences are driving what some are calling the "Customer Experience Challenge.” In his session at @DevOpsSummit at 20th Cloud Expo, Marco Morales, Director of Global Solutions at CollabNet, will discuss how organizations are increasingly adopting a discipline of Value Stream Mapping to ensure that the software they are producing is poised to o...
You know you need the cloud, but you’re hesitant to simply dump everything at Amazon since you know that not all workloads are suitable for cloud. You know that you want the kind of ease of use and scalability that you get with public cloud, but your applications are architected in a way that makes the public cloud a non-starter. You’re looking at private cloud solutions based on hyperconverged infrastructure, but you’re concerned with the limits inherent in those technologies.
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend @CloudExpo | @ThingsExpo, June 6-8, 2017, at the Javits Center in New York City, NY and October 31 - November 2, 2017, Santa Clara Convention Center, CA. Learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
In order to meet the rapidly changing demands of today’s customers, companies are continually forced to redefine their business strategies in order to meet these needs, stay relevant and continue to see profitable growth. IoT deployment and development is integral in this transformation, and today businesses are increasingly seeing the value of investing their resources into IoT deployments. These technologies are able increase ROI through projects such as connecting supply chains or enabling sm...
Cloud applications are seeing a deluge of requests to support the exploding advanced analytics market. “Open analytics” is the emerging strategy to deliver that data through an open data access layer, in the cloud, to be directly consumed by external analytics tools and popular programming languages. An increasing number of data engineers and data scientists use a variety of platforms and advanced analytics languages such as SAS, R, Python and Java, as well as frameworks such as Hadoop and Spark...
IBM helps FinTechs and financial services companies build and monetize cognitive-enabled financial services apps quickly and at scale. Hosted on IBM Bluemix, IBM’s platform builds in customer insights, regulatory compliance analytics and security to help reduce development time and testing. In his session at 20th Cloud Expo, Tom Eck, Industry Platforms CTO at IBM Cloud, will discuss how these tools simplify the time-consuming tasks of selection, mapping and data integration, allowing developers ...
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm.
SYS-CON Events announced today that Outscale, a global pure play Infrastructure as a Service provider and strategic partner of Dassault Systèmes, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Founded in 2010, Outscale simplifies infrastructure complexities and boosts the business agility of its customers. Outscale delivers a secure, reliable and industrial strength solution for its customers, which in...
SYS-CON Events announced today that Progress, a global leader in application development, has been named “Bronze Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Enterprises today are rapidly adopting the cloud, while continuing to retain business-critical/sensitive data inside the firewall. This is creating two separate data silos – one inside the firewall and the other outside the firewall. Cloud ISVs ofte...
In his session at 20th Cloud Expo, Brad Winett, Senior Technologist for DDN Storage, will present several current, end-user environments that are using object storage at scale for cloud deployments including private cloud and cloud providers. Details on the top considerations of features and functions for selecting object storage will be included. Brad will also touch on recent developments in tiering technologies that deliver single solution and an end-user view of data across files and objects...
SYS-CON Events announced today that Tintri, Inc, a leading provider of enterprise cloud infrastructure, will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Tintri offers an enterprise cloud platform built with public cloud-like web services and RESTful APIs. Organizations use Tintri all-flash storage with scale-out and automation as a foundation for their own clouds – to build agile development environments...