Friday, December 10, 2010

Musings on the future of data dedupe

December 10, 2010 – I recently chatted with a few vendors in the data deduplication space. As conversations often do at this time of year, the talk turned toward the future of data deduplication. Here are a few snippets.

“Tier 1 storage vendors will move past point solutions for deduplication next year,” says Tom Cook, CEO at Permabit. “They’re working toward end-to-end deduplication, across SAN, NAS, unified [block and file], nearline and backup.”


“When that happens, once their customers ingest data and get it into a deduplicated state they’ll never have to re-hydrate that data throughout its lifecycle. The data will stay deduplicated through processes such as replication and backup. That’s a huge savings in workflow, footprint and bandwidth,” say Cook.

“Today, the big vendors use a variety of point solutions, but they’d like to use a single data optimization product across all their platforms, whether it’s block or file, primary or secondary. End-to-end deduplication will creep into the market in 2011 and 2012,” Cook predicts. (Permabit sells deduplication software – dubbed Albireo – to OEMs.)

Personally, I don’t think that single-solution, end-to-end deduplication will happen that quickly, in part because of the huge investments that the Tier 1 vendors have made in their “point solutions,” but we’ll see.

Dennis Rolland, director of advanced technology at Sepaton, has some predictions that are similar to Cook’s, as well as some differing opinions regarding trends in the data deduplication market.

“Dedupe will be required in more places going forward, including primary storage in addition to nearline storage, and end users will have to cut down on how many dedupe solutions they have because of the complexity in managing many disparate solutions,” says Rolland, “but we’ll probably still have distinct solutions for primary and nearline storage deduplication.”

Rolland thinks that the emphasis on deduplication benefits such as capacity, footprint and cost savings is shifting. “Dedupe enables low-bandwidth replication, which in turn enables companies to economically deploy DR [disaster recovery] sites,” he says.

Rolland also links two technologies that will no doubt make my list of The Hottest Storage Technologies for 2011 (assuming I get around to making such a list): data deduplication and cloud storage.

“Dedupe is an enabler for cloud storage,” says Rolland. “It makes it practical to deploy cloud storage because you’re sending, say, 10x less data over the WAN. That has significant implications for deploying cloud-based DR.”

(Sepaton bundles data deduplication software with its virtual tape libraries, or VTLs.)

Meanwhile, Quantum released the results of an end-user survey this week that suggests U.S. companies could save $6 billion annually in file restore costs by adopting deduplication.

According to the survey of 300 IT professionals, respondents spend an average of 131 hours annually on file restore activities, with 65% restoring files at least once a week. Based on the average wage for IT professionals in the US ($31.55 per hour according to PayScale.com), that equates to $9.5 billion. However, Quantum’s survey also found that those companies that are most efficient at file restoration predominantly use deduplication and can complete restores in approximately one-third the average time of all respondents. So, according to Quantum’s press release: “If the broader US market was to achieve similar data restore efficiencies, the potential annual savings for US businesses would be approximately $6 billion.”

This survey seems a bit misleading to me because it’s not really focused on the advantages of data deduplication per se in a file restore context but, rather, the advantages of disk-based backup/recovery.

Steve Whitner, Quantum’s product marketing manager for DXi, explains: “If you back up to regular [non-deduplicated] disk and you have a need for DR, you have to get that data to another site and you can’t keep data on conventional disk for very long – maybe a few days or a week. So the real issue is not the speed of restore; it’s the fact that companies can now store a month or two of deduplicated backup data on disk.”

You be the judge. Here’s Quantum’s press release and here are some supporting slides from the survey results.

One thing is clear: In 2011, the focus will shift from deduplication for nearline/secondary storage to deduplication for primary storage. Witness two of this year’s biggest storage acquisitions: Dell buying Ocarina Networks and IBM acquiring Storwize. (Storwize’s technology is now in the IBM Real-time Compression business unit.)

Related blog posts:

What is progressive deduplication?

Data deduplication: Permabit finds success with OEM model

Thursday, December 9, 2010

Dell closing in on Compellent acquisition

December 9, 2010 – Putting to rest weeks of speculation, Dell announced today that it is in “advanced discussions” to buy Compellent for $27.50 per share, or approximately $876 million. The weird thing about this is that the $27.50 offer is about 18% less than Compellent’s closing price yesterday. That’s a rarity in the high-tech acquisition space, and the financial folks refer to it as a “take-under.”

It looks like I will be proved wrong. Although many financial analysts predicted that, after losing the battle with HP for 3PAR, Dell would set its sights on Compellent, I predicted that Dell would turn away from the over-priced storage stocks and make a few acquisitions in non-storage IT sectors.

As I write this, Compellent is trading at $29.37 per share. That would suggest that investors think that (a) a bidding war will ensue and/or (b) negotiations will drive the price up.

I doubt that a bidding war will ensue, mainly because none of the cash-rich storage giants really need Compellent’s technology (although at least one financial analyst predicted that NetApp might jump into the ring). Making a bidding war even less likely: Dell has more than $13 billion in cash, and even though it backed out of the 3PAR bidding there’s no way Compellent will go for much more than $1 billion vs. the $2.4 billion that 3PAR commanded.

Compellent’s stock has almost doubled over the past couple months due to acquisition rumors. And back in August (prior to the start of the 3PAR bidding contest) the stock was trading at about $12 a share.

If this deal goes through, it will be interesting to see how Dell positions Compellent’s products relative to Dell’s (enormously successful) EqualLogic line. There’s certainly a good deal of overlap there. But what will be more interesting is what happens to the Dell-EMC relationship, or lack thereof.

Both Dell and Compellent officials said that there was no assurance that the acquisition deal will be finalized, and they don’t plan to comment further until the deal is either consummated or goes south.

Tuesday, December 7, 2010

How bad is SSD performance degradation?

December 7, 2010 -- “It's a fairly well known fact that solid-state disk (SSD) performance can suffer over time. This was quite common in early SSDs, but newer controllers have helped reduce this problem through a variety of techniques. In part one of this two-part look at SSDs, we examine the origins of the performance problems and some potential solutions.”

That’s how Enterprise Storage Forum contributor Jeffrey Layton begins his exhaustive two-part series on SSD performance degradation.

For years (decades, actually), the focus on SSDs was on the exorbitant prices of the devices. Then the attention shifted to reliability, or endurance, issues. But SSD and controller manufacturers made great strides in those areas over the past couple years.

Now, the focus may be turning to performance degradation over time.

Layton’s articles are the best I’ve read on this subject. However, a warning: The articles are very long, very technical, and very detailed. But if you (a) are using, or considering using, SSDs (b) have sufficient technical credentials and (c) have a lot of time, I strongly recommend reading the articles.

Part 1 examines the issues that cause performance degradation in SSDs, and looks at some of the solutions (or “workarounds,” because all SSD solutions seem to involve trade-offs) that vendors have implemented.

Part 2 looks at technologies/issues such as write amplification, over-provisioning and the TRIM command, and then delves into some very in-depth testing of Intel’s X25-E SSD in ‘before’ and ‘after’ stress test scenarios. Check it out on Enterprise Storage Forum:

Fixing SSD Performance Degradation, Part 1

Fixing SSD Performance Degradation, Part 2

Friday, December 3, 2010

Disk arrays: NetApp, HP duke it out for #3 spot

December 3, 2010 – In more good news for the rebounding storage industry, revenues from external disk systems grew 19% in Q3 2010 vs. Q3 2009, topping the $5 billion mark, according to a report from IDC. Revenues for the total (external and internal) disk systems market grew to almost $7 billion, representing an 18.5% year-over-year growth rate.

Total capacity shipped grew 65.2%.

In the external array market, EMC held on to its #1 spot by a wide margin, with $1.35 billion in Q3 revenue and a 26.1% market share. IBM was a distant second with $667 million in revenue and a 12.9% market share.

But the real race is for the #3 position, where NetApp and HP are in a virtual dead heat. (Even dead heats are virtual these days.) NetApp had an 11.6% market share in Q3, followed closely by HP with an 11.1% slice. IDC considers it to be a statistical tie when less than a one percent revenue difference separates two vendors.

Dell finished fifth, with a 9.1% market share on revenue of $471 million.

All of the top five vendors had healthy, double-digit revenue growth (ranging from 11.3% for HP to 28.3% for EMC), but it was NetApp that busted the charts with a whopping 54.9% growth rate.

Looking at the leader board trends over the past few quarters, it would seem safe to say that NetApp has blown past HP and is closing in on Big Blue, except for HP’s 3PAR acquisition. With HP’s marketing muscle behind the 3PAR product line, revenue could crank up pretty quickly. For now, however, 3PAR had a market share of only 0.83% in the third quarter. (Isilon’s slice was 0.75%.)

Other highlights from the IDC report: The NAS market was the fastest-growing segment of the overall storage systems market, posting 49.8% growth in Q3 2010 vs. Q3 2009. EMC led the NAS market with a 46.6% share, followed by NetApp with a 28.9% share.

The iSCSI segment of the overall market also did well, posting 41.4% revenue growth, with Dell/EqualLogic in the top spot (33.8% share) followed by EMC and HP in a tie for second place.

For more details, read the IDC press release: “External Disk Storage Systems Market Records Fourth-Highest Quarterly Revenue in Third Quarter”

Thursday, December 2, 2010

Who says tape is dead?

December 2, 2010 – People have been predicting the termination of tape almost as long as they’ve been predicting the demise of mainframes. But both technologies keep hanging in there.

In the third quarter, tape media manufacturers pulled in almost $203 million in revenue, which is expected to actually increase slightly in the next quarter to $205 million, according to the Santa Clara Consulting Group (SCCG). And that’s just from tape cartridges; those figures don’t include revenue from tape drives and libraries.

All segments (formats) of the tape market are declining rapidly, with one exception: the LTO format.

LTO tape cartridges accounted for more than 86% ($175 million) of total cartridge shipments in the third quarter, or 6.2 million units, according to SCCG. Sales of LTO-5 (the latest generation, introduced early this year) cartridges were up 100% in Q3 vs. Q2, and accounted for 5% of unit shipments and 15% of revenues. LTO-4 cartridges accounted for 48% of unit shipments and 46% of the total LTO revenues. Even the LTO-3 segment grew in the third quarter (up 3%).

One reason that users stick with tape is that it’s still way cheaper than disk. Those LTO-5 cartridges cost only four cents per GB (assuming 2:1 compression).

According to a study conducted by The Clipper Group research and consulting firm, the cost ratio of storing 1TB of data on SATA disk vs. LTO-4 tape is 23:1. Even if you compare the costs of archiving data on a VTL with data deduplication vs. tape, the cost ratio is 5:1, according to the Clipper Group study.

And for the energy-conscious: Tape is 290X less expensive than disk in terms of energy costs. (The Clipper Group study was conducted two years ago, but with cost reductions in both disk and tape those ratios are probably still accurate.)

Sure, accessing data from tape is painfully slow, but successive generations of LTO have typically doubled the transfer rate. (Exception: LTO-5 only provided a nominal increase in transfer rate vs. LTO-4 – 280MBps vs. 240MBps – but LTO-6 is expected to almost double the transfer rate to 525MBps. That assumes 2.5:1 compression, vs. today’s average compression ratio of 2:1, which will come from the use of larger compression history buffers, according to Bruce Master, an LTO Program representative and senior program manager of tape storage systems at IBM.

And LTO-6 will boost native cartridge capacity to 3.2TB, or 8TB in compressed mode.

The LTO Program vendors (HP, IBM and Quantum) claim that more than 3.3 million LTO tape drives, and more than 150 million LTO cartridges, have been shipped.

In addition to the usual capacity and speed improvements, LTO-5 includes some nifty features such as media partitioning (which enables users to create two partitions on the cartridge, one for content and one for an index) and the Linear Tape File System (which is a free download that leverages dual partitioning and provides file system access at the operating system level).

The LTO Program celebrated its 10th anniversary last month.

Monday, November 29, 2010

VCs score big in EMC-Isilon deal

November 29, 2010 – Whenever there’s a blockbuster acquisition such as EMC’s $2.25 billion buyout of Isilon, it’s interesting to speculate about what the marriage will mean to customers and competitors. But one angle I never look into is what the acquisition means to the venture capitalists (VCs) behind the acquired company.

According to a blog post on The Wall Street Journal’s wsj.com, the VCs behind Isilon made out quite well (see “EMC-Isilon Deal Is Another Data-Storage Win for VCs”).

According to that article: Atlas Ventures and Madrona Group, which provided Isilon with its Series A funding in 2001, as well as Sequoia Capital, which led the company’s Series B funding, all held significant stakes in Isilon.

Atlas said it will reap $473 million from the EMC-Isilon acquisition, or 20X its initial investment.

Madrona will get more than 15X the $15 million it invested, or $225 million+, according to a Madrona representative.

Sequoia Capital (which apparently did not sell any of its holdings prior to the acquisition announcement), will score $394.4 million.

Isilon was founded almost 10 years ago by Sujal Patel. The company went public in late 2006 at $13 a share. Going public was rocky in the beginning, with shares falling about 50% in the first year. Isilon’s stock price kept sliding through 2008 and 2009, when investors such as Atlas and Madrona added to their holdings.

Under the terms of the agreement announced a couple weeks ago, EMC will pay $33.85 per Isilon share.

Read the full blog post at wsj.com: “EMC-Isilon Deal Is Another Data-Storage Win for VCs”

Tuesday, November 23, 2010

Brocade boasts record revenues, but . . .

November 23, 2010 – Brocade set an all-time revenue record in its fiscal fourth quarter, and narrowly exceeded analysts’ expectations, raking in about $550 million. That’s up 9.3% over the previous quarter and up 5.5% year-over-year.

However, the company posted a net profit of $66 million in 4Q10, or 14 cents a share, which is down from $73 million, or 15 cents a share, a year ago. In addition, guidance for the current quarter was, well, cautious. Company executives predicted revenue for the current quarter of $535 million to $550 million, which translates into flat to -3% growth vs. the previous year That guidance was below Street projections. Brocade’s 1Q11 guidance was variously described as “cautious,” “tepid” and “dour.”

In other words, the company’s performance in this quarter was stellar, but the outlook for 1Q11 disappointed. Mixed signals, indeed.

Brocade earned the applause of analysts – and some Buy ratings -- by (narrowly) exceeding their expectations, but investors sent the stock down late Monday, a slide that continued into Tuesday, presumably because of the lackluster projections for the current quarter.

Brocade (NASDAQ: BRCD) shares closed at $5.13 today, down 10%.

Personally, I don’t think Brocade’s guidance on this quarter looks very bad at all, given an expected slowdown or stall in federal spending and Brocade’s challenging competitive position on the Ethernet side of the business against Cisco, HP and others.

Speaking of which, Brocade’s Ethernet-related revenue numbers suggest that the company is picking up steam against those formidable rivals.

4Q10 revenue from Brocade’s Ethernet line was $142.6 million (representing 26% of total revenue.) That’s an increase of 17% vs. the previous quarter. And the company gained about 300 new customers for its Ethernet switch line in the fourth quarter, bringing the total to 1,600 since the acquisition of Foundry.

Brocade’s SAN storage business remained at about 57% of total revenue (vs. 58% in the last quarter), or $316 million. Services accounted for the remainder of the total revenue, or about $92 million.

Gross margin was 62.3%, compared to 54.1% in the previous quarter.

Related articles:

Brocade, HP debut 8Gbps SAN starter bundles

Brocade tackles network convergence, VM mobility

Brocade increases density, throughput of DCX Backbone