When FAST is not properly fast.

I have just finished read this, this and this about the “brand new”, next to be released, FAST feature from EMC on their V-MAX. In his post Barry Burke the Anarchist asks us to place some questions.. so here are my questions and thoughts!

FAST (fully automated storage tiering) is an implementation of what’s commonly called Automated Tiered Storage, this feature was implemented by Compellent years ago with the name of Data Progression and it is one of the factors of success for this company. Automated tiered storage is a feature that allows to move data blocks between different types of disks and raid levels, in function of their frequency of access, in a transparent manner to the hots. The big advantage is to gain tier 1 disk space and performance moving unused data to tier 2 o 3! With this feature SSD’s really make sense in the real world!

Data Progression from Compellent promises (and honours) big saves in TCO because the automatic tuning of LUNs, ease of use, and less hardware/power needs. Customers are indeed asking for these kind of features every day to lower TCO and improve usability of their systems!

what is doing EMC about automted tiered storage? what does it mean for your TCO? i would like to share you some facts (read from the articles below and no FUD):

  1. FAST V1 (end of the year ?) will work at LUN level, FAST V2 (mid 2010?) will work at subLUN level!
  2. FAST V1 will be incompatible with Virtual Provisioning.
  3. FAST is for V-MAX…. DMX not contemplated!
  4. CX will be supported in the future… CX 4 or CX 5?
  5. SAS backend in the future (means, at least, new CX are you ready ?)

Well, a lot of guesses in my mind :-D

FAST V1 will work at LUN level.. FAST V2 will work at subLUN level.

Yes, you have understood very well! LUN Level means FAST needs to move a whole LUN from one Tier to another every time needed. Others attempted this, years ago, with “automatic volume migration”: the best practices, now, is no more automatic shuffling but to suggest the movements to avoid the performance impact on the Raid groups involved!

Moving TBs of data back and forth can be very dangerous and ends up it limiting usability of that feature.

Next version of FAST (V2) will work in the right way, with finer granularity, and it will move small pages of data so it will be suitable for most needs… BTW, i would like to know if subLUNs migrations will be done only among different types of disks with the same RAID level, or it will be done across disks and RAIDs to achieve the best performance and space usage (without user intervention, of course). Another more thing, how can FAST is reconfigured, on the fly, to rearrange the behavior of the single LUNs? (Compellent does these things automatically when setting the right profile with just a point and click!).

Ease of use and predictable results are key values for TCO!


FAST1, will be incompatible with Virtual provisioning.

It’s not a news… every time EMC introduces new features or functionalities you have to ask yourself about limitations come into play too. EMC, give away Virtual Provisioning for free so it’s up to You to decide if you want a space savvy system or an automated tiered system, not both of them at the same time. what a dilemma!!!!

Moreover, what about snapshots, clones, replicas? i would like to know if there are other limitations about these features? only EMC can answer!

what about a migration impact between V1 to V2? fat to thin+FAST? is it all automatic? V2 (with its 768K pages) new questions arise: where can i put my snapshots? how snapshots impact on performance adding FAST? will snapshot be relocated on less valued tiers to save space and performance?

Every constraint is a limit, each limit force more human work, more work is higher TCO!

FAST is for V-MAX.. DMX not contemplated! + CX will be supported in the future… CX-4 or CX-5? + SAS Backend

Not a problem, DMX customers can migrate to V-MAX only for a “small” amount of bucks, ;-) Probably the same tale will be for actual CX-3 and CX-4 customers. will FAST supports CX4? or you need to migrate to the next CX-5 (or “V-MIN”)?

For other vendors (like Compellent) SAS is an option but what does it mean for EMC customers? Hey, Go and see the rear back of your CX and check if you have any free slot to add SAS backend cards. You are out of luck! You need to buy the next CX generation to have SAS!

Buy new systems means forced migrations, migrations means higher TCO!

So, to recap: Compellent 3 – EMC 0 about TCO in automated tiered storage!!!

EMC adds FAST but V1 has a lot of limitations and V2 will see the light in a year (likely with less limitations). On the other hand, Compellent implements this feature (called Data Progression) since years and it is well implemented, without limitations and constraints!

EMC wants you to buy new hardware (V-MAX and probably next CX) to implement FAST!!!! With Compellent you may add features to every generation of the Storage Center without chancing hardware.

EMC plans a SAS backend in the future… Compellent can mix and match SATA, SAS, FC, SSD backends in the same storage system just now, without costly “rip-and-replace” upgrades.

Hey, ok, i’m a Compellent fan and reseller so i’m not really unbiased, but every comment is very welcome!!! :-)

ES

  • G-man

    I am not really convinced (regardless of whether the technology comes from EMC or Compellent) that automatic tiering is good. Seems to me that this would cause data fragmentation and impact overall performance. Do you have some solid information on how many people have bought DP and how many people are using it? What type of Applications or IO characteristics benefit from Compellent’s DP?

  • http://www.cinetica.it Enrico Signoretti

    G-Man,
    A lot of analysts studies show the problem of inactive data on the storage (sometimes 70% or more). Automated Tiered Storage is one of the most discussed storage topics this year because customers ask for it. I followed directly some installations: customers , after a first natural skepticism, are very satisfied about the results.

    DP helps every application ranging from file servers to DBs and mail server, etc. Moreover It simplifies the storage layout avoiding automagically the hot spots!

    Think about a DB: transaction logs are frequently changed with sync writes, some data files are frequently changed and others contain old data.
    In a traditional layout you need to configure more LUNs with raid-1 for logs and raid 1 or 5 for datafiles. With an automated tiered storage (block level of course) you will have a single LUNs where blocks frequently change (logs and new rows) will be written in tier1 and old data will be moved to less valued tiers!
    all in all: you need less T1 disks to achieve performance needs, T2 disk to fulfill space requirements, less power consumption, less management (less TCO overall!)… not bad.

    ES

  • http://thestorageanarchist.com the storage anarchist

    Your bias has clearly clouded your objectivity. Probably would have been better to ask the questions first before you scored the game.

    * FAST v1 will be available for DMX later this year as well.

    * FAST for CLARiiON CX4 will be available at the end of 2009, or early 2010.

    * FAST v1 is indeed designed specifically for full LUNs, which make up well over 90% of the LUNs in use today by Symmetrix customers. The #1 customer request for Flash Drives in today’s world is that we automate the decision process of what goes onto Flash and what goes onto SATA.

    * FAST v2 will provide sub-LUN tiering to V-Max Virtual Provisioning. At that point, we expect most customers will move from FAST v1 to v2.

    * There are already migration paths to get from full LUNs to VP LUNs, with more on the way.

    * FAST policies can be assigned to Snapshots, Clones and remote replicas.

    * And indeed, FAST will be smart enough to keep the remote replica’s disk allocation aligned with the source so that fail-over can occur without loss of performance.

    * On V-Max and CX, RAID type can be changed by FAST as well as disk class.

    * SAS drives offer no significant value over FC drives – they cost the same, they use the same power, they’re the same sizes, and the deliver the same net performance as FC drives. It is thus rather silly to be using the disk interface as a competitive differentiator.

    * And in fact, SAS being so new, it is probably more risky to use a SAS back-end than a FC one. FC is extremely reliable today thanks to years of refinement, while SAS in large drive count configs is immature and the issues have yet to be found, much less resolved.

  • http://www.cinetica.it Enrico Signoretti

    Barry,

    - Ok, so DMX customers will have FAST V1 (and V2 too?) and informations reported by other bloggers are incorrect: “the first unique features of the Symmetrix V-Max line”! :-) or, perhaps, my english is worse than i think!
    sorry, if i have misunderstood.

    - Ok, So is V1 (LUNs level migration) suitable for 90% of your users? because they are not using TP! This answer really fails in convincing me but, at least, is an answer.
    I think it can be painful to move SSDs LUNs to SATA, back and forth, if your customers have spent their bucks for SSDs they need them to cure their performance issues, the only way to automagically gain performance and space is granularity!
    And, Ok, you will get granularity in a year, more or less. Granularity will permit your customers to not re-layout (or slice) big LUNs in small ones to use FAST (but if your LUNs are sliced you can move them manually to less valued disks and not buy FAST).

    - Ok, migration paths: what do you mean with “migration paths”? , I suppose a GUI interface with a “point-and-click” button “convert-lun-from-fat-to-thin-without-pains-and-no-servise-interruption”… or something more complex?

    - Ok, so FAST is flawless/limitless about snapshots, clones, replicas and customers will create profiles with integrated relocation of blocks managed by this features… does it mean that FAST will allow to create profiles, for each LUN, or group of, and its related snapshots? :-)

    - Ok, SAS has the same value of FC. All storage industry is going that way and you will too!. Other vendors offer this option right now.

    ciao,
    Enrico

  • http://www.cinetica.it Enrico Signoretti

    Barry,
    We could continue for days, or more probably, months, in this discussion so this will be my last comment to not annoy your/mine readers.

    just to add last things:

    Ok, EMC is more than twenty years old and Compellent was born only 5 years ago! On the other hand Compellent is growing very fast… Compellent is very small if compared to EMC, but lot of new Compellent’s customers are ex-traditional storage vendor customers (and now they are happier than ever!).

    Your Array can deliver 2PB and 64000 LUNs! really? Compellent can deliver 1PB and infinite LUNs (so they are not so distant ;-) ) but i don’t think that theoretical maximums will be reached soon on installed systems… of course, i could be wrong! please let me know if you can show me an installed V-MAXs with 2PB of raw storage, 64.000 LUNs with “tens of thousands of physical and hundreds of thousands of virtual servers” connected to it… i’m very curious to know who have a similar installation!!!!

    And about SAS…. i could reverse thoughts about every technology, you will push it if you are an early adopter!

    ciao,
    ES

  • http://thestorageanarchist.com the storage anarchist

    Yes, indeed, there are V-Max customers who have already installed 2PB arrays, including Microsoft AdSense, who participated in the V-Max launch. And those numbers I quote aren’t “theoretical maximums” – we actually test and verify those configurations in QA before we announce the product.

    I doubt Compellent has tested an “infinite” number of LUNs :) .

    And vendors tend to push new technologies BECAUSE they offer new value: such is the case for FCoE, Flash Drives, server virtualization, etc.

    I have not yet seen anyone offer any unique value for SAS drives, other than that they are a “new technology.” Until they are cheaper, faster, smaller and their supporting infrastructure is proven to be more reliable, more scalable and more efficient than todays’ Fibre Channel drive, there is really nothing to be proud of as an early adopter.

    Finally, the emergence and growth of Compellent is commendable, and I in no way mean to belittle the company. In pointing out the size of the Symmetrix installed base, I was merely trying to explain why we would focus first on FAST for “thick” LUNs before delivering the sub-LUN implementation.

    Perhaps one day Compellent will be faced with the challenges of balancing new innovations with the needs of a significant installed base. The good news (for Symmetrix customers) is that EMC isn’t standing still – it is bringing new capabilities and features into the product line without disrupting customer’s legacy environments or sacrificing the 24-by-Forever availability that so many of the installed base require.

  • http://www.cinetica.it Enrico Signoretti

    Barry,
    No doubts, You are doing your Job very well!
    you convinced me, tomorrow I will buy a V-MAX. :-D

  • http://blogs.cinetica.it/cinetica/2009/09/28/quando-fast-non-significa-veloce/ Cinetica Blog » quando FAST non significa veloce!

    [...] post, nella versione inglese, ha generato una bella discussione con The Storage Anarchy, un blogger di [...]

  • http://blogs.cinetica.it/cinetica/2009/10/06/virtualized-storage-for-virtualized-infrastructures/ Cinetica Blog » Virtualized storage for virtualized infrastructures

    [...] SubLUN automated tiered storage is a key technology asked by customers and already implemented by Compellent with Data Progression and soon from others. [...]

  • http://www.cinetica.it/2009/12/09/too-much-hype-and-money-for-nothing-fast-v1/ Too much hype and money for nothing = FAST V1 « Cinetica

    [...] FAST V1 is a very limited product, I wrote about it in the recent past. [...]

blog comments powered by Disqus