Tintri adds new VM-aware features and VAAI Support

During VMworld 2012 in San Francisco, I had a chance to catch up once again with the team from Tintri. My first introduction to Tintri was at last year’s VMworld, where they received runner-up in the ‘Hardware for Virtualization’ category by TechTarget for best of VMworld 2011. Well this year they went one better, and won the Best of VMworld 2012 Gold award in Hardware for Virtualization. And for good reason. Let’s see the enhancements to the Tintri platform over the last 12 months have brought.

 Snapshot & Cloning Capabilities

Tintri were one of the first VM-Aware arrays. All the operations on the array were built around the VM. In fact, this is something that VMware is also embracing with the tech preview of virtual volumes that was given in this year’s VMworld keynote, so Tintri are ahead of the curve here. With a VM-aware array, snapshots and clones are done on a per-VM basis rather than on a per LUN or per volume basis. This approach gives customers greater operational granularity and space savings. The demo given to me by Ed Lee (Tintri Chief Architect) and Kieran Harty (Tintri CEO) at this years VMworld 2012 in San Francisco was very captivating. Ed showed me their ability to create many hundreds of VM snapshots/clones in the space of seconds. All of these snapshots and clones are thinly provisioned and already space efficient, so that any unused space can be reclaimed by the array. The space efficiency aspect is something that VMware are also embracing with the announcement of SE Sparse Disks in vSphere 5.1. Incorporated into the Tintri snapshot and clone mechanism are VSS callbacks for quiescing applications and filesystems within the Guest Operating System so that consistent snapshots can be taken. Tintri also have the ability to use existing VMware customization specifications to customize snapshot/clone copies of the VM from a Guest OS (sysprep) perspective.  These features, combined with support for VCAI (View Composer Array Integration) in View 5.1 lend themselves very nicely to VDI, and it comes as no surprise that Tintri have positioned themselves as an ‘array of choice’ for VMware View implementations, amongst other enterprise applications.

VAAI Integration

Tintri’s VM-aware datastore is in fact NFS, so it is nice to see that they have fully supported the VAAI-NAS primitives. VAAI is short for VMware’s vSphere Storage APIs for Array Integration. The first of the primitives implemented is the extended statistics feature. This is where details about the actual space consumed on the ‘storage pool’ on the array can be surfaced up into vSphere. This allows admins to more easily understand the storage consumption rate and plan in advance for additional storage, rather than ‘fire-fighting’ when disk space suddenly runs out. The second primitives related to the implementation of the Reserve Space primitive, which allows you to create thick provisioned VMs on NFS datastores so that you don’t need to worry about your VM running out of space as it writes to new areas of the virtual disk. The third and most impressive feature is the implementation of the File Cloning primitives, which allows you to create clones from the vSphere GUI on Tintri in just a couple of seconds, regardless of the size of the VM that you are cloning! You can learn more about VAAI and the different primitives from a post I did on the vSphere Storage blog here.

Futures

Ed also gave me a sneak-peak at their upcoming replication technology. Basically, again because this is VM-aware storage, replication can be done between arrays on a per VM basis. One of the stand out parts of their replication technology is the ability to make a clone copy of the replica at the destination and verify that it does indeed power-on and the application running in the Guest OS is in a consistent state. Tintri have plans to integrate this replication technology with VMware’s Site recovery Manager product, but no timeframes on that just yet. One of the things which I quite liked was the ability to observe the replication network bandwidth savings due to dedupe and compression within the UI. While many vendors claim dedupe and compression ratios, Tintri put it right out there for you to see for yourself. Very nice.

You can learn more about their new enhancements here. Tintri will also be making their second VMworld EMEA appearance in Barcelona this year. I’d urge you to go along and see them.

Get notification of these blogs postings and more VMware Storage information by following me on Twitter: @VMwareStorage

 

Heads Up! ESXi cannot distinguish between EagerZeroedThick & LazyZeroedThick

VAAI NAS introduced the ability to create LazyZeroedThick & EagerZeroedThick disks on NFS datastores. Without VAAI NAS, one can only create thin VMDKs on NFS datastores. For those of you who are using VAAI NAS plugins, there is an important note in the 5.0U1 release notes that you should be aware of.

  • ESXi cannot distinguish between thick provision lazy zeroed and thick provision eager zeroed virtual disks on NFS datastores with Hardware Acceleration support
    When you use NFS datastores that support Hardware Acceleration, the vSphere Client allows you to create virtual disks in Thick Provision Lazy Zeroed (zeroedthick) or Thick Provision Eager Zeroed (eagerzeroedthick) format. However, when you check the disk type on the Virtual Machine Properties dialog box, the Disk Provisioning section always shows Thick Provision Eager Zeroed as the disk format no matter which format you selected during the disk creation. ESXi does not distinguish between lazy zeroed and eager zeroed virtual disks on NFS datastores.

This can be confusing, especially if you select “Thick Provision Lazy Zeroed” when creating a virtual machine disk during deployment, and later you edit the properties of the VM and it states that the disk is “Thick Provision Eager Zeroed”. This is the crux of the issue; we will always report Eager Zeroed, even if the VMDK is Lazy Zeroed. Some of the guys at EMC have already run into the issue, which I how I got a heads-up on it.

On VMFS, we can query TBZ (To Be Zeroed), which can tell us that there are blocks that are provisioned but not yet initialized. I wrote an KB article on how you can do this via vmkfstools. On NFS, we have no way of retrieving this information.

Get notification of these blogs postings and more VMware Storage information by following me on Twitter: @VMwareStorage

Virsto Software for vSphere Overview

Virsto Software I’d met Virsto Software at previous VMworld conferences, but never had a chance to have a meaningful discussion regarding their products and solutions. On a recent trip to the US, I had the pleasure of meeting with Eric Burgener at the Virsto offices in Sunnyvale. He kindly took the time to give me an overview of their Virsto for vSphere 1.5 product.

Overview
Virsto Software aims to provide the advantages of VMware’s linked clones (single image management, thin provisioning, rapid creation) but deliver better performance than EZT VMDKs.

To achieve this, Virsto provide two components – a software storage appliance and a service which runs on the ESXi host. Block storage devices from your traditional SAN are first mapped as RDMs (Raw Device Mappings) to the storage appliance. The appliance then takes these devices, creates a very large storage pool (called the vSpace) and a log (called the vLog), and presents this object as an NFS datastore to your ESXi hosts. The Virsto appliance can then apply its own ‘secret sauce’ to how I/Os are handled, and requests to create VMDKs (Virtual Machine Disks) in fact instantiate Virsto “vDisks” under the covers. However these Virsto “vDisks” do indeed look like native thin VMDKs. This is important as it allows vSphere Administrators to understand that they can manage this storage using the standard VMware workflows.

The Virsto (NFS) Datastore

From an I/O perspective, all reads go directly to the vSpace pool. Virsto implements a locality of reference for each of the VMs deployed on the datastore. This allows reads to be handled sequentially in most cases. Virsto estimates that using their vSpace provides a read performance improvement that could be 30/40% higher than reads going directly to the SAN.

All writes go to the circular log. Once received into the vLog, an acknowledgment is sent back to the initiator and the write is later destaged from the vLog to vSpace. Before destaging occurs, I/Os can be reassembled to allow destaging to take place on contiguous I/O chunks. Since this is a circular log with regular destaging, Virsto estimate that 10GB per host is all that is needed. For best performance, Virsto suggest that the log is placed on a very fast HDD or even an SSD. With this circular log approach, Virsto estimate that they can achieve a 10 fold increase in write performance over standard SANs.

The nice thing with the Virsto appliance is that it is very lightweight – only 1 vCPU & 1GB RAM. And Virsto can virtualize up to 1 PetaByte of back-end storage. Using their “vDisk” technology, Virsto tell me that they have the ability to deliver upwards of 10,000 snapshots and writable clones, something that could be of interest to potential VDI customers.

VMDK format
I asked Eric to elaborate a little more on their “vDisk” technology. It would appear that VMDKs are created using standard VMware workflows, but behind the scenes, they are deployed as thin Virsto “vDisks” onto the NFS datastore. However with the Virsto appliance, there is no overhead when extending the thin VMDK (traditional thin disks have to do zero on write operation). Virsto claim that thin VMDKs deployed on the Virsto appliance can therefore outperform the standard eager zeroed thick (EZT) format VMDK. The other neat thing about Virsto “vDisks” is that space can be reclaimed from within the VMDK, making them very space efficient. This has been a major pain point for many customers.

vSphere Integration
There is a vSphere client plugin for the Virsto appliance for management functionality, though some operations would still need to be done outside of the client. There is no VAAI functionality at the time of writing, but Virsto are working on implementing the Fast File Copy primitive to allow VMware linked-clones use Virsto native snapshots for VDI solutions.

Failure Handling
The immediate question is what happens to the outstanding writes in the circular vLog which have not yet destaged and the Virtual Machine has a failure? Eric explained that Virsto can take the vLog and attach it to a another host in the cluster. Once it attached, everything in the log device gets flushed (in about 10 to 15 secs) to the vSpace. VMs which have failed, and are then restarted by vSphere HA, will automatically have access to all their data.

What about a failure on the appliance itself (or indeed the ESXi host on which it resides)? This is where vSphere HA again plays a role – the Virsto appliance is being monitored by VMware HA using VMware Tools Heartbeat Monitoring, so if it fails, it gets re-started.

Any writes in process that have not been acknowledged by the log will have to be re-submitted after recovery, but anything which has been committed to the logs is not lost on failover.

In most cases, recovery from a Virsto appliance failure happens quickly enough that the VMs on the host don’t even need to be re-started (if it was just a Virsto appliance and not an ESXi host failure). If it was a host failure then the recovery order is (1) replay the log from the failed host, (2) start the VMs elsewhere in the cluster (the Virsto service doesn’t need to re-start because it’s already running on every other node in that cluster).

See Virsto at VMworld.
Virsto are an exhibitor at VMworld 2012 at booth 414. In addition to providing a demonstration of their new Virsto Software for vSphere (version 1.5), I have been told by the Virsto guys that they are also going to do a demonstration of Virsto working with EMC’s new VFCache. Definitely worth checking out in my opinion.

Get notification of these blogs postings and more VMware Storage information by following me on Twitter: @VMwareStorage

SimpliVity Announce OmniCube Storage Appliance

I recently had the pleasure of chatting with  Jesse St. Laurent, Product Director at a new storage startup called SimpliVity. SimpliVity finally exited stealth mode today, but has been around since the end of 2009, with development starting in earnest in 2010.

The name of the hardware storage appliance which SimpliVity have just announced is the OmniCube. Having asked Jesse to describe the features of the appliance, he listed the following:

  • The OmniCube is a 2U hardware Storage Appliance which has a pre-installed & pre-configured ESXi hypervisor. The appliances are deployed in configurations of 2 or more nodes and use a combination of SimpliVity software and PCIe accelerator cards, both of which are intellectual property (IP) of SimpliVity.
  • It deduplicates & compresses all data at inception – there is no need for a third-party appliance/component to deliver this. Jesse stated that they can achieve 1.5:1 for both dedupe and 1:1.5 for compression, but said he was being very conservative with this estimate.
  • The appliance provides space efficient snapshots for backup & other purposes which are VM-centric. Many backup and replication products work off of a whole datastore – SimpliVity works at the VM level.
  • The appliance supports a combination of HDD & SSD for cache & performance reasons.
  • There is a High Availability feature across multiple OmniCubes located in the same DC.
  • There is replication across OmniCubes in different datacenters for BC/DR purposes.
  • The appliance is based on a scale out architecture so customers can start out small-scale and then grow as their performance and capacity requirements grow.
  • The datastore created by SimpliVity is NFS – therefore this storage can also be shared with other hosts and VMs in the infrastructure.
  • The storage is VM-centric in so far as the deployment of VMs is policy driven (i.e. backup/snapshots policy, DR/Replication policy and supports per VM failover). Many traditional approaches require customers to snapshot or replicate complete datastores when in fact you may only be interested in one or more of the VMs on the datastore. SimpliVity have the ability to snap and replicate on a per-VM basis. I asked about whether SimpliVity has a policy to define QoS for the VMs (both for network & storage), and although the appliance is plumbed-in for these sorts of policies under the covers, it is not yet exposed so will not available at GA.

SimpliVity Omnicube

SimpliVity’s OmniCube is powered by Omnistack: the software (SVT in the above diagram) and the PCIe accelerator card. The Omnistack is designed to work with your typical DAS server. One of the other nice features of the appliance is that it is cloud ready – SimpliVity support their Omnistack (without the hardware acceleration) running in a public cloud. At the time of writing, they are only supporting it on Amazon’s EC2, . What this does mean however is that you can have DR to the Cloud pretty much out of the box. The other neat thing is that you can clone and backup across datacenters to any Omnistack instance, and restore from any instance too, including the one based in the cloud.

I put the following questions to Jesse.

  • Q. What is SimpliVity’s target market?
  • A. Jesse expected customers to start using SimpliVity storage for the tier2 applications, but added that their storage is designed to run any application running on VMware today. SimpliVity feels that current storage offerings are either too complex or too expensive. As I have not yet seen the product in action or any pricing from SimpliVity, I guess time will tell whether SimpliVity is less complex or less expensive than the competition.
  • Q. How does SimpliVity differentiate itself from the many other storage appliances operating in this space?
  • A. Jesse stated that he believed that the SimpliVity appliance was feature complete. Jesse stated that a lot of customers were faced with a proliferation of appliances to provide the complete feature set that SimpliVity provides, such as dedupe/compression appliances and cloud gateways.
  • Q. What sort of vSphere integration is there?
  • A. SimpliVity have a plugin to vCenter which allows the SimpliVity appliance(s) to be managed from the vSphere client. All nodes can be managed (same datacenter, different datacenter, nodes in the cloud) from the same management interface.
  • Q. What other components are required for deployment?
  • A. The is a PCIe ‘accelerator’ card required on the hosts. This Omnicube accelerator card is SimpliVity Intellectual Property. There is also a requirement to have 10GbE connectivity between the hosts, but in small configurations, SimpliVity will support direct connect.

It does seems like a very nice solution and I’m looking forward to seeing a live demo at VMworld 2012. SimpliVity are a gold sponsor at VMworld 2012 this year and you will find them at booth 1117.

Get notification of these blogs postings and more VMware Storage information by following me on Twitter: @VMwareStorage

EMC Isilon – OneFS Mavericks Release Overview

EMC IsilonEMC Isilon are providing even further vSphere integration features in their upcoming ‘Mavericks’ release of their OneFS operating system. This is great to see. The integration is in the area of vSphere APIs, both for Array Integration (VAAI) &  Storage Awareness (VASA).

Let’s have a look at the VAAI enhancements first.

1. VAAI NAS integration

  • Full File Clone/NFS File Copy – The Full File Clone primitive calls the storage array’s replication facility. In Isilon’s case, a writeable snapshot of the file is created, saving space since it does not need to clone the whole VM’s disk. This is very similar to the VAAI block primitive XCOPY. One difference I do need to call out however between block and NAS primitives is that the NAS Full File Clone primitive will only work with VMs that are not running. In other words, Storage vMotion operations do not use the Full File Clone primitive at this time, unlike Storage vMotion on block devices which support VAAI. I want to highlight that this is not a limitation in Isilon’s implementation; rather it is a limitation on the vSphere side. It is definitely something I want to see in a future implementation of VAAI.
  • NFS Extended Stats – With NFS, vSphere only gets generic information about space consumption on Thin Provisioned datastores. The full details around the amount of space that is being consumed by an actual file on an NFS datastore at the back-end is not visible. This can lead to some space-management administration overhead as vSphere administrators may need to contact the storage admin for detailed information. In vSphere 5, all extended file and filesystem information are available via this primitive. For example, how much actual space is being consumed by a VMDK on the back-end can now be retrieved.
  • NFS Reserve Space – In earlier versions of vSphere, there was no way for NFS datastores to create the equivalent of an “eager-zeroed thick” VMDK. In vSphere 5, with VAAI NAS support, you now have the ability to reserve the entire space for a VMDK on an NFS datastore with this Reserve Space primitive.

These primitives, of course, require the EMC Isilon VAAI NAS plugin, but this is easily installed via VUM, the VMware Update Manager. After watching some of the tests, the improvement is significant. An offline clone operation of a 120GB VM took about 7 minutes 15 seconds without VAAI. With VAAI, it took 1 minute and 29 seconds. This was almost 5 times faster. Nice!

2. VASA

vSphere Storage APIs for Storage Awareness, commonly referred to as VASA, is a set of APIs that permits storage arrays to integrate with vCenter for management functionality.

Isilon are now surfacing up a bunch of device capabilities with VASA. These are now visible in the vSphere client when examining datastores.

Capability

Description

ARCHIVE Datastore resides on Isilon NL-series hardware
CAPACITY Datastore resides on Isilon X-Series hardware
HYBRID Datastore resides on a mixed Isilon hardware configuration
INVALID Datastore resides on a mixed Isilon hardware configuration
PERFORMANCE Datastore resides on Isilon S-Series hardware or SSD accelerated storage
ULTRA_PERFORMANCE Datastore resides on Isilon S-Series hardware with SSD acceleration
UNKNOWN The Storage Capability for this object is Unknown

This is great to see. Isilon customers who deploy the VASA plugin along with upgrading to the Mavericks release can now reap the full benefits of VMware’s Profile Driven Storage feature. What this means is that deployments of VMs will always be error free, allowing you to select the correct datastore for your VM each & every time. The other benefit is that you can constantly check the compliance state of your VMs storage throughout its life-cycle (e.g. detect if someone inadvertently migrated to a lower tier of backing storage). You can learn more about Storage Profile but this blog post I did on the vSphere Storage Blog.

We don’t have enough vendors doing offloading with VAAI NAS, so it is a welcome sign to see Isilon introduce this. And I certainly like the VASA capability descriptions that they are surfacing up – I think this make it nice and clear to Isilon customers what sort of device(s) are backing their respective datastores.

EMC are a diamond sponsor at this years VMworld 2012 in San Francisco. I’m sure Jay, James and the rest of the Isilon team would be delighted to show you these new features. You’ll find those guys at booth 1203.

Get notification of these blogs postings and more VMware Storage information by following me on Twitter: @VMwareStorage