Virsto Software for vSphere Overview

Virsto Software I’d met Virsto Software at previous VMworld conferences, but never had a chance to have a meaningful discussion regarding their products and solutions. On a recent trip to the US, I had the pleasure of meeting with Eric Burgener at the Virsto offices in Sunnyvale. He kindly took the time to give me an overview of their Virsto for vSphere 1.5 product.

Overview
Virsto Software aims to provide the advantages of VMware’s linked clones (single image management, thin provisioning, rapid creation) but deliver better performance than EZT VMDKs.

To achieve this, Virsto provide two components – a software storage appliance and a service which runs on the ESXi host. Block storage devices from your traditional SAN are first mapped as RDMs (Raw Device Mappings) to the storage appliance. The appliance then takes these devices, creates a very large storage pool (called the vSpace) and a log (called the vLog), and presents this object as an NFS datastore to your ESXi hosts. The Virsto appliance can then apply its own ‘secret sauce’ to how I/Os are handled, and requests to create VMDKs (Virtual Machine Disks) in fact instantiate Virsto “vDisks” under the covers. However these Virsto “vDisks” do indeed look like native thin VMDKs. This is important as it allows vSphere Administrators to understand that they can manage this storage using the standard VMware workflows.

The Virsto (NFS) Datastore

From an I/O perspective, all reads go directly to the vSpace pool. Virsto implements a locality of reference for each of the VMs deployed on the datastore. This allows reads to be handled sequentially in most cases. Virsto estimates that using their vSpace provides a read performance improvement that could be 30/40% higher than reads going directly to the SAN.

All writes go to the circular log. Once received into the vLog, an acknowledgment is sent back to the initiator and the write is later destaged from the vLog to vSpace. Before destaging occurs, I/Os can be reassembled to allow destaging to take place on contiguous I/O chunks. Since this is a circular log with regular destaging, Virsto estimate that 10GB per host is all that is needed. For best performance, Virsto suggest that the log is placed on a very fast HDD or even an SSD. With this circular log approach, Virsto estimate that they can achieve a 10 fold increase in write performance over standard SANs.

The nice thing with the Virsto appliance is that it is very lightweight – only 1 vCPU & 1GB RAM. And Virsto can virtualize up to 1 PetaByte of back-end storage. Using their “vDisk” technology, Virsto tell me that they have the ability to deliver upwards of 10,000 snapshots and writable clones, something that could be of interest to potential VDI customers.

VMDK format
I asked Eric to elaborate a little more on their “vDisk” technology. It would appear that VMDKs are created using standard VMware workflows, but behind the scenes, they are deployed as thin Virsto “vDisks” onto the NFS datastore. However with the Virsto appliance, there is no overhead when extending the thin VMDK (traditional thin disks have to do zero on write operation). Virsto claim that thin VMDKs deployed on the Virsto appliance can therefore outperform the standard eager zeroed thick (EZT) format VMDK. The other neat thing about Virsto “vDisks” is that space can be reclaimed from within the VMDK, making them very space efficient. This has been a major pain point for many customers.

vSphere Integration
There is a vSphere client plugin for the Virsto appliance for management functionality, though some operations would still need to be done outside of the client. There is no VAAI functionality at the time of writing, but Virsto are working on implementing the Fast File Copy primitive to allow VMware linked-clones use Virsto native snapshots for VDI solutions.

Failure Handling
The immediate question is what happens to the outstanding writes in the circular vLog which have not yet destaged and the Virtual Machine has a failure? Eric explained that Virsto can take the vLog and attach it to a another host in the cluster. Once it attached, everything in the log device gets flushed (in about 10 to 15 secs) to the vSpace. VMs which have failed, and are then restarted by vSphere HA, will automatically have access to all their data.

What about a failure on the appliance itself (or indeed the ESXi host on which it resides)? This is where vSphere HA again plays a role – the Virsto appliance is being monitored by VMware HA using VMware Tools Heartbeat Monitoring, so if it fails, it gets re-started.

Any writes in process that have not been acknowledged by the log will have to be re-submitted after recovery, but anything which has been committed to the logs is not lost on failover.

In most cases, recovery from a Virsto appliance failure happens quickly enough that the VMs on the host don’t even need to be re-started (if it was just a Virsto appliance and not an ESXi host failure). If it was a host failure then the recovery order is (1) replay the log from the failed host, (2) start the VMs elsewhere in the cluster (the Virsto service doesn’t need to re-start because it’s already running on every other node in that cluster).

See Virsto at VMworld.
Virsto are an exhibitor at VMworld 2012 at booth 414. In addition to providing a demonstration of their new Virsto Software for vSphere (version 1.5), I have been told by the Virsto guys that they are also going to do a demonstration of Virsto working with EMC’s new VFCache. Definitely worth checking out in my opinion.

Get notification of these blogs postings and more VMware Storage information by following me on Twitter: @VMwareStorage

SimpliVity Announce OmniCube Storage Appliance

I recently had the pleasure of chatting with  Jesse St. Laurent, Product Director at a new storage startup called SimpliVity. SimpliVity finally exited stealth mode today, but has been around since the end of 2009, with development starting in earnest in 2010.

The name of the hardware storage appliance which SimpliVity have just announced is the OmniCube. Having asked Jesse to describe the features of the appliance, he listed the following:

  • The OmniCube is a 2U hardware Storage Appliance which has a pre-installed & pre-configured ESXi hypervisor. The appliances are deployed in configurations of 2 or more nodes and use a combination of SimpliVity software and PCIe accelerator cards, both of which are intellectual property (IP) of SimpliVity.
  • It deduplicates & compresses all data at inception – there is no need for a third-party appliance/component to deliver this. Jesse stated that they can achieve 1.5:1 for both dedupe and 1:1.5 for compression, but said he was being very conservative with this estimate.
  • The appliance provides space efficient snapshots for backup & other purposes which are VM-centric. Many backup and replication products work off of a whole datastore – SimpliVity works at the VM level.
  • The appliance supports a combination of HDD & SSD for cache & performance reasons.
  • There is a High Availability feature across multiple OmniCubes located in the same DC.
  • There is replication across OmniCubes in different datacenters for BC/DR purposes.
  • The appliance is based on a scale out architecture so customers can start out small-scale and then grow as their performance and capacity requirements grow.
  • The datastore created by SimpliVity is NFS – therefore this storage can also be shared with other hosts and VMs in the infrastructure.
  • The storage is VM-centric in so far as the deployment of VMs is policy driven (i.e. backup/snapshots policy, DR/Replication policy and supports per VM failover). Many traditional approaches require customers to snapshot or replicate complete datastores when in fact you may only be interested in one or more of the VMs on the datastore. SimpliVity have the ability to snap and replicate on a per-VM basis. I asked about whether SimpliVity has a policy to define QoS for the VMs (both for network & storage), and although the appliance is plumbed-in for these sorts of policies under the covers, it is not yet exposed so will not available at GA.

SimpliVity Omnicube

SimpliVity’s OmniCube is powered by Omnistack: the software (SVT in the above diagram) and the PCIe accelerator card. The Omnistack is designed to work with your typical DAS server. One of the other nice features of the appliance is that it is cloud ready – SimpliVity support their Omnistack (without the hardware acceleration) running in a public cloud. At the time of writing, they are only supporting it on Amazon’s EC2, . What this does mean however is that you can have DR to the Cloud pretty much out of the box. The other neat thing is that you can clone and backup across datacenters to any Omnistack instance, and restore from any instance too, including the one based in the cloud.

I put the following questions to Jesse.

  • Q. What is SimpliVity’s target market?
  • A. Jesse expected customers to start using SimpliVity storage for the tier2 applications, but added that their storage is designed to run any application running on VMware today. SimpliVity feels that current storage offerings are either too complex or too expensive. As I have not yet seen the product in action or any pricing from SimpliVity, I guess time will tell whether SimpliVity is less complex or less expensive than the competition.
  • Q. How does SimpliVity differentiate itself from the many other storage appliances operating in this space?
  • A. Jesse stated that he believed that the SimpliVity appliance was feature complete. Jesse stated that a lot of customers were faced with a proliferation of appliances to provide the complete feature set that SimpliVity provides, such as dedupe/compression appliances and cloud gateways.
  • Q. What sort of vSphere integration is there?
  • A. SimpliVity have a plugin to vCenter which allows the SimpliVity appliance(s) to be managed from the vSphere client. All nodes can be managed (same datacenter, different datacenter, nodes in the cloud) from the same management interface.
  • Q. What other components are required for deployment?
  • A. The is a PCIe ‘accelerator’ card required on the hosts. This Omnicube accelerator card is SimpliVity Intellectual Property. There is also a requirement to have 10GbE connectivity between the hosts, but in small configurations, SimpliVity will support direct connect.

It does seems like a very nice solution and I’m looking forward to seeing a live demo at VMworld 2012. SimpliVity are a gold sponsor at VMworld 2012 this year and you will find them at booth 1117.

Get notification of these blogs postings and more VMware Storage information by following me on Twitter: @VMwareStorage