Kubernetes, Hadoop, Persistent Volumes and vSAN

At VMworld 2018, one of the sessions I presented on was running Kubernetes on vSphere, and specifically using vSAN for persistent storage. In that presentation (which you can find here), I used Hadoop as a specific example, primarily because there are a number of moving parts to Hadoop. For example, there is the concept of Namenode and a Datanode. Put simply, a Namenode provides the lookup for blocks, whereas Datanodes store the actual blocks of data. Namenodes can be configured in a HA pair with a standby Namenode, but this requires a lot more configuration and resources, and introduces additional…

Fun with PKS, K8s, VCP, StatefulSets and Couchbase

After just deploying the newest version of Pivotal Container Services (PKS) and rolling out my first Kubernetes cluster (read all about it here), I wanted to try to do something a bit more interesting than just create another persistent volume claim to test out our vSphere Cloud Provider since I had done this  a number of times already. Thanks to some of the work I have been doing with our cloud native team, I was introduced to StatefulSets. That peaked my interest a little, as I had not come across them before.

vSAN 6.7U1 – Capacity History – Unable to query charts data

A very quick heads-up to let you know about an issue some of us experienced with vSAN 6.7U1 and about how to resolve it. We noticed that after upgrading to vSAN 6.7U1, the new Capacity History view did not work. However brand new installs of 6.7U1 worked just fine. The error that one gets from trying to look at the capacity history is “Unable to query charts data for capacity history” as shown below: I’m pleased to report that we have a solution for this issue already. It was caused by an inability to update the database schema in the…

PKS deployment revisited – some changes in v1.2.2

It is almost 6 months since I last rolled out a deployment of Pivotal Container Service (PKS). I just did a new deployment this week using some of the more later builds of Pivotal Operations Manager (v2.3), and PKS (v1.2.2) and noticed a number of changes. This post is to take you through those changes and highlight where things are different and might catch you out. I am not going to go through all of the requirements from scratch – there are a number of posts already available which explain the command line tools that you need, and so on.…

A primer on First Class Disks/Improved Virtual Disks

A First Class Disk (FCD), also referred to as Improved Virtual Disk (IVDs), is one of the more recent features in vSphere that may have escaped your notice. FCDs were created to address a particular gap that we have in vSphere at this time. We are well aware that within a vSphere environment, it is currently very difficult to manage virtual disks unless they are associated with a virtual machine. A simple example would be snapshots. Snapshots work at a per VM basis, and to only snapshot a single VMDK rather than all VMDK attached to a VM involves a…

New vSAN 6.7U1 Advanced Options

Most readers will be aware that vSAN version 6.7U1 was recently released. For those of you who wish to know more about the release, I wrote this blog article last month detailing the new features. In this post I want to cover an item which many of you may not be aware of. It is a new feature which makes the most common vSAN advanced options visible and configurable in the vSphere UI. There are 3 advanced options which we have surfaced up. The first is the VSAN.ClomRepairDelay timer which is the delay used before rebuilding ABSENT components. The second…

My VMworld 2018 recorded sessions

At this year’s VMworld, I was very fortunate to have 3 of my submitted sessions accepted for both VMworld in Las Vegas and again for VMworld in Barcelona. Not only that, but I got the opportunity to present with my friends and colleagues, Christos, Duncan and Paudie. The sessions that I presented in both Las Vegas and Barcelona were as follows: HCI1246BE – Optimizing vSAN for Performance with Paudie O’Riordan HCI1270BE – The Power of Storage Policy-Based Management with Duncan Epping HCI1338BE – vSAN: An Ideal Storage Platform for Kubernetes-controlled Cloud-Native Apps with Christos Karamanolis These have now been re-recorded…