Quick Start Guide
Key Concepts​
- vCluster Control Plane: Contains a Kubernetes API server, a controller manager, a data store mount, and the Syncer.
- Syncing resources: vCluster runs your workloads by syncing pods from the virtual cluster to the host cluster.
- Pod scheduling: By default, vCluster reuses the host cluster scheduler to schedule workloads, but you can enable the virtual cluster's scheduler.
- Storage: You can use the host's storage classes without the need to create them in the virtual cluster by enabling them to sync from the host cluster to the virtual cluster.
- Networking: vCluster can sync resources such as Service and Ingress resources from the virtual to the host cluster.
- Nodes: By default, vCluster creates pseudo nodes for every pod
spec.nodeName
in the virtual cluster.
Before you begin​
In order to deploy vcluster, you need the following:
- kubectl
- Helm v3.10.0+
- Access to a Kubernetes v1.28+ cluster with permissions to deploy applications into a namespace. This is considered the host cluster for the vCluster deployment.
Since vCluster runs as an application, vCluster can run on any host cluster regardless of OS or Kubernetes distribution. The Kubernetes distribution of vCluster does not need to match the Kubernetes distribution of the host cluster. For example,
you can select a vCluster with k8s
as the distro and run it on host cluster that's running EKS.
Deploy vCluster​
Deploy a vCluster instance called my-vcluster
to namespace team-x
. This guide uses the vCluster CLI to deploy vCluster, but there are multiple ways to deploy vCluster using other tools like Helm, Terraform, ArgoCD, ClusterAPI, etc. Read about the additional options in the deployment section of the docs.
Install the vCluster CLI.
- Homebrew
- Mac (Intel/AMD)
- Mac (Silicon/ARM)
- Linux (AMD)
- Linux (ARM)
- Download Binary
- Windows Powershell
brew install loft-sh/tap/vcluster-experimental
If you installed the CLI using
brew install vcluster
, you shouldbrew uninstall vcluster
and then install the experimental version. The binaries in the tap are signed using the Sigstore framework for enhanced security.curl -L -o vcluster "https://github.com/loft-sh/vcluster/releases/download/<VCLUSTER_VERSION>/vcluster-darwin-amd64" && sudo install -c -m 0755 vcluster /usr/local/bin && rm -f vcluster
Replace
<VCLUSTER_VERSION>
with the version you want to download.curl -L -o vcluster "https://github.com/loft-sh/vcluster/releases/download/<VCLUSTER_VERSION>/vcluster-darwin-arm64" && sudo install -c -m 0755 vcluster /usr/local/bin && rm -f vcluster
Replace
<VCLUSTER_VERSION>
with the version you want to download.curl -L -o vcluster "https://github.com/loft-sh/vcluster/releases/download/<VCLUSTER_VERSION>/vcluster-linux-amd64" && sudo install -c -m 0755 vcluster /usr/local/bin && rm -f vcluster
Replace
<VCLUSTER_VERSION>
with the version you want to download.curl -L -o vcluster "https://github.com/loft-sh/vcluster/releases/download/<VCLUSTER_VERSION>/vcluster-linux-arm64" && sudo install -c -m 0755 vcluster /usr/local/bin && rm -f vcluster
Replace
<VCLUSTER_VERSION>
with the version you want to download.Download the binary for your platform from the GitHub Releases page and add this binary to your $PATH.
md -Force "$Env:APPDATA\vcluster"; [System.Net.ServicePointManager]::SecurityProtocol = [System.Net.SecurityProtocolType]'Tls,Tls11,Tls12';
Invoke-WebRequest -URI "https://github.com/loft-sh/vcluster/releases/download/<VCLUSTER_VERSION>/vcluster-windows-amd64.exe" -o $Env:APPDATA\vcluster\vcluster.exe;
$env:Path += ";" + $Env:APPDATA + "\vcluster";
[Environment]::SetEnvironmentVariable("Path", $env:Path, [System.EnvironmentVariableTarget]::User);Replace
<VCLUSTER_VERSION>
with the version you want to download.Reboot RequiredYou may need to reboot your computer to use the CLI due to changes to the PATH variable (see below).
Check Environment Variable $PATHLine 4 of this install script adds the install directory
%APPDATA%\vcluster
to the$PATH
environment variable. This is only effective for the current Powershell session, i.e. when opening a new terminal window,vcluster
may not be found.Make sure to add the folder
%APPDATA%\vcluster
to thePATH
environment variable after installing vcluster CLI via Powershell. Afterward, a reboot might be necessary.Confirm that you've installed the correct version of the vCluster CLI.
vcluster --version
(Optional) Create a
vcluster.yaml
to configure your vCluster. Various options can be configured before deploying your vCluster, but even without avcluster.yaml
, a vCluster can be deployed with the default options.Refer to the
vcluster.yaml
reference docs to explore all configuration options.vcluster.yaml configurationIf you aren't sure what options you want to configure, you can always upgrade your vCluster after deployment with an updated
vcluster.yaml
to change your configuration. There are some configuration options (e.g. backing store) that can only be defined during deployment and not changed during upgrade.Deploy vCluster using the vCluster CLI. There are other methods to deploy vCluster, but this is the quickest way to get started!
- Default (No vcluster.yaml)
- With vcluster.yaml
vcluster create my-vcluster --namespace team-x
Include your
vcluster.yaml
configuration file.vcluster create my-vcluster --namespace team-x --values vcluster.yaml
Check out the namespaces in your virtual cluster. When the virtual cluster deployment finishes, your kube context is automatically updated to the virtual cluster. When you run
kubectl
commands, it will now be pointed at your virtual cluster instead of the original Kubernetes cluster.kubectl get namespaces # See the namespaces of your virtual cluster
Use your virtual cluster​
After immediately creating your virtual cluster, your kube context is updated to point to the virtual cluster and all these commands are directed at the virtual cluster.
Deploy resources inside the virtual cluster​
To illustrate what happens in the host cluster, create a namespace and deploy NGINX in the virtual cluster.
kubectl create namespace demo-nginx
kubectl create deployment ngnix-deployment -n demo-nginx --image=nginx -r 2
Check that this deployment creates two pods inside the virtual cluster.
kubectl get pods -n demo-nginx
View resources inside the host cluster​
Most resources inside your virtual cluster only exist in your virtual cluster and not in the host cluster.
To verify this, perform these steps:
Switch your kube context from the virtual cluster to the host cluster by disconnecting.
vcluster disconnect
Check the namespaces in the host cluster to confirm you are in the correct kube context.
kubectl get namespaces
Output is similar to:
NAME STATUS AGE
default Active 35m
kube-public Active 35m
kube-system Active 35m
team-x Active 30mLook at all the deployments in the
team-x
namespace to see if thenginx-deployment
deployment was deployed on the host cluster.kubectl get deployments -n team-x
Notice that this
deployment
resource does not exist in the host cluster. By default, it does not get synced from the virtual cluster to the host cluster because it isn't required to run this workload in the host cluster.Now, look for the NGINX pods on the host cluster.
kubectl get pods -n team-x
Output is similar to:
coredns-cb5ccc67f-kqwmx-x-kube-system-x-my-vcluster 1/1 Running 0 34m
my-vcluster-0 1/1 Running 0 34m
nginx-deployment-6d6565499c-cbv4w-x-demo-nginx-x-my-vcluster 1/1 Running 0 20m
nginx-deployment-6d6565499c-s7g8z-x-demo-nginx-x-my-vcluster 1/1 Running 0 20mYou can see from the output that the the two NGINX pods exist in the host cluster. To prevent collisions, the pod names and their namespaces are rewritten by vCluster during the sync process from the virtual cluster to the host cluster.
vCluster Control PlaneThe vCluster
my-cluster-0
pod is also known as the vCluster control plane.
Explore Features​
Configure features in a vcluster.yaml
file. These examples show you how to configure some popular features. See the vcluser.yaml
configuration reference for how to configure additional features.
Expose the vCluster control plane
There are multiple ways of granting access to the vCluster control plane for external applications like kubectl. The following example uses an Ingress, but you can also do it via ServiceAccount, LoadBalancer, and NodePort.
Modify
vcluster.yaml
so that vCluster creates the required Ingress resource.vcluster.yaml ingress configurationcontrolPlane:
ingress:
enabled: true
host: $VCLUSTER_HOSTNAME
proxy:
extraSANs:
- $VCLUSTER_HOSTNAMEReplace
$VCLUSTER_HOSTNAME
with the hostname of the vCluster instance.Apply your changes.
vcluster create --upgrade my-vcluster -n team-x -f vcluster.yaml
Show real nodes
By default, vCluster syncs pseudo nodes from the host cluster to the virtual cluster. However, deploying a vCluster instance via the CLI on a local Kubernetes cluster automatically enables real node syncing, so you would not see a difference in this context.
Pseudo nodes only have real values for the CPU, architecture, and operating system, while everything else is randomly generated. Therefore, for use cases requiring real node information, you can opt to sync the real nodes into the virtual cluster.
Modify
vcluster.yaml
to sync the nodes from the host cluster to the virtual cluster.vcluster.yaml node sync configurationsync:
fromHost:
nodes:
enabled: trueApply your changes.
vcluster create --upgrade my-vcluster -n team-x -f vcluster.yaml
Sync ingress classes from host cluster to virtual cluster
If you want to use an ingress controller from the host cluster inside your virtual cluster by syncing Ingress
resources from the virtual cluster to host cluster, and allow the host cluster IngressClasses to be viewable, enable IngressClass
syncing from the host cluster to virtual cluster.
Modify
vcluster.yaml
to sync the IngressClasses from the host cluster to the virtual cluster.vcluster.yaml ingress class sync configurationsync:
fromHost:
ingressClasses:
enabled: trueApply your changes.
vcluster create --upgrade my-vcluster -n team-x -f vcluster.yaml
Sync ingress from virtual cluster to host cluster
Create an ingress in a virtual cluster to make a service in that virtual cluster available via a hostname/domain. Instead of having to run a separate ingress controller in each virtual cluster, sync the ingress resource to the host cluster so that the virtual cluster can use a shared ingress controller running in the host cluster.
Modify
vcluster.yaml
to sync the ingresses from the virtual cluster to the host cluster.sync:
toHost:
ingresses:
enabled: trueApply your changes.
vcluster create --upgrade my-vcluster -n team-x -f vcluster.yaml
Sync services from host cluster to virtual cluster
In this example, you map a service my-host-service
in the namespace my-host-namespace
to the virtual cluster service my-virtual-service
inside the virtual cluster namespace team-x
.
Modify
vcluster.yaml
to sync the ingresses from the virtual cluster to the host cluster.replicateServices:
fromHost:
- from: my-host-namespace/my-host-service
to: team-x/my-virtual-serviceApply your changes.
vcluster create --upgrade my-vcluster -n team-x -f vcluster.yaml
Delete vCluster​
Deleting a vCluster also deletes all resources within the virtual cluster and all states related to the vCluster. If the namespace on the host cluster was created by the vCluster CLI, then that namespace is also deleted.
vcluster delete my-vcluster --namespace team-x