Note:

Configure VMware vSAN file share with Oracle Cloud VMware Solution

Introduction

Oracle Cloud VMware Solution provides customer-managed native Oracle Cloud Infrastructure (OCI) service that provisions VMware Software Defined Data Center (SDDC)) in a customer’s tenancy. The Oracle Cloud VMware Solution SDDC consists of VMware software products(vSphere, vSAN and NSX-T) built on top of the OCI’s hyper-converged bare metal compute hardware.

Oracle Cloud VMware Solution currently uses BM DenseIO2.52 (Intel) and BM Dense E4.128 (AMD) compute shapes to create a VMware SDDC and offers an option to deploy SDDC with VMware vSphere versions 6.5, 6.7 and 7.0.

Note: The End of General Support for VMware vSphere 6.5 and 6.7 was October 15, 2022. To upgrade, see the Perform an in-place upgrade from Oracle Cloud VMware Solution 6.x to 7.x tutorial link in the Related Links section.

VMware vSAN offers software-defined storage capabilities to SDDC workloads by combining all-flash NVMe drives from OCI bare metal server. VMware vSAN also offers a native integrated File Service to create file shares in the VMware vSAN datastore that SDDC VMs can access. The data stored in a file share can be accessed from any device that has access rights. The VMware vSAN File Service exposes storage endpoints to clients for the respective storage protocol used such as SMB, NFSv3, NFSv4.1.

Objective

This tutorial provides an operational overview of how to configure the VMware vSAN File Service and provide file share capabilities to the SDDC VMs (clients). The focus of this tutorial is to highlight the ‘how-to’ steps required to configure the VMware vSAN file share with best practices architecture in an Oracle Cloud VMware Solution environment.

The intent is to provide existing Oracle Cloud VMware Solution customers to use the VMware vSAN file service option within Oracle Cloud VMware Solution SDDC as a shared file storage for the workloads. Customers can always use this architecture and implementation for the applications requiring shared file storage capabilities without paying an additional cost for external file storage service.

Prerequisites

Architecture Overview

The architecture diagram below represents the VMware vSAN file share implementation within Oracle Cloud VMware Solution SDDC. It also depicts how the Oracle Cloud VMware Solution SDDC VMs (clients) are connected to NSX overlay segment to utilize the VMware vSAN File share service.

vSAN File Share Architecture with Oracle Cloud VMware Solution

The architecture has the following components:

Task 1: Create a dedicated VLAN

This section describes how to create a VLAN backed DvPortgroup for the VMware vSAN file share.

  1. Login to the OCI console and from the left navigation pane, go to Networking, click Virtual Cloud Network, and then select the VCN where you have deployed the Oracle Cloud VMware Solution SDDC.

  2. Navigate to Network Security Groups and click Create Network Security Group.

    Note: We are creating this Network Security Group for the VMware vSAN File Share VLAN to accept the inter-VCN and overlay traffic.

  3. Add ingress and egress rule to accept the communication from the VCN CIDR and NSX overlay network where the SDDC VMs are connected.

    Create VLAN

  4. Now, let’s create a Route Table for VMware vSAN VLAN file share. Click Route Tables under the VCN and then click Create Route Table.

  5. Provide the name of the Route Table, select the appropriate compartment and click +Another Route Rule to add the routes.

    Note: Add a route of Target Type: Private IP and the destination CIDR of NSX Overlay network and use Target selection as NSX VIP IP.

    Create VLAN

  6. Now, let’s create a VLAN for VMware vSAN file share and associate the network security group and route table created in the previous steps. Click on the VLANs under VCN and then click Create VLAN.

    1. Provide the name of the VLAN.
    2. Select the compartment.
    3. Select the Regional VLAN Type.
    4. Provide the Network CIDR Block.
    5. Associate the Route Table created in Step 4.
    6. Associate the Network Security Group created in Step 2.
  7. Click Create VLAN.

    Create VLAN

    Note: Now we should associate the newly created VLAN to each ESXi host in the cluster. Each OCI compute instance has 2 physical NICs and every VLAN created should be associated with both the physical NICs. To do so, navigate to the Compute, and then click Instances.

  8. Locate your ESXi compute instance and click on the instance to open.

  9. Navigate to Attached VNICs and click Create VNIC.

    1. Provide the name of the VNIC but provide nic0 as suffix to the name.
    2. Select the Virtual Cloud Network.
    3. Select “Advanced setup: VLAN” as a Network.
    4. Select the VLAN created in step 7.
    5. Select the Physical NIC as “NIC 0”
  10. Click Save Changes.

    Create VLAN

  11. On the same OCI compute instance, the VLAN should be attached to the second physical NIC. Click Create VNIC.

  12. Provide the same name as step 9.1 with suffix nic1.

  13. Select the VCN.

  14. Select the “Advanced setup: VLAN” as a Network.

  15. Select the VLAN created in step 7.

  16. Select the Physical NIC as “NIC 1”.

  17. Click Save Changes.

    Create VLAN

  18. Repeat the steps 8 to 12 for all the remaining ESXi hosts.

  19. As a result of these steps, you are expected to see two VNICS associated with the VLAN attachment and with VLAN tag. Note down the VLAN tag. In this example screenshot below, the VLAN tag is 3661.

    Create VLAN

  20. Now, let’s create DvPortgroup in the vCenter from this new VLAN. Login to the vCenter server and navigate to Networking view.

  21. Click DSwitch, ACTIONS, Distributed Port Group, and then click New Distributed Port Group.

    Create VLAN

  22. Provide the name of the DvPortgroup and click NEXT.

    Create VLAN

  23. Configure the following settings on the wizard:

    1. Port binding : Ephemeral-no binding
    2. Network resource Pool: default
    3. VLAN Type: VLAN
    4. VLAN ID: VLAN Tag (from step 14)
  24. Click NEXT and then click FINISH.

    Create VLAN

  25. Right-click on the newly created DvPortgroup and click Edit Settings.

  26. Click Security and select Accept from the Promiscuous mode and Forged transmits drop-down lists.

    Create VLAN

Task 2: Configure VMware vSAN file share

  1. Login to Oracle Cloud VMware Solution vCenter Server, navigate to the Hosts & Cluster view and select cluster.

  2. Navigate to Configure and select Services under vSAN and click ENABLE.

    Configure vSAN File Share

  3. The vSAN file service configuration wizard will appear. Click NEXT.

    Configure vSAN File Share

  4. Leave the default option selected Automatically load latest OVF and select the Trust the certificate checkbox.

    NOTE: The default Oracle Cloud VMware Solution implementation has outbound internet connectivity for vCenter server. If you have changed this setting for any reason then make sure the vCenter has internet access to fetch the OVF or download the OVF file from the url shown in the wizard and use Manual load OVF option.

    Configure vSAN File Share

  5. On the wizard provide inputs as below.

    1. File service domain: Provide vSAN file service domain. Should be a unique namespace.
    2. Provide the DNS Servers: In this example, the DNS server IP addresses that resolves the vCenter, ESXi hosts and other SDDC VM workloads are provided.
    3. DNS Suffix: provide the DNS suffix.
    4. Select the checkbox for Directory service: Active directory.
    5. AD domain: Provide the name of the AD domain.
    6. AD Username: Provide the AD user who has administrative privileges.
    7. Password: Provide the password for the AD user.
  6. Click NEXT.

    Configure vSAN File Share

  7. Select the network that was created in Task 1 (steps 15 to 21).

  8. Provide the subnet mask and gateway of the network.

    Configure vSAN File Share

  9. Now in the next screen, the IP addresses of the same number of esxi hosts in the cluster should be provided with the name resolution.

  10. Login to the AD/DNS server and create the A and PTR records for the free static IP addresses. Refer to the screenshot below where the Oracle Cloud VMware Solution cluster consists of 3 ESXi hosts and therefore 3 DNS records are pre-created.

    ConfigurevSAN File Share

  11. Provide the first IP address on the VMware vSAN file share IP Pool screen and click AUTOFILL. The remaining number of IP addresses are auto populated in the sequence.

  12. Click LOOKUP DNS and these values should be auto populated as a result of step 10.

    Configure vSAN File Share

  13. Review the configuration parameters and click FINISH.

  14. Once the operation is successful you are expected to see the following output in the vCenter Server.

    Configure vSAN File Share

Task 3: Validate the VMware vSAN file share setup

You must validate the VMware vSAN file share setup with the clients (SDDC VMs). Here we will create the vSAN file share and mount it to the SDDC VM.

Assumptions / Prerequisites:

Task 3.1 : Create VMware vSAN file share

  1. Login to the vCenter server, navigate to the Hosts & Cluster view and click on the cluster, Configure, File Shares under vSAN and then click ADD.

    Configure vSAN File Share

  2. Provide the details in the wizard to create a file share with the NFS or SMB protocols.

    1. Name: Provide the name of the file share.
    2. Protocol: Select the protocol as per your choice NFS or SMB. In this example, NFS has been selected.
    3. Versions: Select the NFS version. It supports NFS 4.1 and NFS 3 as well. The NFS versions are not applicable if the SMB protocol is selected.
    4. Storage policy: Select the vSAN storage policy. You can select the existing one or choose to create a custom storage policy according to your requirement.
    5. (Optional) Select the storage space quotas.
    6. (Optional)Labels: Select labels or tags.

    Configure vSAN File Share

  3. Click NEXT.

  4. Select the Net access control to decide how and who can access the file share. Refer to the screenshot below where specific IP CIDR is allowed to communicate with the file share. Click NEXT.

    Configure vSAN File Share

  5. Review the configuration and click FINISH. Once the file share is created, you should be able to capture the details from the vCenter server.

  6. Login to the vCenter server and navigate to the Hosts & Cluster view, Configure, File Share under vSAN, and click on View File Share created in Task 2. This page will show you the export path for NFS v3 and NFS v4.1.

    Configure vSAN File Share

  7. Now, Mount the NFS to the client VMs.

  8. Login to client SDDC VM and install the NFS client (Windows, Linux) if not already done so.

  9. Map the vSAN file share as shown in the screenshot below.

    Configure vSAN File Share

As a result, you should be able to see shared network drive mounted on the operating system. Refer to the sample screenshot below for Windows client.

Configure vSAN File Share

Acknowledgments

Author: Devendra Gawale (Cloud VMware Solutions Specialist, EMEA)

More Learning Resources

Explore other labs on docs.oracle.com/learn or access more free learning content on the Oracle Learning YouTube channel. Additionally, visit education.oracle.com/learning-explorer to become an Oracle Learning Explorer.

For product documentation, visit Oracle Help Center.