VMware ESXi

From Leo's Notes
Last edited on 14 December 2020, at 03:18.

Keys[edit | edit source]

The hypervisor keys are available for free. To obtain one:

The license key 'VMware vSphere Hypervisor 6 License' works on all 6.x hypervisors.

Without a key, ESXi enters the "Evaluation Mode" which has all the features enabled for 60 days.

The features between an 'Evaluation' and 'VMware vSphere 6 Enterprise Plus'

Evaluation Mode Enterprise Plus
Key: 00000-00000-00000-00000-00000
Expiration date: 
Features:
Unlimited virtual SMP
H.264 for Remote Console Connections
vCenter agent for VMware host
vSphere API
Content Library
Storage APIs
vSphere vMotion
X-Switch vMotion
vSphere HA
vSphere Data Protection
vShield Endpoint
vSphere Replication
vShield Zones
Hot-Pluggable virtual HW
vSphere Storage vMotion
Shared Smart Card Reader
vSphere FT (up to 4 virtual CPUs)
Virtual Volumes
APIs for Storage Awareness
Storage-Policy Based Management
vSphere Storage APIs for Array Integration
vSphere DRS
Remote virtual Serial Port Concentrator
MPIO / Third-Party Multi-Pathing
Big Data Extensions
Reliable Memory
vSphere Distributed Switch
vSphere Host Profiles
vSphere Auto Deploy
SR-IOV
vSphere Storage I/O Control
Direct Path vMotion
vSphere Storage DRS
vSphere vMotion Metro
vSphere View Accelerator
vSphere App HA
vSphere Flash Read Cache
Cross Virtual Center vMotion
vGPU
vSphere Proactive HA
vSphere VM Encryption
vSphere Encrypted vMotion
vSphere Predictive DRS
Key: xxxxx-xxxxx-xxxxx-xxxxx-xxxxx
Expiration date: Never
Features:
Unlimited virtual SMP
H.264 for Remote Console Connections
vCenter agent for VMware host
vSphere API
Content Library
Storage APIs
vSphere vMotion
X-Switch vMotion
vSphere HA
vSphere Data Protection
vShield Endpoint
vSphere Replication
vShield Zones
Hot-Pluggable virtual HW
vSphere Storage vMotion
Shared Smart Card Reader
vSphere FT (up to 4 virtual CPUs)
Virtual Volumes
APIs for Storage Awareness
Storage-Policy Based Management
vSphere Storage APIs for Array Integration
vSphere DRS
Remote virtual Serial Port Concentrator
MPIO / Third-Party Multi-Pathing
Big Data Extensions
Reliable Memory
vSphere Distributed Switch
vSphere Host Profiles
vSphere Auto Deploy
SR-IOV
vSphere Storage I/O Control
Direct Path vMotion
vSphere Storage DRS
vSphere vMotion Metro
vSphere View Accelerator
vSphere App HA
vSphere Flash Read Cache
Cross Virtual Center vMotion
vGPU
vSphere Proactive HA
vSphere VM Encryption
vSphere Encrypted vMotion

Installation[edit | edit source]

The easiest way is to just burn the iso image and install via CD/DVD.

But if your server doesn't have a CD/DVD reader, you can try getting a USB stick.

USB Stick[edit | edit source]

I suggest using rufus on Windows to build the USB stick. I was able to get it working with ESXi 6.5 no problem.

If you're on Linux, you can try to do it manually using the steps below. Warning: These steps didn't work for me for ESXi 6.5. I kept on getting failed to load COM32 file menu.c32 when booting. I tried replacing the menu.c32 file from /usr/share/syslinux/menu.c32 to no avail.

## Set up the USB drive
root@nas:/mnt/iso# fdisk /dev/sdk

Welcome to fdisk (util-linux 2.28.2).
Changes will remain in memory only, until you decide to write them.
Be careful before using the write command.

Command (m for help): o
Created a new DOS disklabel with disk identifier 0xde56333a.

Command (m for help): p
Disk /dev/sdk: 14.7 GiB, 15720251392 bytes, 30703616 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0xde56333a

Command (m for help): n
Partition type
   p   primary (0 primary, 0 extended, 4 free)
   e   extended (container for logical partitions)
Select (default p): p
Partition number (1-4, default 1):
First sector (2048-30703615, default 2048):
Last sector, +sectors or +size{K,M,G,T,P} (2048-30703615, default 30703615):

Created a new partition 1 of type 'Linux' and of size 14.7 GiB.

Command (m for help): t
Selected partition 1
Partition type (type L to list all types): c
Changed type of partition 'Linux' to 'W95 FAT32 (LBA)'.

Command (m for help): a
Selected partition 1
The bootable flag on partition 1 is enabled now.

Command (m for help): p
Disk /dev/sdk: 14.7 GiB, 15720251392 bytes, 30703616 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0xde56333a

Device     Boot Start      End  Sectors  Size Id Type
/dev/sdk1  *     2048 30703615 30701568 14.7G  c W95 FAT32 (LBA)

Command (m for help): wq
The partition table has been altered.
Calling ioctl() to re-read partition table.
Syncing disks.

## Format the drive
root@nas:/mnt/iso# mkfs.vfat -F 32 -n USB /dev/sdk1
mkfs.fat 4.1 (2017-01-24)

## Use the syslinux utility (from syslinux-nonlinux-6.04-0.1.fc25.noarch)
root@nas:/mnt/iso# syslinux /dev/sdk1
root@nas:/usr# cat /usr/share/syslinux/mbr.bin > /dev/sdk

## Copy the files
root@nas:/mnt# mount /dev/sdk1 usb
root@nas:/mnt# cp -r iso/* usb

## Edit the syslinux.cfg file
root@nas:/mnt/usb# mv isolinux.cfg syslinux.cfg

## Edit syslinux.cfg so that the APPEND line is 'APPEND -c boot.cfg -p 1'
root@nas:/mnt/usb# cat syslinux.cfg
DEFAULT menu.c32
MENU TITLE ESXi-6.5.0-20170104001-standard Boot Menu
NOHALT 1
PROMPT 0
TIMEOUT 80
LABEL install
  KERNEL mboot.c32
  APPEND -c boot.cfg -p 1
  MENU LABEL ESXi-6.5.0-20170104001-standard ^Installer
LABEL hddboot
  LOCALBOOT 0x80
  MENU LABEL ^Boot from local disk

## Unmount the image

Updating[edit | edit source]

Make sure the update is compatible!
When upgrading across major versions, you need to make absolutely sure that your hardware is capable of supporting the new version. Refer to https://www.vmware.com/resources/compatibility.

That means no, you cannot update your HP Proliant DL380 G6 past ESXi 6.5.

6.5 to 6.7[edit | edit source]

Download the offline depot package from https://my.vmware.com/group/vmware/details?productId=742&rPId=24857&downloadGroup=ESXI670. Apply the update like so:

[root@server:/vmfs/volumes/5a6304dd-44fda002-ed6b-0026552dc0d8] esxcli software sources profile list -d /vmfs/volumes/5a6304dd-44fda002-ed6b-0026552dc0d8/
VMware-ESXi-6.7.0-8169922-depot.zip
Name                         Vendor        Acceptance Level
---------------------------  ------------  ----------------
ESXi-6.7.0-8169922-no-tools  VMware, Inc.  PartnerSupported
ESXi-6.7.0-8169922-standard  VMware, Inc.  PartnerSupported
[root@server:/vmfs/volumes/5a6304dd-44fda002-ed6b-0026552dc0d8] esxcli software profile update -p ESXi-6.7.0-8169922-standard -d /vmfs/volumes/5a6304dd-44
fda002-ed6b-0026552dc0d8/VMware-ESXi-6.7.0-8169922-depot.zip
Update Result
   Message: The update completed successfully, but the system needs to be rebooted for the changes to be effective.
   Reboot Required: true
   VIBs Installed: VMW_bootbank_ata-libata-92_3.00.9.2-16vmw.670.0.0.8169922, VMW_bootbank_ata-pata-amd_0.3.10-3vmw.670.0.0.8169922, VMW_bootbank_ata-pata-atiixp_0.4.6-4vmw.670.0.0.8169922, VMW_bootbank_ata-pata-cmd64x_0.2.5-3vmw.670.0.0.8169922, VMW_bootbank_ata-pata-hpt3x2n_0.3.4-3vmw.670.0.0.8169922, VMW_bootbank_ata-pata-pdc2027x_1.0-3vmw.670.0.0.8169922, VMW_bootbank_ata-pata-serverworks_0.4.3-3vmw.670.0.0.8169922, VMW_bootbank_ata-pata-sil680_0.4.8-3vmw.670.0.0.8169922, VMW_bootbank_ata-pata-via_0.3.3-2vmw.670.0.0.8169922, VMW_bootbank_block-cciss_3.6.14-10vmw.670.0.0.8169922, VMW_bootbank_bnxtnet_20.6.101.7-11vmw.670.0.0.8169922, VMW_bootbank_brcmfcoe_11.4.1078.0-8vmw.670.0.0.8169922, VMW_bootbank_char-random_1.0-3vmw.670.0.0.8169922, VMW_bootbank_ehci-ehci-hcd_1.0-4vmw.670.0.0.8169922, VMW_bootbank_elxiscsi_11.4.1174.0-2vmw.670.0.0.8169922, VMW_bootbank_elxnet_11.4.1094.0-5vmw.670.0.0.8169922, VMW_bootbank_hid-hid_1.0-3vmw.670.0.0.8169922, VMW_bootbank_i40en_1.3.1-18vmw.670.0.0.8169922, VMW_bootbank_iavmd_1.2.0.1011-2vmw.670.0.0.8169922, VMW_bootbank_igbn_0.1.0.0-15vmw.670.0.0.8169922, VMW_bootbank_ima-qla4xxx_2.02.18-1vmw.670.0.0.8169922, VMW_bootbank_ipmi-ipmi-devintf_39.1-4vmw.670.0.0.8169922, VMW_bootbank_ipmi-ipmi-msghandler_39.1-4vmw.670.0.0.8169922, VMW_bootbank_ipmi-ipmi-si-drv_39.1-4vmw.670.0.0.8169922, VMW_bootbank_iser_1.0.0.0-1vmw.670.0.0.8169922, VMW_bootbank_ixgben_1.4.1-11vmw.670.0.0.8169922, VMW_bootbank_lpfc_11.4.33.1-6vmw.670.0.0.8169922, VMW_bootbank_lpnic_11.4.59.0-1vmw.670.0.0.8169922, VMW_bootbank_lsi-mr3_7.702.13.00-4vmw.670.0.0.8169922, VMW_bootbank_lsi-msgpt2_20.00.04.00-4vmw.670.0.0.8169922, VMW_bootbank_lsi-msgpt35_03.00.01.00-10vmw.670.0.0.8169922, VMW_bootbank_lsi-msgpt3_16.00.01.00-1vmw.670.0.0.8169922, VMW_bootbank_misc-cnic-register_1.78.75.v60.7-1vmw.670.0.0.8169922, VMW_bootbank_misc-drivers_6.7.0-0.0.8169922, VMW_bootbank_mtip32xx-native_3.9.6-1vmw.670.0.0.8169922, VMW_bootbank_ne1000_0.8.3-4vmw.670.0.0.8169922, VMW_bootbank_nenic_1.0.11.0-1vmw.670.0.0.8169922, VMW_bootbank_net-bnx2_2.2.4f.v60.10-2vmw.670.0.0.8169922, VMW_bootbank_net-bnx2x_1.78.80.v60.12-2vmw.670.0.0.8169922, VMW_bootbank_net-cdc-ether_1.0-3vmw.670.0.0.8169922, VMW_bootbank_net-cnic_1.78.76.v60.13-2vmw.670.0.0.8169922, VMW_bootbank_net-e1000_8.0.3.1-5vmw.670.0.0.8169922, VMW_bootbank_net-e1000e_3.2.2.1-2vmw.670.0.0.8169922, VMW_bootbank_net-enic_2.1.2.38-2vmw.670.0.0.8169922, VMW_bootbank_net-fcoe_1.0.29.9.3-7vmw.670.0.0.8169922, VMW_bootbank_net-forcedeth_0.61-2vmw.670.0.0.8169922, VMW_bootbank_net-igb_5.0.5.1.1-5vmw.670.0.0.8169922, VMW_bootbank_net-ixgbe_3.7.13.7.14iov-20vmw.670.0.0.8169922, VMW_bootbank_net-libfcoe-92_1.0.24.9.4-8vmw.670.0.0.8169922, VMW_bootbank_net-mlx4-core_1.9.7.0-1vmw.670.0.0.8169922, VMW_bootbank_net-mlx4-en_1.9.7.0-1vmw.670.0.0.8169922, VMW_bootbank_net-nx-nic_5.0.621-5vmw.670.0.0.8169922, VMW_bootbank_net-tg3_3.131d.v60.4-2vmw.670.0.0.8169922, VMW_bootbank_net-usbnet_1.0-3vmw.670.0.0.8169922, VMW_bootbank_net-vmxnet3_1.1.3.0-3vmw.670.0.0.8169922, VMW_bootbank_nhpsa_2.0.22-1vmw.670.0.0.8169922, VMW_bootbank_nmlx4-core_3.17.9.12-1vmw.670.0.0.8169922, VMW_bootbank_nmlx4-en_3.17.9.12-1vmw.670.0.0.8169922, VMW_bootbank_nmlx4-rdma_3.17.9.12-1vmw.670.0.0.8169922, VMW_bootbank_nmlx5-core_4.17.9.12-1vmw.670.0.0.8169922, VMW_bootbank_nmlx5-rdma_4.17.9.12-1vmw.670.0.0.8169922, VMW_bootbank_ntg3_4.1.3.0-1vmw.670.0.0.8169922, VMW_bootbank_nvme_1.2.1.34-1vmw.670.0.0.8169922, VMW_bootbank_nvmxnet3-ens_2.0.0.21-1vmw.670.0.0.8169922, VMW_bootbank_nvmxnet3_2.0.0.27-1vmw.670.0.0.8169922, VMW_bootbank_ohci-usb-ohci_1.0-3vmw.670.0.0.8169922, VMW_bootbank_pvscsi_0.1-2vmw.670.0.0.8169922, VMW_bootbank_qcnic_1.0.2.0.4-1vmw.670.0.0.8169922, VMW_bootbank_qedentv_2.0.6.4-8vmw.670.0.0.8169922, VMW_bootbank_qfle3_1.0.50.11-9vmw.670.0.0.8169922, VMW_bootbank_qfle3f_1.0.25.0.2-14vmw.670.0.0.8169922, VMW_bootbank_qfle3i_1.0.2.3.9-3vmw.670.0.0.8169922, VMW_bootbank_qflge_1.1.0.11-1vmw.670.0.0.8169922, VMW_bootbank_sata-ahci_3.0-26vmw.670.0.0.8169922, VMW_bootbank_sata-ata-piix_2.12-10vmw.670.0.0.8169922, VMW_bootbank_sata-sata-nv_3.5-4vmw.670.0.0.8169922, VMW_bootbank_sata-sata-promise_2.12-3vmw.670.0.0.8169922, VMW_bootbank_sata-sata-sil24_1.1-1vmw.670.0.0.8169922, VMW_bootbank_sata-sata-sil_2.3-4vmw.670.0.0.8169922, VMW_bootbank_sata-sata-svw_2.3-3vmw.670.0.0.8169922, VMW_bootbank_scsi-aacraid_1.1.5.1-9vmw.670.0.0.8169922, VMW_bootbank_scsi-adp94xx_1.0.8.12-6vmw.670.0.0.8169922, VMW_bootbank_scsi-aic79xx_3.1-6vmw.670.0.0.8169922, VMW_bootbank_scsi-bnx2fc_1.78.78.v60.8-1vmw.670.0.0.8169922, VMW_bootbank_scsi-bnx2i_2.78.76.v60.8-1vmw.670.0.0.8169922, VMW_bootbank_scsi-fnic_1.5.0.45-3vmw.670.0.0.8169922, VMW_bootbank_scsi-hpsa_6.0.0.84-3vmw.670.0.0.8169922, VMW_bootbank_scsi-ips_7.12.05-4vmw.670.0.0.8169922, VMW_bootbank_scsi-iscsi-linux-92_1.0.0.2-3vmw.670.0.0.8169922, VMW_bootbank_scsi-libfc-92_1.0.40.9.3-5vmw.670.0.0.8169922, VMW_bootbank_scsi-megaraid-mbox_2.20.5.1-6vmw.670.0.0.8169922, VMW_bootbank_scsi-megaraid-sas_6.603.55.00-2vmw.670.0.0.8169922, VMW_bootbank_scsi-megaraid2_2.00.4-9vmw.670.0.0.8169922, VMW_bootbank_scsi-mpt2sas_19.00.00.00-2vmw.670.0.0.8169922, VMW_bootbank_scsi-mptsas_4.23.01.00-10vmw.670.0.0.8169922, VMW_bootbank_scsi-mptspi_4.23.01.00-10vmw.670.0.0.8169922, VMW_bootbank_scsi-qla4xxx_5.01.03.2-7vmw.670.0.0.8169922, VMW_bootbank_shim-iscsi-linux-9-2-1-0_6.7.0-0.0.8169922, VMW_bootbank_shim-iscsi-linux-9-2-2-0_6.7.0-0.0.8169922, VMW_bootbank_shim-libata-9-2-1-0_6.7.0-0.0.8169922, VMW_bootbank_shim-libata-9-2-2-0_6.7.0-0.0.8169922, VMW_bootbank_shim-libfc-9-2-1-0_6.7.0-0.0.8169922, VMW_bootbank_shim-libfc-9-2-2-0_6.7.0-0.0.8169922, VMW_bootbank_shim-libfcoe-9-2-1-0_6.7.0-0.0.8169922, VMW_bootbank_shim-libfcoe-9-2-2-0_6.7.0-0.0.8169922, VMW_bootbank_shim-vmklinux-9-2-1-0_6.7.0-0.0.8169922, VMW_bootbank_shim-vmklinux-9-2-2-0_6.7.0-0.0.8169922, VMW_bootbank_shim-vmklinux-9-2-3-0_6.7.0-0.0.8169922, VMW_bootbank_smartpqi_1.0.1.553-10vmw.670.0.0.8169922, VMW_bootbank_uhci-usb-uhci_1.0-3vmw.670.0.0.8169922, VMW_bootbank_usb-storage-usb-storage_1.0-3vmw.670.0.0.8169922, VMW_bootbank_usbcore-usb_1.0-3vmw.670.0.0.8169922, VMW_bootbank_vmkata_0.1-1vmw.670.0.0.8169922, VMW_bootbank_vmkfcoe_1.0.0.0-1vmw.670.0.0.8169922, VMW_bootbank_vmkplexer-vmkplexer_6.7.0-0.0.8169922, VMW_bootbank_vmkusb_0.1-1vmw.670.0.0.8169922, VMW_bootbank_vmw-ahci_1.2.0-6vmw.670.0.0.8169922, VMW_bootbank_xhci-xhci_1.0-3vmw.670.0.0.8169922, VMware_bootbank_cpu-microcode_6.7.0-0.0.8169922, VMware_bootbank_elx-esx-libelxima.so_11.4.1184.0-0.0.8169922, VMware_bootbank_esx-base_6.7.0-0.0.8169922, VMware_bootbank_esx-dvfilter-generic-fastpath_6.7.0-0.0.8169922, VMware_bootbank_esx-ui_1.25.0-7872652, VMware_bootbank_esx-xserver_6.7.0-0.0.8169922, VMware_bootbank_lsu-hp-hpsa-plugin_2.0.0-13vmw.670.0.0.8169922, VMware_bootbank_lsu-lsi-lsi-mr3-plugin_1.0.0-12vmw.670.0.0.8169922, VMware_bootbank_lsu-lsi-lsi-msgpt3-plugin_1.0.0-8vmw.670.0.0.8169922, VMware_bootbank_lsu-lsi-megaraid-sas-plugin_1.0.0-9vmw.670.0.0.8169922, VMware_bootbank_lsu-lsi-mpt2sas-plugin_2.0.0-7vmw.670.0.0.8169922, VMware_bootbank_native-misc-drivers_6.7.0-0.0.8169922, VMware_bootbank_qlnativefc_3.0.1.0-5vmw.670.0.0.8169922, VMware_bootbank_rste_2.0.2.0088-7vmw.670.0.0.8169922, VMware_bootbank_vmware-esx-esxcli-nvme-plugin_1.2.0.32-0.0.8169922, VMware_bootbank_vsan_6.7.0-0.0.8169922, VMware_bootbank_vsanhealth_6.7.0-0.0.8169922, VMware_locker_tools-light_10.2.0.7253323-8169922
   VIBs Removed: VMW_bootbank_ata-libata-92_3.00.9.2-16vmw.650.0.0.4564106, VMW_bootbank_ata-pata-amd_0.3.10-3vmw.650.0.0.4564106, VMW_bootbank_ata-pata-atiixp_0.4.6-4vmw.650.0.0.4564106, VMW_bootbank_ata-pata-cmd64x_0.2.5-3vmw.650.0.0.4564106, VMW_bootbank_ata-pata-hpt3x2n_0.3.4-3vmw.650.0.0.4564106, VMW_bootbank_ata-pata-pdc2027x_1.0-3vmw.650.0.0.4564106, VMW_bootbank_ata-pata-serverworks_0.4.3-3vmw.650.0.0.4564106, VMW_bootbank_ata-pata-sil680_0.4.8-3vmw.650.0.0.4564106, VMW_bootbank_ata-pata-via_0.3.3-2vmw.650.0.0.4564106, VMW_bootbank_block-cciss_3.6.14-10vmw.650.0.0.4564106, VMW_bootbank_char-random_1.0-3vmw.650.0.0.4564106, VMW_bootbank_ehci-ehci-hcd_1.0-3vmw.650.0.0.4564106, VMW_bootbank_elxnet_11.1.91.0-1vmw.650.0.0.4564106, VMW_bootbank_hid-hid_1.0-3vmw.650.0.0.4564106, VMW_bootbank_i40en_1.1.0-1vmw.650.0.0.4564106, VMW_bootbank_igbn_0.1.0.0-12vmw.650.0.0.4564106, VMW_bootbank_ima-qla4xxx_2.02.18-1vmw.650.0.0.4564106, VMW_bootbank_ipmi-ipmi-devintf_39.1-4vmw.650.0.0.4564106, VMW_bootbank_ipmi-ipmi-msghandler_39.1-4vmw.650.0.0.4564106, VMW_bootbank_ipmi-ipmi-si-drv_39.1-4vmw.650.0.0.4564106, VMW_bootbank_ixgben_1.0.0.0-8vmw.650.0.0.4564106, VMW_bootbank_lpfc_11.1.0.6-1vmw.650.0.0.4564106, VMW_bootbank_lsi-mr3_6.910.18.00-1vmw.650.0.0.4564106, VMW_bootbank_lsi-msgpt2_20.00.01.00-3vmw.650.0.0.4564106, VMW_bootbank_lsi-msgpt3_12.00.02.00-11vmw.650.0.0.4564106, VMW_bootbank_misc-cnic-register_1.78.75.v60.7-1vmw.650.0.0.4564106, VMW_bootbank_misc-drivers_6.5.0-0.0.4564106, VMW_bootbank_mtip32xx-native_3.9.5-1vmw.650.0.0.4564106, VMW_bootbank_ne1000_0.8.0-9vmw.650.0.0.4564106, VMW_bootbank_nenic_1.0.0.2-1vmw.650.0.0.4564106, VMW_bootbank_net-bnx2_2.2.4f.v60.10-2vmw.650.0.0.4564106, VMW_bootbank_net-bnx2x_1.78.80.v60.12-1vmw.650.0.0.4564106, VMW_bootbank_net-cdc-ether_1.0-3vmw.650.0.0.4564106, VMW_bootbank_net-cnic_1.78.76.v60.13-2vmw.650.0.0.4564106, VMW_bootbank_net-e1000_8.0.3.1-5vmw.650.0.0.4564106, VMW_bootbank_net-e1000e_3.2.2.1-2vmw.650.0.0.4564106, VMW_bootbank_net-enic_2.1.2.38-2vmw.650.0.0.4564106, VMW_bootbank_net-fcoe_1.0.29.9.3-7vmw.650.0.0.4564106, VMW_bootbank_net-forcedeth_0.61-2vmw.650.0.0.4564106, VMW_bootbank_net-igb_5.0.5.1.1-5vmw.650.0.0.4564106, VMW_bootbank_net-ixgbe_3.7.13.7.14iov-20vmw.650.0.0.4564106, VMW_bootbank_net-libfcoe-92_1.0.24.9.4-8vmw.650.0.0.4564106, VMW_bootbank_net-mlx4-core_1.9.7.0-1vmw.650.0.0.4564106, VMW_bootbank_net-mlx4-en_1.9.7.0-1vmw.650.0.0.4564106, VMW_bootbank_net-nx-nic_5.0.621-5vmw.650.0.0.4564106, VMW_bootbank_net-tg3_3.131d.v60.4-2vmw.650.0.0.4564106, VMW_bootbank_net-usbnet_1.0-3vmw.650.0.0.4564106, VMW_bootbank_net-vmxnet3_1.1.3.0-3vmw.650.0.0.4564106, VMW_bootbank_nhpsa_2.0.6-3vmw.650.0.0.4564106, VMW_bootbank_nmlx4-core_3.16.0.0-1vmw.650.0.0.4564106, VMW_bootbank_nmlx4-en_3.16.0.0-1vmw.650.0.0.4564106, VMW_bootbank_nmlx4-rdma_3.16.0.0-1vmw.650.0.0.4564106, VMW_bootbank_nmlx5-core_4.16.0.0-1vmw.650.0.0.4564106, VMW_bootbank_ntg3_4.1.0.0-1vmw.650.0.0.4564106, VMW_bootbank_nvme_1.2.0.32-2vmw.650.0.0.4564106, VMW_bootbank_nvmxnet3_2.0.0.22-1vmw.650.0.0.4564106, VMW_bootbank_ohci-usb-ohci_1.0-3vmw.650.0.0.4564106, VMW_bootbank_pvscsi_0.1-1vmw.650.0.0.4564106, VMW_bootbank_qedentv_2.0.3.29-1vmw.650.0.0.4564106, VMW_bootbank_qfle3_1.0.2.7-1vmw.650.0.0.4564106, VMW_bootbank_qflge_1.1.0.3-1vmw.650.0.0.4564106, VMW_bootbank_qlnativefc_2.1.30.0-11vmw.650.0.0.4564106, VMW_bootbank_sata-ahci_3.0-22vmw.650.0.0.4564106, VMW_bootbank_sata-ata-piix_2.12-10vmw.650.0.0.4564106, VMW_bootbank_sata-sata-nv_3.5-4vmw.650.0.0.4564106, VMW_bootbank_sata-sata-promise_2.12-3vmw.650.0.0.4564106, VMW_bootbank_sata-sata-sil24_1.1-1vmw.650.0.0.4564106, VMW_bootbank_sata-sata-sil_2.3-4vmw.650.0.0.4564106, VMW_bootbank_sata-sata-svw_2.3-3vmw.650.0.0.4564106, VMW_bootbank_scsi-aacraid_1.1.5.1-9vmw.650.0.0.4564106, VMW_bootbank_scsi-adp94xx_1.0.8.12-6vmw.650.0.0.4564106, VMW_bootbank_scsi-aic79xx_3.1-5vmw.650.0.0.4564106, VMW_bootbank_scsi-bnx2fc_1.78.78.v60.8-1vmw.650.0.0.4564106, VMW_bootbank_scsi-bnx2i_2.78.76.v60.8-1vmw.650.0.0.4564106, VMW_bootbank_scsi-fnic_1.5.0.45-3vmw.650.0.0.4564106, VMW_bootbank_scsi-hpsa_6.0.0.84-1vmw.650.0.0.4564106, VMW_bootbank_scsi-ips_7.12.05-4vmw.650.0.0.4564106, VMW_bootbank_scsi-iscsi-linux-92_1.0.0.2-3vmw.650.0.0.4564106, VMW_bootbank_scsi-libfc-92_1.0.40.9.3-5vmw.650.0.0.4564106, VMW_bootbank_scsi-megaraid-mbox_2.20.5.1-6vmw.650.0.0.4564106, VMW_bootbank_scsi-megaraid-sas_6.603.55.00-2vmw.650.0.0.4564106, VMW_bootbank_scsi-megaraid2_2.00.4-9vmw.650.0.0.4564106, VMW_bootbank_scsi-mpt2sas_19.00.00.00-1vmw.650.0.0.4564106, VMW_bootbank_scsi-mptsas_4.23.01.00-10vmw.650.0.0.4564106, VMW_bootbank_scsi-mptspi_4.23.01.00-10vmw.650.0.0.4564106, VMW_bootbank_scsi-qla4xxx_5.01.03.2-7vmw.650.0.0.4564106, VMW_bootbank_shim-iscsi-linux-9-2-1-0_6.5.0-0.0.4564106, VMW_bootbank_shim-iscsi-linux-9-2-2-0_6.5.0-0.0.4564106, VMW_bootbank_shim-libata-9-2-1-0_6.5.0-0.0.4564106, VMW_bootbank_shim-libata-9-2-2-0_6.5.0-0.0.4564106, VMW_bootbank_shim-libfc-9-2-1-0_6.5.0-0.0.4564106, VMW_bootbank_shim-libfc-9-2-2-0_6.5.0-0.0.4564106, VMW_bootbank_shim-libfcoe-9-2-1-0_6.5.0-0.0.4564106, VMW_bootbank_shim-libfcoe-9-2-2-0_6.5.0-0.0.4564106, VMW_bootbank_shim-vmklinux-9-2-1-0_6.5.0-0.0.4564106, VMW_bootbank_shim-vmklinux-9-2-2-0_6.5.0-0.0.4564106, VMW_bootbank_shim-vmklinux-9-2-3-0_6.5.0-0.0.4564106, VMW_bootbank_uhci-usb-uhci_1.0-3vmw.650.0.0.4564106, VMW_bootbank_usb-storage-usb-storage_1.0-3vmw.650.0.0.4564106, VMW_bootbank_usbcore-usb_1.0-3vmw.650.0.0.4564106, VMW_bootbank_vmkata_0.1-1vmw.650.0.0.4564106, VMW_bootbank_vmkplexer-vmkplexer_6.5.0-0.0.4564106, VMW_bootbank_vmkusb_0.1-1vmw.650.0.0.4564106, VMW_bootbank_vmw-ahci_1.0.0-32vmw.650.0.0.4564106, VMW_bootbank_xhci-xhci_1.0-3vmw.650.0.0.4564106, VMware_bootbank_cpu-microcode_6.5.0-0.0.4564106, VMware_bootbank_emulex-esx-elxnetcli_11.1.28.0-0.0.4564106, VMware_bootbank_esx-base_6.5.0-0.9.4887370, VMware_bootbank_esx-dvfilter-generic-fastpath_6.5.0-0.0.4564106, VMware_bootbank_esx-tboot_6.5.0-0.0.4564106, VMware_bootbank_esx-ui_1.8.0-4516221, VMware_bootbank_esx-xserver_6.5.0-0.0.4564106, VMware_bootbank_lsu-hp-hpsa-plugin_2.0.0-3vmw.650.0.0.4564106, VMware_bootbank_lsu-lsi-lsi-mr3-plugin_1.0.0-7vmw.650.0.0.4564106, VMware_bootbank_lsu-lsi-lsi-msgpt3-plugin_1.0.0-6vmw.650.0.0.4564106, VMware_bootbank_lsu-lsi-megaraid-sas-plugin_1.0.0-7vmw.650.0.0.4564106, VMware_bootbank_lsu-lsi-mpt2sas-plugin_2.0.0-5vmw.650.0.0.4564106, VMware_bootbank_native-misc-drivers_6.5.0-0.0.4564106, VMware_bootbank_rste_2.0.2.0088-4vmw.650.0.0.4564106, VMware_bootbank_vmware-esx-esxcli-nvme-plugin_1.2.0.10-0.0.4564106, VMware_bootbank_vsan_6.5.0-0.9.4887370, VMware_bootbank_vsanhealth_6.5.0-0.9.4887370
   VIBs Skipped:

6.0 to 6.5[edit | edit source]

Download the offline depot package and apply the update:

# esxcli software profile update -p ESXi-6.5.0-4564106-standard -d /vmfs/volumes/vol/VMware-ESXi-6.5.0-4564106-depot.zip

This package requires a subscription. If you're using the free license, either get the evaluation or install the update by booting with the ISO image.

5.5 to 6.0[edit | edit source]

To update a ESXi install from 5.5 to 6.0, download the ESXi 6.0 offline bundle and upload it to a datastore on the server.

Log in via SSH and execute

# esxcli software vib update -d /vmfs/volumes/datastore1/ESXi600-201504001.zip

Then reboot to apply the changes.

See Also:

Other Notes[edit | edit source]

When upgrading ESXi, keep in mind that newer versions may drop support for older CPUs.

According to the Release Notes, ESXi 6.5 drops support for the following CPUs:

Intel Xeon 51xx series
Intel Xeon 30xx series
Intel core 2 duo 6xxx series
Intel Xeon 32xx series
Intel core 2 quad 6xxx series
Intel Xeon 53xx series
Intel Xeon 72xx/73xx series

On a Xeon X5570 (HP DL380 G6), installing ESXi 6.5 gave a CPU_SUPPORT warning.

HP Smart Array[edit | edit source]

Download the vib packages from HP at http://vibsdepot.hpe.com/hpe/jul2017/.

The packages you want are:

Install the package. This may take a couple minutes.

[root@server:~] esxcli software vib install -v /scsi-hpvsa-5.5.0.102-1OEM.550.0.0.1331820.x86_64.vib
Installation Result
   Message: The update completed successfully, but the system needs to be rebooted for the changes to be effective.
   Reboot Required: true
   VIBs Installed: HPE_bootbank_scsi-hpvsa_5.5.0.102-1OEM.550.0.0.1331820
   VIBs Removed:
   VIBs Skipped:

[root@server:~] esxcli software vib install -v /ssacli-3.10.3.0-6.5.0.vib
Installation Result
   Message: The update completed successfully, but the system needs to be rebooted for the changes to be effective.
   Reboot Required: true
   VIBs Installed: HPE_bootbank_ssacli_3.10.3.0-6.5.0.4240417
   VIBs Removed:
   VIBs Skipped:

After installing the packages, reboot the system. After it comes back up, you should see the installed packages:

# esxcli software vib list

The ssacli utility is installed at /opt/smartstorageadmin/ssacli/bin/ssacli.

Command Description
# ssacli ctrl all show

Smart Array P410i in Slot 0 (Embedded)    (sn: 50123456789ABCDE)
Shows all controllers
#ssacli ctrl all show config

Smart Array P410i in Slot 0 (Embedded)    (sn: 50123456789ABCDE)


   Port Name: 1I

   Port Name: 2I


   Internal Drive Cage at Port 1I, Box 1, OK



   Internal Drive Cage at Port 2I, Box 1, OK


   Array A (Solid State SATA, Unused Space: 0  MB)

      logicaldrive 1 (59.6 GB, RAID 0, OK)

      physicaldrive 1I:1:1 (port 1I:box 1:bay 1, SATA SSD, 64 GB, OK)


   Array B (SAS, Unused Space: 0  MB)

      logicaldrive 2 (279.4 GB, RAID 1, OK)

      physicaldrive 1I:1:2 (port 1I:box 1:bay 2, SAS HDD, 300 GB, OK)
      physicaldrive 1I:1:3 (port 1I:box 1:bay 3, SAS HDD, 300 GB, OK)


   Array C (SATA, Unused Space: 0  MB)

      logicaldrive 3 (465.7 GB, RAID 1, Interim Recovery Mode)

      physicaldrive 2I:1:6 (port 2I:box 1:bay 6, SATA HDD, 500 GB, OK)
      physicaldrive 2I:1:7 (port 2I:box 1:bay 7, SATA HDD, 0 GB, Failed)

   Unassigned

      physicaldrive 1I:1:4 (port 1I:box 1:bay 4, SAS HDD, 300 GB, OK)
      physicaldrive 2I:1:8 (port 2I:box 1:bay 8, SAS HDD, 300 GB, OK)

   SEP (Vendor ID PMCSIERA, Model  SRC 8x6G) 250  (WWID: 50123456789ABCED)
Shows all controllers and drives
# ssacli ctrl all show status

Smart Array P410i in Slot 0 (Embedded)
   Controller Status: OK
   Cache Status: OK
   Battery/Capacitor Status: Failed (Replace Batteries/Capacitors)
Show controller status
# ssacli ctrl slot=0 pd all show

Smart Array P410i in Slot 0 (Embedded)

   Array A

      physicaldrive 1I:1:1 (port 1I:box 1:bay 1, SATA SSD, 64 GB, OK)

   Array B

      physicaldrive 1I:1:2 (port 1I:box 1:bay 2, SAS HDD, 300 GB, OK)
      physicaldrive 1I:1:3 (port 1I:box 1:bay 3, SAS HDD, 300 GB, OK)

   Array C

      physicaldrive 2I:1:6 (port 2I:box 1:bay 6, SATA HDD, 500 GB, OK)
      physicaldrive 2I:1:7 (port 2I:box 1:bay 7, SATA HDD, 0 GB, Failed)

   Unassigned

      physicaldrive 1I:1:4 (port 1I:box 1:bay 4, SAS HDD, 300 GB, OK)
      physicaldrive 2I:1:8 (port 2I:box 1:bay 8, SAS HDD, 300 GB, OK)
Lists all arrays and unassigned drives and their status
# ssacli ctrl slot=0 ld all show

Smart Array P410i in Slot 0 (Embedded)

   Array A

      logicaldrive 1 (59.6 GB, RAID 0, OK)

   Array B

      logicaldrive 2 (279.4 GB, RAID 1, OK)

   Array C

      logicaldrive 3 (465.7 GB, RAID 1, Interim Recovery Mode)
Show logical drives
# ssacli ctrl slot=0 pd  2I:1:6 show detail

Smart Array P410i in Slot 0 (Embedded)

   Array C

      physicaldrive 2I:1:6
         Port: 2I
         Box: 1
         Bay: 6
         Status: OK
         Drive Type: Data Drive
         Interface Type: SATA
         Size: 500 GB
         Drive exposed to OS: False
         Logical/Physical Block Size: 512/512
         Rotational Speed: 5400
         Firmware Revision: DEM6
         Serial Number: W3723FQN
         WWID: 30123456789ABCD5
         Model: ATA     ST500LM000-1EJ16
         SATA NCQ Capable: True
         SATA NCQ Enabled: True
         Current Temperature (C): 26
         Maximum Temperature (C): 46
         PHY Count: 1
         PHY Transfer Rate: 3.0Gbps
         Sanitize Erase Supported: False
         Shingled Magnetic Recording Support: None
Show disk detail.
# ssacli rescan
Rescans for new devices
# ssacli ctrl slot=0 ld 1 show

Smart Array P410i in Slot 0 (Embedded)

   Array A

      Logical Drive: 1
         Size: 59.6 GB
         Fault Tolerance: 0
         Heads: 255
         Sectors Per Track: 32
         Cylinders: 15316
         Strip Size: 128 KB
         Full Stripe Size: 128 KB
         Status: OK
         Caching:  Enabled
         Unique Identifier: 600508B1001037383941424344450500
         Logical Drive Label: A006331B50123456789ABCDE0315
         Drive Type: Data
         LD Acceleration Method: Controller Cache
Displays detailed logical drive status
# ssacli ctrl slot=0 create type=ld drives=1I:1:4,2I:1:8 raid=1
Create a new RAID 1 volume across 2 disks.
# ssacli ctrl slot=0 array c delete forced
Deletes the array 'C'

See more at: http://www.thegeekstuff.com/2014/07/hpacucli-examples

Troubleshooting[edit | edit source]

IOMMU Hangs[edit | edit source]

If your ESXi server hangs while "Initializing IOV", disable IOMMU by appending 'noIOMMU' to the kernel immediately after the new kernel boots by hitting Shift-O (letter O, not zero)

To make the changes persistent, add it to the boot arguments in /bootbank/boot.cfg

See Also:

Removing a NFS v4.1 storage using CLI[edit | edit source]

I have a NFS v4.1 mount which shows up when running df but doesn't show up in the ESXi web console. This might have been something I tried adding previously via vCenter, but it hung and locked up and resulted in some inconsistency on the system. You can remove the mount using the esxcli utility:

[root@server:~] df
Filesystem         Bytes         Used     Available Use% Mounted on
NFS41      4403187810304 116839940096 4286347870208   3% /vmfs/volumes/bnas

[root@server:~] esxcli storage nfs41 list
Volume Name  Host(s)    Share              Accessible  Mounted  Read-Only  Security   isPE  Hardware Acceleration
-----------  ---------  -----------------  ----------  -------  ---------  --------  -----  ---------------------
bnas         10.1.1.10  /nas/downloads/OS        true     true      false  AUTH_SYS  false  Not Supported

[root@server:~] esxcli storage nfs41 remove  -v bnas

Guest CentOS No Keyboard[edit | edit source]

On CentOS 7 running under ESXi 6.5, when the graphical interface starts, the keyboard stops responding.

Looking at the X logs at /var/log/Xorg.0.log, you can see that certain devices are being ignored.

[  4086.057] (**) Power Button: Applying InputClass "system-keyboard"
[  4086.057] (II) No input driver specified, ignoring this device.
[  4086.057] (II) This device may have been added with another device file.
[  4086.058] (II) config/udev: Adding input device AT Translated Set 2 keyboard (/dev/input/event1)
[  4086.058] (**) AT Translated Set 2 keyboard: Applying InputClass "system-keyboard"
[  4086.058] (II) No input driver specified, ignoring this device.
[  4086.058] (II) This device may have been added with another device file.
[  4086.059] (II) config/udev: Adding input device VirtualPS/2 VMware VMMouse (/dev/input/event2)
[  4086.059] (II) No input driver specified, ignoring this device.
[  4086.059] (II) This device may have been added with another device file.
[  4086.059] (II) config/udev: Adding input device VirtualPS/2 VMware VMMouse (/dev/input/js0)
[  4086.059] (II) No input driver specified, ignoring this device.
[  4086.059] (II) This device may have been added with another device file.
[  4086.060] (II) config/udev: Adding input device VirtualPS/2 VMware VMMouse (/dev/input/mouse0)
[  4086.060] (II) No input driver specified, ignoring this device.
[  4086.060] (II) This device may have been added with another device file.
[  4086.061] (II) config/udev: Adding input device VirtualPS/2 VMware VMMouse (/dev/input/event3)
[  4086.061] (II) No input driver specified, ignoring this device.
[  4086.061] (II) This device may have been added with another device file.
[  4086.061] (II) config/udev: Adding input device VirtualPS/2 VMware VMMouse (/dev/input/mouse1)
[  4086.062] (II) No input driver specified, ignoring this device.
[  4086.062] (II) This device may have been added with another device file.
[  4086.062] (II) config/udev: Adding input device PC Speaker (/dev/input/event4)
[  4086.063] (II) No input driver specified, ignoring this device.
[  4086.063] (II) This device may have been added with another device file.

To fix this, ensure that the xorg-x11-drv-vmware and xorg-x11-drv-evdev packages are installed.