[NVMe-oF] How to Setup NVMe-oF with VMware and NetApp

Some quick notes on how to configure VMware vSphere and NetApp ONTAP for end-to-end NVMe-oF. An Express Guide!
 
Overview: NVMe-oF vs FC Concepts
 
   FCP | NVMe-oF
-------+--------
   LUN | Namespace
  WWPN | NQN
Igroup | Subsystem
  ALUA | ANA
 
NQN = NVMe Qualified Name
ANA = Asymmetric Namespace Access
 
How to Set Up NVMe-oF - vSphere 7.0: Step-by-Step Guide
 

  • Disable the HppManageDegradedPaths parameters on each host – *Reboot required
    • # esxcfg-advcfg -s 0 /Misc/HppManageDegradedPaths
  • Configure the Broadcom FC adapter for NVMe-oF
    • # esxcli software vib install -d /tmp/t/Emulex-FCoE-FC-lpfc-12.4.224.0-offline-bundle-13621872.zip --no-sig-check
  • For LPe32000 & LPe31000 series adapter enable the NVMe-FC
    • # esxcli system module parameters set -m lpfc -p lpfc_enable_fc4_type=3
  • Upgrade the HBA firmware viersion if needed (Check IMT) – *reboot required
    • # esxcli software vib install -d /tmp/t/Emulex-elxmgmt-6.8.7-12.4.211.7.zip --no-sig-check
  • Retrieve the NVMe NQN
    • # esxcli nvme info get
 
How to Set Up NVMe-oF with NetApp ONTAP 9.7
 
Note: You can use System Manager for this.
  • Create dedicated SVM
  • Remove all protocols from the SVM
  • Add NVME protocol 
  • Create NVMe service
  • Create NVMe-oF LIF on each node (2 per node)
  • Create NVME namespace & subsystem
  • Add host NQN to subsystem
  • Map namespace to a subsystem
Image: NVMe Over Fabrics (NVMe-oF) with NetApp ONTAP


Comments