1) Read the documentation on NetApp:
Overview of installation and configuration for NVIDIA SN2100 switches (netapp.com)
2) To understand from a support perspective:
3) To ascertain the correct Cumulus version and RCF version, and download the RCF:
NetApp Support Site - NVIDIA Cluster and Storage Switches
4) Nvidia switch support:
All software license activation is done by NVIDIA. You can find and manage your licenses by logging into the NVIDIA Enterprise Support Portal and accessing “NVIDIA APPLICATION HUB” via the “MORE” drop-down menu.
Switch Registration: It is the customer/partner’s responsibility to register all the switches purchased from NetApp directly with NVIDIA or an NVIDIA reseller. If you need to check your support contract assets, please email networking-contracts@nvidia.com
Switch Renewal: It is the customer/partner’s responsibility to change entitlements or to renew their systems to get support for their switches. Any questions on renewals, please email networking-contracts@nvidia.com
Other useful links:
- NVIDIA Networking Documentation
- Cumulus Private Customized Training | NVIDIA ACADEMY
- Upgrading Cumulus Linux | Cumulus Linux 5.4 (nvidia.com)
5) Download Cumulus:
To download the MSN2100 Cumulus software, please log into the NVIDIA Enterprise Support Portal
A: You can get an NVIDIA ENTERPRISE Account by purchasing an NVIDIA Licensed Product.
The customer needs to register the products with Nvidia and they should download the software. This is a bit frustrating if you're an installation engineer and want to install the correct version prior to a deployment!
How To Register With NVIDIA For Enterprise Support Portal Access - NetApp Knowledge Base
6) Racking the SN2100
SN2100/SN2010 Side by Side Mounting Rail Kit - NVIDIA Docs
7) Cumulus Linux 5.4 Quick Start Guide
Quick Start Guide | Cumulus Linux 5.4 (nvidia.com)
- Default login = cumulus / cumulus
- Serial 115200 baud.
cumulus@switch:~$ nv set interface eth0 ip gateway 192.0.2.1
cumulus@switch:~$ nv config apply
cumulus@switch:~$ nv set system hostname leaf01
cumulus@switch:~$ nv config apply
cumulus@switch:~$ nv set system timezone US/Eastern
cumulus@switch:~$ nv config apply
cumulus@switch:~$ date
Mon 21 Nov 2022 06:30:37 PM UTC
cumulus@switch:~$ sudo date -s "Tue Jan 26 00:37:13 2021"
cumulus@switch:~$ nv config save
8) Upgrade/Install Cumulus
** Each time Cumulus Linux is upgraded, the entire file system structure is erased and rebuilt. Your existing configuration will be erased. You must save and record your switch configuration before updating Cumulus Linux **
Upgrading Cumulus Linux | Cumulus Linux 5.4 (nvidia.com)
Cumulus Linux Image Install (ONIE)
Startup is here: /etc/nvue.d/startup.yaml
cumulus@switch:~$ nv config show -o commands > backup.config
cumulus@switch:~$ sudo onie-install -a -i http://10.0.1.251/cumulus-linux-4.1.0-mlx-amd64.bin && sudo reboot
With HTTP (remember sudo reboot)$ sudo onie-install -a -i http://10.60.132.97/x/eng/testbedN,svl/nic/files/NVIDIA/cumulus-linux-5.4.0-mlx-amd64.bin/
cumulus@switch:~$ source backup.config
cumulus@switch:~$ nv config save
Also see:
- Install Cumulus Linux in Cumulus mode (netapp.com)
- Install Cumulus Linux in ONIE mode (netapp.com)
- Upgrade Cumulus Linux versions (netapp.com)
9) Install the RCF
net show interface all
cumulus@cumulus:mgmt:~$ pwd
/home/cumulus
cumulus@cumulus:mgmt: /tmp$ scp <user>@<host:/<path>/MSN2100-RCF-v1.x-Cluster-HA-Breakout-LLDP ./
ssologin@10.233.204.71's password:
cumulus@cumulus:mgmt:/tmp$ sudo python3 MSN2100-RCF-v1.x-Cluster-HA-Breakout-LLDP
[sudo] password for cumulus:
net show interface all
net show roce config
net show interface pluggables
net show lldp
APPENDIX: Optional Stuff and Further Information
A) Steps (Enable CDPv2 and Disable LLDP) (for FPVR support with ONTAP 9.8)
nv set service lldp mode force-send-cdpv2
nv unset system config apply ignore /etc/lldpd.d/lldp-nvue.conf
nv unset system config apply ignore /etc/lldpd.d/lldpd.conf
nv unset system config apply ignore /etc/default/lldpd
nv config apply
nv config save
B) Support for Copper Connections
cumulus@cumulus:mgmt:~$ nv show interface pluggables
# Example #
cumulus@cumulus:mgmt:~$ nv set interface swp5 link fast-linkup on
cumulus@cumulus:mgmt:~$ nv config apply
switchd need to reload on this config change
Are you sure? [y/N] y
applied [rev_id: 22]
Only switchd reload required
cumulus@cumulus:mgmt:~$ net show interface all
Comments
Post a Comment