A place to record some links on:
Project: Migrate data to ONTAP, move site, Commvault, Cloud Backup, S3
- Minimum recommended ONTAP version:
- SU2: Minimum Recommended ONTAP releases (9.12.1P2 as of writing)
- Aggregate layout. Check the following for maximum aggregate size and more:
- https://hwu.netapp.com/
- Maximum aggregate size for FAS8300 running ONTAP 9.12.1 = 800TB
- 50*16TB disks would hit max aggregate size.
- In my scenario > 2.2PB usable is expected.
- We have (30+60+60+60 = 210) * 16TB disks and shelves are DS460C (not dual carrier)
- Suggestion 1: ADP on 24 disks.
- RAID-TEC across 24 partitions (give it to node 1)
- 8 spares (4 per controller.)
- Node 1 has 2 aggrs with RAID-TEC RGs: 24&26 + 25&26
- Node 2 has 2 aggrs with RAID-TEC RGs: 24&26 + 25&26
- Will give closer to 3PB usable
- A bit on volume efficiencies:
- How to consider additional ONTAP storage efficiency options on FAS systems
- How to enable cross volume storage efficiency on FAS systems
- cluster1::> system node run -node * -command "options sis.idedup_allow_non_aff_hya on"
- How do I realize aggregate dedupe savings after moving NVE to NAE volumes?
- Flexgroups:
- TR-4557: NetApp ONTAP FlexGroup Volumes - A Technical Overview
- TR-4571: NetApp ONTAP FlexGroup volumes - Best practices and implementation
- ONTAP Workgroup Mode:
- NAS Migration tool:
- Customer has been recommended XCP but I understand it is CIFS data that is being copied in which case the NetApp Preferred tool is DataDobi (there is a cost)
- Preferred: SnapMirror/SVMDR, 7MTT and/or DataDobi
- Secondary: StorageX
- Tertiary: Cloud Sync and all other licensed 3rd party tools
- Other Tools: RSYNC & XCP (Linux), Robocopy (Windows), NDMPcopy (NetApp to NetApp)
- NetApp ONTAP S3:
- Commvault integration with NetApp ONTAP S3:
- Commvault supports integration with NetApp ONTAP 9.12.1 S3
- Cloud Backup:
- Cloud Backup Service - Short Video Introduction
- Learn about BlueXP backup and recovery | NetApp Docs
- Note: CBS supports Flexgroups from 9.12.1
NetApp Cloud Backup aka BlueXP Backup and Recovery |
APPENDIX
A1: Deployment Steps
- Rack, stack, cable and power on kit.
- ONTAP version.
- Cluster setup (5 IPs required - cluster mgmt, 2 x node mgmt, 2 x SP)
- Onboard key-manager configuration (OKM)
- Aggregate configuration (including NAE)
- Apply licenses (NLF in ONTAP 9.10.1 +)
- Create an SVM
- Create data LIFs
- Create a CIFS server in a workgroup
- Create a big FlexGroup
- Enable storage efficiencies
- Create CIFS shares and folders
- Snapshot configuration as required
A2: Creating FlexGroup in ONTAP System Manager on 9.12.1
For testing in LoD, I used ONTAP System Manager to create a FlexGroup volume with this specification:
- Size = 200 GiB
- No QoS
- SMB/CIFS share
- Nothing else
This created a FlexGroup with 4 x 50GiB constituent volumes (2 per available data aggregate.)
SIMBOXs have the 'All-Flash Optimized = True' personality, so this test does not simulate what happens for a FAS (can we changed the personality in LoD!?) Note: To see this run> node show -instance
The volume efficiency settings for the FlexGroup show:
- Efficiency Policy Name = auto
- Compression = true
- Inline compression = true
- Storage efficiency mode = default
- Inline dedupe = true
- Data compaction = true
- Cross volume inline deduplication = true
- Cross volume background deduplication = true
And these are our volume efficiency modify options:
cluster1::> volume efficiency modify -volume FlexGroup01 -?
-vserver VSERVER
-schedule SCHEDULE
-policy EFF_POLICY_NAME
-compression {true|false}
-inline-compression {true|false}
-storage-efficiency-mode {default|efficient}
-inline-dedupe {true|false}
-data-compaction {true|false}
-cross-volume-inline-dedupe {true|false}
-cross-volume-background-dedupe {true|false}
Default volume efficiency policies = auto, default, inline-only.
Enabling volume efficiencies:
Cluster::> volume efficiency on -volume VOLUME -vserver VSERVER
Cluster::> volume efficiency modify -volume VOLUME -vserver VSERVER -policy default -compression true -inline-compression true -inline-dedupe true -data-compaction true -cross-volume-inline-dedupe true -cross-volume-background-dedupe true
A3: How to create a new CIFS server configured for Workgroup mode?
Cluster::> vserver cifs create -vserver [vserver_name] -cifs-server [cifs_server_name] -workgroup [workgroup_name]
A4: Maximum files on a FAS8300 running ONTAP 9.12.1
2'000'000'000 files per volume
2'000 volumes per HA Pair (1'000 per node)
TOTAL = 4'000'000'000'000 (4 thousand billion)
Note: Each file requires 4KB space, so to achieve that you'd need > 14.5 PB
A5: Other things to consider
Comments
Post a Comment