Dell EMC PowerStore Networking Guide for PowerStore X Models Version 2.x June 2021 Rev.
Notes, cautions, and warnings NOTE: A NOTE indicates important information that helps you make better use of your product. CAUTION: A CAUTION indicates either potential damage to hardware or loss of data and tells you how to avoid the problem. WARNING: A WARNING indicates a potential for property damage, personal injury, or death. © 2020 - 2021 Dell Inc. or its subsidiaries. All rights reserved. Dell, EMC, and other trademarks are trademarks of Dell Inc. or its subsidiaries.
Contents Additional Resources.....................................................................................................................5 Chapter 1: Overview...................................................................................................................... 6 PowerStore X model appliance overview...................................................................................................................... 6 Supported switches................................................
Chapter 8: Initial configuration of the PowerStore X model appliance......................................... 43 Initial Configuration Wizard.............................................................................................................................................43 Get your completed Initial Configuration Worksheet .............................................................................................. 44 Appendix A: Expand a Storage network to run across multiple ports.............
Preface As part of an improvement effort, revisions of the software and hardware are periodically released. Some functions that are described in this document are not supported by all versions of the software or hardware currently in use. The product release notes provide the most up-to-date information about product features. Contact your service provider if a product does not function properly or does not function as described in this document.
1 Overview The following information is included in this chapter. Topics: • • PowerStore X model appliance overview Supported switches PowerStore X model appliance overview PowerStore X model supports block (SAN-only), and vVol workloads with a hypervisor installed on the system. The system software is deployed on the hypervisor, which enables deployment of virtual machines (VMs) and customer applications within the hardware.
Table 1. PowerSwitch documentation resources Document Reference Location Dell EMC PowerSwitch S4100ON Series Installation Guide PowerSwitch site preparation requirements, step-by-step procedures for rack mounting and desk mounting, inserting modules, and connecting to a power source.
2 Prepare to configure switches and networks This chapter contains the following information. Topics: • • PowerStore X model Network Setup Preparation Worksheet Initial Configuration Worksheet PowerStore X model Network Setup Preparation Worksheet Work with your network administrator to complete the Network Setup Preparation Worksheet to reserve the necessary information to configure the switches.
Table 2. PowerStore X model Network Setup Preparation Worksheet (blank) (continued) Step Step details Notes vMotion (tagged) Internal (untagged) 7. Reserve and record the IP addresses necessary to configure the switch below: Management IP address for switch 1 Management IP address for switch 2 Default gateway NTP server 8. Dell EMC supports deploying PowerStore X model with two Top-of-Rack (ToR) switches with a layer 2 interconnect link.
Table 2. PowerStore X model Network Setup Preparation Worksheet (blank) (continued) Step Step details Notes Spanning tree protocol for ToR switch 1 Spanning tree protocol for ToR switch 2 14. Once you have completed steps above, you have the necessary information to configure the switches.
Table 3. Initial Configuration Worksheet (blank) (continued) Ensure that there are at least the following number of SSD drives in the enclosure: ● At least 6 for single drive failure tolerance ● 7 for double drive failure tolerance NOTE: Once set, the drive failure tolerance level for an appliance cannot be changed. Networks Your cluster requires a dedicated set of IP addresses for each type of network. NOTE: VLAN information for management, storage, and vMotion networks are optional and default to 0.
Table 3. Initial Configuration Worksheet (blank) (continued) Infrastructure Services Record IP addresses for your DNS and NTP servers. It is recommended that you specify at least two addresses for DNS and NTP servers each. DNS Server NTP Server Physical/Top-of-Rack Switch Information Record the switch IP addresses to validate the cabling and switch settings before the cluster is configured.
Table 3. Initial Configuration Worksheet (blank) (continued) SupportAssist is a secure, automated health and system monitoring capability. It sends notifications to Dell EMC, enables remote support, and sends data to CloudIQ. Once your cluster is created successfully, you can connect to Dell EMC SupportAssist. If you already have SupportAssist enabled, record the associated account details and the gateway or proxy IP information here. Tip: The default port number Dell EMC uses is 9443.
3 PowerStore X model: Network configuration requirements This chapter includes the following information. Topics: • • • • Top-of-Rack (ToR) switch connectivity options and requirements PowerStore X model networks PowerStore X model networks VLAN options IP addresses for network configuration Top-of-Rack (ToR) switch connectivity options and requirements PowerStore requires connectivity to a pair of Top-of-Rack (ToR) switches.
PowerStore Network Topology with Top of Rack Switches and MC-LAG Interconnect Upstream Switch 2 Upstream Switch 1 Port Channel Top of Rack Switch 1 Port 0 MC-LAG Interconnect Port 1 Top of Rack Switch 2 Port 1 Node A Port 0 Node B PowerStore T Appliance Legend: 10 Gb 1 Gb Figure 1.
NOTE: Port location for the reliable high speed uplinks may change depending on switch vendor or model. MC-LAG is a switch interconnection technology that joins a number of independent Top-of-Rack (ToR) switches into a single virtual chassis. MC-LAG allows the link aggregation (LAG) port groups to span multiple chassis, enabling better resilience of the LAG connection.
PowerStore Network Topology with a no MC-LAG interconnect Upstream Switch 2 Upstream Switch 1 Port Channels Top of Rack Switch 1 Port 0 Top of Rack Switch 2 Port 1 Port 1 Node A Port 0 Node B PowerStore T Appliance Legend: 10 Gb 1 Gb Figure 2.
NOTE: Port location for the reliable high speed uplinks may change depending on switch vendor or model. Non-MC-LAG L2 connectivity requires redundant, high speed connections. Node to Top-of-Rack (ToR) switch connectivity Deploying with Top-of-Rack (ToR) switches requires that each of the base enclosure appliance nodes have at least one connection to each of the ToR switches to provide redundancy at the NIC and switch levels. Figure 3.
PowerStore X model networks PowerStore X model requires all networks to be unique. It is highly recommended to deploy PowerStore X model with multiple and unique VLANs to separate the traffic. However, if only one VLAN is available, you have the option to deploy PowerStore X model with a single VLAN and multiple unique subnets as demonstrated below. Figure 4. PowerStore X model network traffic Ensure that the PowerStore X model interfaces are able to communicate to each other through the VLANs shown above.
Network configuration in PowerStore All PowerStore networks must be configured on the switch. Management, Storage, and vMotion networks are configured in PowerStore the first time you create a cluster through the PowerStore Initial Configuration Wizard (ICW).
PowerStore X model networks VLAN options The following table shows an example of the different type of networks with sample VLAN IDs in a PowerStore X model appliance. Table 7. PowerStore X model VLAN configuration Sample VLAN ID Network VLAN Ports Subnet example 1 Remote Discovery (runs over the Native VLAN) Untagged 169.254.x.x/16 100 Management Tagged y.y.y.y/24 200 Storage Tagged y.y.x.y/24 400 vMotion Tagged y.y.a.
Table 8. Initial configuration IP address requirements (continued) Network IP Address assignments Per Cluster vMotion Network Number of IP Addresses ESXi Node B iSCSI Initiator 2 (optional) Global Storage Discovery IP Address (Storage Network) 0 required, 1 recommended Total Required Per VLAN or Subnet for vMotion 2 Per Appliance Node A 1 Node B 1 You can choose to assign either IPv4 or IPv6 addresses to the management, storage, or vMotion networks.
4 Configuring with Dell EMC PowerSwitch Series S4148-ON switches This chapter includes the following information.
Table 9. Network Setup Preparation Worksheet (completed) (continued) Step Step details Notes ● Port 1 on Node A, and Port 1 on Node B must connect to opposite switches Record the ToR switch ports required to connect to: Node A, Port 0 to ToR 1 port 1 Node A, Port 1 to ToR 2 port 1 Node B, Port 0 to ToR 2 port 54 Node B, Port 1 to ToR 1 port 54 3. Record the switch port to use for discovery while configuring your switches. port 13 4.
Table 9. Network Setup Preparation Worksheet (completed) (continued) Step 11. Step details Notes Uplink A to ToR 1 port 29 Uplink B to ToR 1 port 30 Uplink A to ToR 2 port 29 Uplink B to ToR 2 port 30 Record the port channel ID used for connectivity between the ToR switches, and the uplinks. If deploying with MC-LAG, enter the port channel ID for the uplink. port channel 30 Only a single port channel ID is required for MC-LAG.
3. Open a terminal emulator program, such as PuTTY, on the computer. 4. Configure the serial connection in the terminal emulator program using the following settings. Table 10. Serial connection settings Setting Value Speed(baud) 115200 (9600 for micro-USB port) Data bits 8 Stop bits 1 Parity None Flow control None 5. Connect to the switch using the terminal emulator program. 6. Enter the switch log in credentials. Default username and password are: ● Username: admin ● Password: admin 7.
Platform Name : x86_64-dellemc_s4100_c2538-r0 PPID : CN00Y2VTCES0082O0038 Service Tag : D8MSG02 License Details ---------------Software : OS10-Enterprise Version : 10.4.1.1 License Type : PERPETUAL License Duration: Unlimited License Status : Active License location: /mnt/license/D8MSG02.lic --------------------------------------------------------NOTE: If OS10EE was factory installed, a perpetual license is already installed on the switch. 4. Repeat the steps for each switch.
6. Configure the management route (default gateway) for the switch. management route 0.0.0.0/0 100.0.100.1 7. Configure an NTP server for the switch. ntp server 100.0.100.200 8. Enable the Rapid Spanning Tree Protocol (RSTP) on the switch. spanning-tree mode rstp 9. Configure the spanning tree priority on the switch.
3. Create the Internal network. interface vlan 1 description Internal_Network no shutdown exit 4. Create the Management VLAN. interface vlan 100 description Management_Network no shutdown exit 5. Create the Storage VLAN. interface vlan 200 description Storage_Network no shutdown exit 6. Create a vMotion VLAN. interface vlan 400 description vMotion_Network no shutdown exit 7. Repeat steps on Switch 2.
3. Disable L2 mode on the 100 GbE ports that will be used for VLTi on Switch1. interface range ethernet 1/1/25-1/1/26 description vlti no switchport exit 4. Create new VLTi domain and select 100 GbE ports as discovery interfaces. vlt-domain 1 discovery-interface ethernet 1/1/25-1/1/26 ● vlt-domain, and port numbers should be the same on both switches. ● Ports 25 and 26 are both 100 GbE ports on the Dell EMC PowerSwitch Series S4148-ON switches.
When enabling your uplinks to the customer network it is helpful to know that VLTi configurations for PowerStore X model require that port channels are configured for the uplink ports to avoid looping. Configure port interfaces for PowerStore X model node connectivity You configure the port interfaces between the PowerStore X model nodes and the ToR switches. 1. Establish a terminal connection to the switch to the first ToR switch (Switch1) 2. Enter global configuration mode. configure terminal 3.
Table 12.
interface port-channel 30 description Uplink no shutdown switchport mode trunk switchport access vlan 1 switchport trunk allowed vlan 100,200,400 vlt-port-channel 30 interface ethernet 1/1/29 description Uplink_Ports no shutdown channel-group 30 mode active no switchport flowcontrol receive off flowcontrol transmit off interface ethernet 1/1/30 description Uplink_Ports no shutdown channel-group 30 mode active no switchport flowcontrol receive off flowcontrol transmit off copy running-configuration startup-c
5 PowerStore X model: Cabling the appliance to the switches This chapter contains the following information. Topics: • • • Cable the base enclosure to the ToR switches Cable the ToR switches together Cable the Top-of-Rack switches to the core uplinks Cable the base enclosure to the ToR switches Cable the nodes to the Top of Rack (ToR) switches. 2 4 1 Figure 5.
Table 13. Steps to cable to the switches (continued) 4 Connect Port 0 of the top node (B), to Port 54 of the top switch (2). Cable the ToR switches together PowerStore dual switch deployments with VLT, requires that the two Top of Rack (ToR) switches are cabled together. 1 2 Figure 6. Switch-to-switch connectivity Use two cables that support connectivity between the high speed ports, for example 100Gbps Direct Attached Cables (DAC).
Cable the Top-of-Rack switches to the core uplinks Cable the Dell EMC PowerSwitch Serires S4148-ON Top-of-Rack (ToR) switches to the core uplinks. Core uplinks Uplink A 1 3 Uplink B 4 2 Figure 7. Dell EMC PowerSwitch Serires S4148-ON ToR switch connections to the core uplinks Table 15. Steps to connect to the Dell EMC PowerSwitch Serires S4148-ON ToR switches to the core uplinks 1 Connect port 30 of the bottom ToR switch to the core Uplink A.
6 Validate switch and network configuration This chapter contains the following information. Topics: • • Validate configuration on the Top-of-Rack (ToR) switches Network Validation Tool for PowerStore Validate configuration on the Top-of-Rack (ToR) switches Once you have configured and cabled your Dell EMC PowerSwitch Series S4148-ON ToR switches, validate the configuration prior to discovering yourPowerStore X model model deployment. 1. Establish a terminal session to the switch. 2.
400 Active 4094 Inactive vMotion_Network T Eth1/1/1,1/1/54 T Po30 T Po1000 5.
No mismatch VLT VLAN mismatch: No mismatch 9. Validate the VLT port configuration. show vlt vlt-port-detail vlt-port-channel ID : 30 VLT Unit ID Port-Channel Status Configured ports Active ports ------------------------------------------------------------------------------1 port-channel30 up 2 2 * 2 port-channel30 up 2 2 10. Review the running configuration for ToR switch 1, and repeat all validation steps for ToR switch 2.
7 Discovering PowerStore Appliances Once you have configured your networks and completed installing the appliances, you can discover your PowerStore appliance and begin the initial configuration process. Topics: • • Discovery with a direct connection Discovery with a remote connection Discovery with a direct connection This is the recommended procedure and requires that you are physically present in the data center or lab where the base enclosure is installed.
Discovery with a remote connection Network Node If you do not have access to the base enclosure, deploy a workstation or virtual machine on the same network as the PowerStore system and use the PowerStore Discovery Utility to discover and create a cluster. B A Figure 9.
● (Optional) Download and run the Network Validation Tool (NVT) for PowerStore to validate that your networks are correctly configured. The NVT can be downloaded from Dell EMC Central Solutions at https://psapps.emc.com/central/solution/ NVT-PowerStore.
8 Initial configuration of the PowerStore X model appliance This chapter contains the following information. Topics: • • Initial Configuration Wizard Get your completed Initial Configuration Worksheet Initial Configuration Wizard Once you have discovered the PowerStore X model appliance, you are redirected to the Initial Configuration Wizard (ICW) to configure the networks on the PowerStore X model appliance.
○ Storage Policy Based Management For details see PowerStore Virtualization Infrastructure Guide. Once you have completed the initial configuration of your PowerStore X model appliance, you have the option of adding more storage networks as described in: Create an additional Storage network.
Table 16. Initial Configuration Worksheet (completed) (continued) Networks Your cluster requires a dedicated set of IP addresses for each type of network. NOTE: VLAN information for management, storage, and vMotion networks are optional and default to 0. It is a marker used to indicate that the network traffic is not tagged and native VLAN is applied through the switch. For better security and performance, it is recommended that you specify a unique VLAN information for each type of network.
Table 16. Initial Configuration Worksheet (completed) (continued) Record IP addresses for your DNS and NTP servers. It is recommended that you specify at least two addresses for DNS and NTP servers each. DNS Server 100.0.100.20 0 100.0.100.201 NTP Server 100.0.100.20 0 100.0.100.201 Physical/Top-of-Rack Switch Information Record the switch IP addresses to validate the cabling and switch settings before the cluster is configured.
Table 16. Initial Configuration Worksheet (completed) (continued) SupportAssist (Optional) SupportAssist is a secure, automated health and system monitoring capability. It sends notifications to Dell EMC, enables remote support, and sends data to CloudIQ. Once your cluster is created successfully, you can connect to Dell EMC SupportAssist. If you already have SupportAssist enabled, record the associated account details and the gateway or proxy IP information here.
A Expand a Storage network to run across multiple ports The appendix contains the following information. Topics: • Expand a Storage network Expand a Storage network You can expand a Storage network to run across multiple ports on a PowerStore X model appliance. You will require the following information to perform the steps to expand a Storage network.
Table 18. PowerStore X model appliance Ethernet port to Virtual port mapping Ethernet Port on the 4- Virtual Port port card vSphere Port Group Uplink Port 0 vFEPort2 PG_Storage_TGT2 Uplink 2 Port 1 vFEPort1 PG_Storage_TGT1 Uplink 1 Port 2 vFEPort6 PG_Storage_TGT4 Uplink 4 Port 3 vFEPort3 PG_Storage_TGT3 Uplink 3 Perform the following steps to configure an additional port and expand a Storage network you have configured on the PowerStore X model appliance. 1.
2. Connect Port 2 of the top node (B), to Port 53 of the top switch (2). Configure the VLAN on the ToR switches The following steps provide an example of configuring VLANs on two Dell PowerSwitch Series S4148 Top-of-Rack (ToR) switches. You can cable the PowerStore X model appliance nodes to the switches before or after you perform these steps. For steps, see Cable the nodes to the ToR switches.
5. Enter the IP addresses or address range for the addresses reserved for expanding the storage network and Select Add. 6. Go to the Hardware page. 7. Select the appliance name and go to the Ports tab, and select the Virtual tab. 8. Select the checkbox next to the name of one of the Virtual ports on which you are expanding the Storage network. 9. Select Map Storage Network. 10. Select the checkbox next to the Storage network you are expanding on the Map Storage Network page, and Select Map Network.
B Create an additional Storage network This appendix contains the following information. Topics: • Create a new Storage network Create a new Storage network You can configure up to 32 storage networks, with a maximum of 8 networks per port on the 4-port card. You configure up to 8 storage networks over each one of the ports on the 4-port cards. You will require the following information to perform the steps to create a new Storage network.
Table 21. PowerStore X model appliance Ethernet port to Virtual port mapping Ethernet Port on the 4- Virtual Port port card vSphere Port Group Uplink Port 0 vFEPort2 PG_Storage_TGT2 Uplink 2 Port 1 vFEPort1 PG_Storage_TGT1 Uplink 1 Port 2 vFEPort6 PG_Storage_TGT4 Uplink 4 Port 3 vFEPort3 PG_Storage_TGT3 Uplink 3 Perform the following steps to configure an additional port on which to create a new Storage network on the PowerStore X model appliance. 1. Cable the nodes to the ToR switches.
2. Connect Port 2 of the top node (B), to Port 53 of the top switch (2). Configure a Storage network on the ToR switches The following steps provide an example of configuring a Storage network on two Dell PowerSwitch Series S4148 Top-of-Rack (ToR) switches. You can cable the PowerStore T model appliance nodes to the switches before or after you perform these steps. For steps, see Cable the nodes to the ToR switches.
4. Select the checkbox next to the name of the first Virtual port over which the storage traffic will run for the Storage network. PowerStore Manager will automatically map the Storage network to both the Virtual port you selected, and the corresponding Virtual port. 5. To validate the Storage network was successfully configured: a. Go to the Hardware page. b. Select the appliance name, go to the Ports page, and select the Virtual tab. c.
C Other Dell EMC PowerSwitch Series S4148ON switch configuration operations This appendix includes the following information. Topics: • • Reset the switch to factory settings Running configuration of Dell EMC PowerSwitch Series S4148-ON ToR switches Reset the switch to factory settings If necessary, you can reset the Dell EMC PowerSwitch Series S4148-ON switches to the default factory settings.
Table 23. Example of running-configuration on ToR switches Switch1 Switch 2 interface breakout 1/1/25 map 100g-1x interface breakout 1/1/26 map 100g-1x interface breakout 1/1/29 map 100g-1x interface breakout 1/1/30 map 100g-1x username admin password $6$q9QBeYjZ$jfxzVqGhkxX3smxJSH9DDz7/3OJc6m 5wjF8nnLD7/VKx8SloIhp4NoGZs0I/ UNwh8WVuxwfd9q4pWIgNs5BKH. role sysadmin ntp server 100.0.10.
Table 23.
Table 23.
Table 23.
Table 23.
Table 23.
