Dell EMC Networking Fibre Channel Deployment with S4148U-ON in F_port Mode Connecting server Fibre Channel HBAs to Fibre Channel storage using two S4148UON leaf switches running OS10 Enterprise Edition Dell EMC Networking Infrastructure Solutions June 2018 A Dell EMC Deployment Guide
Revisions Date Rev. Description Authors June 2018 1.0 Initial release Jim Slaughter, Andrew Waranowski The information in this publication is provided “as is.” Dell Inc. makes no representations or warranties of any kind with respect to the information in this publication, and specifically disclaims implied warranties of merchantability or fitness for a particular purpose. Use, copying, and distribution of any software described in this publication requires an applicable software license.
Table of contents Revisions............................................................................................................................................................................. 2 1 2 3 4 Introduction ................................................................................................................................................................... 5 1.1 Typographical conventions .......................................................................................
8 A B C 4 7.1 Create a storage pool .......................................................................................................................................25 7.2 Add ESXi hosts .................................................................................................................................................26 7.3 Create LUNs and configure host access ..........................................................................................................
1 Introduction Our vision at Dell EMC is to be the essential infrastructure company in the data center for today’s applications and for the cloud-native world we are entering. To attain that vision, the Dell EMC portfolio focuses on making every component of data center infrastructure (servers, storage, and networking) compelling by making the value of the integrated solution greater than the sum of the parts.
1.1 Typographical conventions The CLI and GUI examples in this document use the following conventions: 1.2 Monospace Text CLI examples Underlined Monospace Text CLI examples that wrap the page. This text is entered as a single command. Italic Monospace Text Variables in CLI examples Bold Monospace Text Commands entered at the CLI prompt Bold text GUI fields and information entered in the GUI Attachments This .pdf includes switch configuration file attachments.
2 Hardware overview This section briefly describes the primary hardware used to validate this deployment. A complete listing of hardware validated for this guide is provided in Appendix A. 2.1 Dell EMC Networking S4148U-ON The S4148U-ON enables converging LAN and SAN traffic in a single 1-RU, multilayer switch. It includes twenty-four 10GbE ports, two 40GbE ports, four 10/25/40/50/100GbE or FC8/16/32 ports, and twenty-four 10GbE or FC8/16 ports.
2.4 Dell EMC Unity 500F storage array The Unity 500F storage platform delivers all-flash storage with up to 8PB raw capacity. It has concurrent support for NAS, iSCSI, and FC protocols. The Disk Processing Enclosure (DPE) has a 2-RU form factor, redundant Storage Processors (SPs), and supports up to twenty-five 2.5" drives. Additional 2-RU Disk Array Enclosures (DAEs) may be added providing twenty-five additional drives each.
3 Topology overview Each S4148U-ON provides universal ports that may be configured as either FC or Ethernet. The mix of FC and Ethernet ports allows the switches to simultaneously connect directly to an FC SAN for storage traffic and act as leafs in a leaf-spine network for production TCP/IP traffic. Note: FC SAN traffic does not traverse the leaf-spine network, or the VLT interconnect (VLTi). FC traffic is contained within the rack. A combined FC SAN and leaf-spine topology is shown in the diagram below.
3.1 FC SAN topology detail Each S4148U-ON switch is placed in F_port mode and acts as an FC switch. This enables direct connections to N_port devices such as FC storage and server FC HBAs without the need for additional dedicated FC switches. The FC SAN topology used in this guide is shown in Figure 7. S4148U-Leaf1 S4148U-Leaf2 fc1 fc3 fc5 fc7 fc5 fc7 fc3 fc1 Leaf port numbers shown are abbreviated, e.g., fc1/1/1 is abbreviated as fc1.
3.2 OOB management network The out-of-band (OOB) management network is an isolated network for management traffic only. It is used by administrators to remotely configure and manage servers, switches, and storage devices. Production traffic initiated by the network end users does not traverse the management network. An S3048-ON switch is installed at the top of each rack for OOB management connections as shown.
4 Preparation Note: Exact iDRAC steps in this section may vary depending on hardware, software and browser versions used. See the PowerEdge server documentation for steps to connect to the iDRAC. 4.1 Reset server FC HBAs to factory defaults Note: Resetting to defaults is only necessary if installed FC HBAs have been modified from their factory default settings. 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 4.2 Connect to the server's iDRAC in a web browser and launch the virtual console.
FC ports listed in iDRAC 4. Under Fibre Channel Ports, click the icon next to the first port to expand the details as shown: WWPN for FC HBA port 1 5. Record the World Wide Port Name, outlined in red in Figure 10. A convenient method is to copy and paste it into a text file. The WWPN is used in the S4148U-ON switch FC zone configuration. 13 Dell EMC Networking Fibre Channel Deployment with S4148U-ON in F_port Mode | version 1.
6. Repeat steps 4 and 5 for FC port 2. 7. Repeat steps 1-6 for remaining servers. The FC WWPNs used in this deployment example are shown in Table 1. The Switch column has been added for reference per the cable connections in the SAN topology diagram (Figure 7).
4.3 Determine Unity 500F storage array FC WWPNs The WWPNs of FC adapters in storage arrays are also used for FC zone configuration. WWPNs on Unity storage arrays are determined as follows: 1. Connect to the Unisphere GUI in a web browser and log in. Click the Settings icon right corner of the page. 2. In the left pane of the Settings window, select Access > Fibre Channel. near the top The Fibre Channel Ports page is displayed as shown in Figure 11.
4.4 VMware preparation 4.4.1 VMware ESXi download and installation Install VMware ESXi 6.5 U1 or later on each PowerEdge server. Dell EMC recommends using the latest Dell EMC customized ESXi .iso image available on support.dell.com. The correct drivers for the PowerEdge server hardware are built into this image. This image is used to install ESXi via CD/DVD, a USB flash drive, or by mounting the .iso image through the PowerEdge server’s iDRAC interface.
5 S4148U-ON switch configuration This section covers steps to configure the S4148U-ON leaf switches running OS10EE. 5.1 Prepare switches 5.1.1 Factory default configuration The configuration commands in the sections that follow begin with S4148U-ON switches at their factory default settings.
Proceed to reboot the system? [confirm yes/no]:y 5.2 Configure switches After the switch port profile is set on both S4148U-ONs, the commands in the tables that follow are run to complete the FC configuration on both switches. The port numbers used correspond to the topology diagram shown in Figure 7. Note: The commands in the tables below should be entered in the order shown. Switch runningconfiguration files are provided as attachments named S4148U-Leaf1.txt and S4148U-Leaf2.txt.
Server and storage adapter WWPNs, or their aliases, are combined into zones to allow communication between devices in the same zone. Dell EMC recommends single-initiator zoning. In other words, no more than one server HBA port per zone. For high availability, each server HBA port should be zoned to at least one port from SP A and one port from SP B. In this deployment, one zone is created for each server HBA port.
Note: If changes are subsequently made to aliases, zones, or zone sets, the zone set must be reactivated for the changes to take effect. This is done with the following command sequence: S4148U-Leaf1# configure terminal S4148U-Leaf1(config)# vfabric vfabric_number S4148U-Leaf1(conf-vfabric-100)# zoneset activate zoneset_name Put enough unified ports in 16Gb FC mode for connections to the FC storage array. In this deployment example, four FC ports per S4148U-ON switch are used.
6 S4148U-ON validation After connected devices are configured, many commands are available to validate the network configuration. This section provides a list of the most common commands and their output for this topology. Note: The commands and output shown below are for S4148U-Leaf1. The output for S4148U-Leaf2 is similar. For additional commands and output related to the leaf-spine portion of the topology, such as VLT, BGP, etc.
Symbolic Node Name Port Type Registered with NameServer Registered for SCN UNITY::::SPA::FC:::::: N_PORT Yes Yes Switch Name Domain Id Switch Port FC-Id Port Name Node Name Class of Service Symbolic Port Name Symbolic Node Name Port Type Registered with NameServer Registered for SCN 10:00:e4:f0:04:6b:04:42 100 fibrechannel1/1/3 64:0c:00 50:06:01:66:47:e0:1b:19 50:06:01:60:c7:e0:1b:19 8 UNITY::::SPA10::FC:::::: UNITY::::SPA::FC:::::: N_PORT Yes Yes Switch Name Domain Id Switch Port FC-Id Port Name Node N
6.4 show fc zoneset active The show fc zoneset active command shows the zones and zone members in the active zone set. Members logged into the fabric are shown with an asterisk (*). S4148U-Leaf1# show fc zoneset active vFabric id: 100 Active Zoneset: zoneset1 ZoneName ZoneMember =========================================================== r640-1p1zone *20:01:00:0e:1e:09:a2:3a *50:06:01:66:47:e0:1b:19 *50:06:01:6e:47:e0:1b:19 r640-2p1zone 6.
fibrechannel1/1/3 fibrechannel1/1/5 fibrechannel1/1/7 ========================================== Note: By default, the Default Zone Mode is set to Deny. This setting denies access between FC nodes except those in the same zone of the active zone set.
7 Configure Unity FC storage This section covers configuration of a Dell EMC Unity 500F storage array. Refer to the storage system documentation for other FC storage devices. 7.1 Create a storage pool 1. 2. 3. 4. 5. Connect to the Unisphere GUI in a web browser and log in. In the left pane under STORAGE, select Pools. Click the icon. In the Create Pool dialog box, provide a Name and click Next. Select appropriate storage tiers and RAID configuration for the pool. Click Next.
7.2 Add ESXi hosts 1. In the Unisphere left pane under ACCESS, select VMware. 2. On the vCenters tab, click the icon to open the Add vCenter dialog box. 3. Enter the Network Name or Address of the vCenter server. Enter the vCenter User Name and Password and click Find. 4. A list of discovered ESXi hosts is displayed. Select the applicable hosts and click Next. 5. A VMware API for Storage Awareness (VASA) Provider is not used in this example. Click Next. 6.
5. 6. 7. 8. On the Snapshot page, leave settings at their defaults and click Next. On the Replication page, leave settings at their defaults and click Next. On the Summary page, review the details and click Finish to create the LUN. On the Results page, click Close when Overall status shows 100% Completed. The newly created LUN is now visible on the LUNs tab as shown in Figure 17. In this example, a LUN named FC-80GB that is 80GB in size has been created.
8 Configure storage on ESXi hosts In this section, the example LUN created on the storage array is used to create a datastore on an ESXi host. The datastore is used to create a virtual disk on a virtual machine (VM) residing on the ESXi host. This process may be repeated as needed for additional LUNs, hosts, and VMs. 8.1 Rescan storage 1. In the vSphere Web Client, go to Home > Hosts and Clusters. 2. In the Navigator pane, select an ESXi host with LUN access configured on the FC storage array. 3.
Adapter Details - Paths tab The Paths tab includes similar information for the host’s second storage adapter. 8.2 Create a datastore In this section, a datastore that uses the Unity LUN is created on the ESXi host. To create the datastore: 1. 2. 3. 4. In the vSphere Web Client, go to Home > Hosts and Clusters. In the Navigator pane, right-click on the ESXi host and select Storage > New Datastore. In the New Datastore window, leave the Type set to VMFS and click Next.
Datastore configured The datastore is also accessible by going to Home > Storage. It is listed under the Datacenter object in the Navigator pane. 8.3 Create a virtual disk Note: Virtual machine guest operating system deployment steps are not included in this document. For instructions, see the VMware vSphere 6.5 Documentation. Guest operating systems can be any supported by ESXi 6.5. VMs should be deployed before proceeding with this section.
New hard disk configuration options 6. Next to New Hard disk, set the size in GB less than or equal to the Maximum size shown on the line below. The size is set to 40 GB in this example. 7. Click OK to close the Edit Settings window and create the virtual disk. 31 Dell EMC Networking Fibre Channel Deployment with S4148U-ON in F_port Mode | version 1.
8.4 Configure the virtual disk Note: The following example is applicable for VMs running Windows Server 2008, 2012, or 2016. See the operating system documentation to configure virtual disks on other supported guest operating systems. 1. Power on the VM and log in to the Windows Server guest OS. 2. In Windows, go to Server Manager > Tools > Computer Management > Storage > Disk Management. Note: If an Initialize Disk window appears, select OK to initialize now, or Cancel to initialize in step 5. 3.
A Validated components The following tables include the hardware, software, and firmware used to configure and validate the examples in this guide. A.1 Switches Switches and OS versions A.2 Qty Item OS Version 2 Dell EMC Networking S4148U-ON leaf switches 10.4.0E(R3P2) 1 Dell EMC Networking S3048-ON management switch 10.4.0E(R3P2) PowerEdge R640 servers R640 server components A.3 Qty per server Item Firmware version 1 Intel Xeon Gold 6126 CPU @ 2.
A.4 VMware software The following table lists the VMware software components used to validate the examples in this guide. VMware software versions A.5 Item Version VMware ESXi 6.5 U1 - Dell EMC customized image version A10, build 7967591 VMware vCenter Server Appliance 6.5 Update 1d – build 7312210 (Includes vSphere Web Client) VMware licenses The vCenter Server is licensed by instance.
B Technical support and resources Dell TechCenter is an online technical community where IT professionals have access to numerous resources for Dell EMC software, hardware, and services. B.1 Dell EMC product manuals and technical guides Manuals and documentation for Dell EMC Networking S3048-ON Manuals and documentation for Dell EMC Networking S4148U-ON Manuals and documentation for Dell EMC PowerEdge R640 OS10 Enterprise Edition User Guide Release 10.4.
C Support and feedback Contacting Technical Support Support Contact Information Web: http://www.dell.com/support Telephone: USA: 1-800-945-3355 Feedback for this document We encourage readers to provide feedback on the quality and usefulness of this publication by sending an email to Dell_Networking_Solutions@Dell.com. 36 Dell EMC Networking Fibre Channel Deployment with S4148U-ON in F_port Mode | version 1.
