Design & Build

Data Center Solution, Storage-Validation Test: Brocade VCS Fabric and EMC VNX VG2 NAS Storage

by on ‎10-21-2014 12:02 PM (2,540 Views)
 

 

Preface

 

Overview

Many data centers use network attached storage (NAS) for a variety of applications and workloads. As more data is stored on NAS, efficient network designs are under evaluation to minimize latency, maximum use of interswitch links between switches and to automate network configuration changes. For these reasons, Brocade’s VCS Fabric with Brocade VDX Switches is increasingly being deployed when new NAS arrays are added to the storage pool.

 

Purpose of This Document

The goal of this document is to validate Brocade VCS Fabric with the EMC VNX VG2 NAS storage array. The testing includes test cases that demonstrate VCS Fabric feature support, high availability and resiliency and automatic network reconfiguration when links are added or removed. This document provides validation test results for typical use cases of NAS with Brocade’s VCS Fabric and EMC VNX VG2 NAS storage arrays.

 

Audience

The content in this document is written for a technical audience, including solution architects, system engineers, and technical development representatives.

 

Objectives

  1. Validate interoperability with redundant and non-redundant network topologies with Brocade VCS and EMC VNX VG2.
  2. Identify any unique configuration details necessary to establish end-to-end connectivity.
  3. Simulate real-world customer environment perturbations and validate end-to-end behavior and recovery.

 

Test Conclusions

  1. Brocade VCS Fabric and EMC VNX VG2 NAS array smoothly interoperate with both redundant and non-redundant configurations. No exceptions were noted.
  2. The configuration procedures followed Brocade VCS Fabric and EMC VNX VG2 standard documentation guides and found no issues with these procedures.
  3. All simulated changes in network and storage (add, remove, failover) resulted in expected behaviors and I/O recovery.

 

Related Documents

 

References

 

Document History

Date                  Version        Description

10-22-2014       1.0                  Initial version

 

Key Contributors

The content in this guide was provided by the following key contributors.

Test Architects: Dustin Maiers, Patrick Stander

Test Engineer: Robert Batesole

 

About Brocade

Brocade networking solutions help the world’s leading organizations transition smoothly to a world where applications and information reside anywhere. This vision is realized through the Brocade One™ strategy, which is designed to deliver key business benefits such as unmatched simplicity, non-stop networking, application optimization, and investment protection.

 

Innovative Ethernet and storage networking solutions for data center, campus, and service provider networks help reduce complexity and cost while enabling virtualization and cloud computing to increase business agility.

 

To help ensure a complete solution, Brocade partners with world-class IT companies and provides comprehensive education, support, and professional services offerings.

 

To learn more, visit ( www.brocade.com )

 

About EMC

EMC is a global leader in enabling businesses and service providers to transform their operations and deliver information technology as a service (ITaaS). Fundamental to this transformation is cloud computing. Through innovative products and services, EMC accelerates the journey to cloud computing, helping IT departments to store, manage, protect and analyze their most valuable asset — information — in a more agile, trusted and cost-efficient way.

 

To learn more, visit ( www.emc.com )

 

Test Plan

The storage array is connected to one VDX Ethernet fabric with multiple Windows and Red Hat server hosts to drive I/O.

 

Scope

Testing will be performed with GA versions of Brocade’s Network Operating System (NOS) in a heterogeneous environment. Test beds will include Brocade switches configured in routed and non-routed fabric configurations.

 

Testing is centered on interoperability and optimal configuration. Performance is observed within the context of best practice fabric configuration; however absolute maximum benchmark reporting of storage performance is beyond the scope of this test.

 

Test Configuration

 

Test Topology.jpg 

   Test Topology

 

The following diagram shows VCS Fabric switch port connections and vLAG (port-channel) ports for each server and the storage array. For example, “1/0/1” means the device port connects to Rbridge# = 1, Card# = 0, and Port# = 1. For fixed top of rack switches such as the VDX 6740, there are no port cards, which are indicated by “0” for the Card#.

 

Device to VCS Fabric Switch Port Connections.jpg

   Device to VCS Fabric Switch Port Connections

 

DUT Descriptions

The following tables provide details about the devices under test (DUT).

 

Storage Array

Model

Vendor

Description

VNX VG2

EMC

The EMC® VNX® VG2 platform delivers a comprehensive, consolidated solution with NAS storage in a centrally managed information storage system, enabling you to dynamically grow, share, and cost-effectively manage file systems with multi-protocol file access. This entry-level EMC IP storage solution extends your existing storage investment with a low-cost SAN-plus-NAS platform.

 

Switches

Model

Vendor

Description

BR-VDX6740

Brocade

The Brocade VDX 6740 and 6740T are Ethernet fabric Top of Rack (ToR) switches featuring 10 GbE ports with 40 GbE uplinks. The new Brocade VDX 6740T-1G Switch offers dual-speed functionality. It can be deployed with1000BASET for existing 1 GbE server connectivity and upgraded via software to 10GBASE-T for future bandwidth growth. Together with Brocade VCS Fabric technology, these switches deliver the high performance and low latency needed to support demanding virtualized data center environments.

BR-VDX8770-4

Brocade

The Brocade VDX 8770 Switch is a highly scalable, low-latency, 1/10/40/100 Gigabit Ethernet (GbE) modular switch. Designed to easily scale out Brocade VCS fabrics, the Brocade VDX 8770 Switch brings new levels of performance to VCS fabric deployments.

 

DUT Specifications

 

NAS Array

Version

VNX VG2

File Software Version 7.1.74-5

EMC Unisphere

V1.2.28.1.0110

 

Brocade Switches

Device ID

Version

VDX 6740

CASTOR-VCS20-1

NOS 5.0.1

VDX 6740

CASTOR-VCS20-2

NOS 5.0.1

VDX 6740

CASTOR-VCS20-12

NOS 5.0.1

VDX 8770

M4-VCS20-11

NOS 5.0.1

 

Operating System

Adapter

Driver Version

Red Hat 6.5

Brocade 1860

3.2.4.0

Red Hat 6.5

Emulex OCe10102

10.0.803.31

Windows Server 2008 R2

Brocade 1860

3.2.4.0

Windows Server 2012 R2

Emulex OCe14102

10.2.370.19

 

Servers

Memory

Processor

IBM x3650 M3

8 GB

E5506 @ 2.13 GHz (x4)

IBM x3650 M3

8 GB

E5506 @ 2.13 GHz (x4)

HP ProLiant DL380 G7

8 GB

E5506 @ 2.13 GHz (x4)

HP ProLiant DL380 G7

8 GB

E5506 @ 2.13 GHz (x4)

 

Operating Systems

Version

Red Hat Enterprise Linux Server

6.5

Windows Server

2008 R2, 2012 R2

  

Test Equipment

Version

Medusa Labs Test Tools

6.0.1.148039

 

 

Device

Interface

IP Address

EMC VNX VG2

fxg-1-0

9.79.40.1

EMC VNX VG2

fxg-1-1, fxg-2-1 (NOS_VCS20)

9.79.40.2

Windows 2012 Server

NIC Team

9.79.100.1

Windows 2008 Server

NIC Team

9.79.100.11

Red Hat 6.5 Server

bond0

9.79.100.21

Red Hat 6.3 Server

bond0

9.79.100.31

 

Configure DUT and Test Equipment

This section describes the initial configuration of DUT and test equipment. In some test cases, additional configuration changes are made.

 

Step 1. Brocade VDX Switch Configuration - Logical Chassis Mode

On the VCS cluster, configure VLAN 979 interfaces on all cluster members. Configure the vLAG interfaces connecting to Windows and Red Hat hosts as well as NAS storage array.

 

< ========== >

interface Vlan 979

!

rbridge-id 1

 interface Ve 979

  ip address 9.79.1.1/16

  no shutdown

 !

!

rbridge-id 2

 interface Ve 979

  ip address 9.79.1.2/16

  no shutdown

 !

!

rbridge-id 11

 interface Ve 979

  ip address 9.79.1.11/16

  no shutdown

 !

!

rbridge-id 12

 interface Ve 979

  ip address 9.79.1.12/16

  no shutdown

 !

!

interface TenGigabitEthernet 1/0/1

 no fabric isl enable

 no fabric trunk enable

 channel-group 101 mode active type standard

 lacp timeout long

 no shutdown

!

interface TenGigabitEthernet 1/0/2

 no fabric isl enable

 no fabric trunk enable

 channel-group 102 mode active type standard

 lacp timeout long

 no shutdown

!

interface TenGigabitEthernet 1/0/3

 no fabric isl enable

 no fabric trunk enable

 channel-group 103 mode active type standard

 lacp timeout long

 no shutdown

!

interface TenGigabitEthernet 1/0/4

 no fabric isl enable

 no fabric trunk enable

 channel-group 104 mode active type standard

 lacp timeout long

 no shutdown

!

interface TenGigabitEthernet 2/0/1

 no fabric isl enable

 no fabric trunk enable

 channel-group 101 mode active type standard

 lacp timeout long

 no shutdown

!

interface TenGigabitEthernet 2/0/2

 no fabric isl enable

 no fabric trunk enable

 channel-group 102 mode active type standard

 lacp timeout long

 no shutdown

!

interface TenGigabitEthernet 2/0/3

 no fabric isl enable

 no fabric trunk enable

 channel-group 103 mode active type standard

 lacp timeout long

 no shutdown

!

interface TenGigabitEthernet 2/0/4

 no fabric isl enable

 no fabric trunk enable

 channel-group 104 mode active type standard

 lacp timeout long

 no shutdown

!

interface TenGigabitEthernet 11/1/9

 no fabric isl enable

 no fabric trunk enable

 channel-group 41 mode active type standard

 lacp timeout long

 no shutdown

!

interface TenGigabitEthernet 11/1/10

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 spanning-tree shutdown

 no shutdown

!

interface TenGigabitEthernet 12/0/9

 no fabric isl enable

 no fabric trunk enable

 channel-group 41 mode active type standard

 lacp timeout long

 no shutdown

!

interface Port-channel 41

 vlag ignore-split

 switchport

 switchport mode access

 switchport access vlan 979

 spanning-tree shutdown

 no shutdown

!

interface Port-channel 101

 vlag ignore-split

 switchport

 switchport mode access

 switchport access vlan 979

 spanning-tree shutdown

 no shutdown

!

interface Port-channel 102

 vlag ignore-split

 switchport

 switchport mode access

 switchport access vlan 979

 spanning-tree shutdown

 no shutdown

!

interface Port-channel 103

 vlag ignore-split

 switchport

 switchport mode access

 switchport access vlan 979

 spanning-tree shutdown

 no shutdown

!

interface Port-channel 104

 vlag ignore-split

 switchport

 switchport mode access

 switchport access vlan 979

 spanning-tree shutdown

 no shutdown

!

< ========== >

 

Step 2. EMC VNX VG2 Configuration

 

a. Physical Interface Configuration

From the EMC Unisphere dashboard, click on System List.

 

EMC VNX VG2 Physical Interface Configuration – Screen 1.jpg

   EMC VNX VG2 Physical Interface Configuration – Screen 1

 

Click on the desired system’s name.

 EMC VNX VG2 Physical Interface Configuration – Screen 2.jpg

   EMC VNX VG2 Physical Interface Configuration – Screen 2

 

Click on System.

 EMC VNX VG2 Physical Interface Configuration – Screen 3.jpg

   EMC VNX VG2 Physical Interface Configuration – Screen 3

 

Click on Settings.

 EMC VNX VG2 Physical Interface Configuration – Screen 4.jpg

   EMC VNX VG2 Physical Interface Configuration – Screen 4

 

Click the Devices tab.

 

EMC VNX VG2 Physical Interface Configuration – Screen 5.jpg

   EMC VNX VG2 Physical Interface Configuration – Screen 5

 

Click on Create at the bottom, left.

 

EMC VNX VG2 Physical Interface Configuration – Screen 6.jpg

   EMC VNX VG2 Physical Interface Configuration – Screen 6

 

For an LACP interface, on the screen below, enter the following fields:

  • In the Data Mover drop down, select the appropriate data mover.
  • In the Type field, select Link Aggregation.
  • Enter in a desired device name for the Device Name
  • Check the boxes for the desired physical interfaces to be aggregated.
  • Click OK.

EMC VNX VG2 LACP Interface Configuration – Screen 1.jpg

   EMC VNX VG2 LACP Interface Configuration – Screen 1

 

On the Devices screen you should see the new device name.

 

EMC VNX VG2 LACP Interface Configuration – Screen 2.jpg

   EMC VNX VG2 LACP Interface Configuration – Screen 2

 

Click on Interfaces tab and click on Create at the bottom, left.

 

EMC VNX VG2 LACP Interface Configuration – Screen 3.jpg

   EMC VNX VG2 LACP Interface Configuration – Screen 3

 

For the LACP interface, on the screen below, enter the following fields:

 

  • In the Data Mover drop-down, select the desired data mover.
  • In the Device Name drop-down, select the device previously created.
  • In the Address field, enter the desired IP address.
  • In the Netmask field, enter the subnet mask associated with the IP address previously entered.
  • In the MTU field, enter 1500.
  • Click OK.

EMC VNX VG2 LACP Interface Configuration – Screen 4.jpg

   EMC VNX VG2 LACP Interface Configuration – Screen 4

 

On the Interfaces screen, you will see the configuration of the LACP interface.

 

EMC VNX VG2 LACP Interface Configuration – Screen 5.jpg

   EMC VNX VG2 LACP Interface Configuration – Screen 5

 

To configure a single link interface, click Create at the bottom, left of the Interfaces screen. Then enter the following values in the pop-up screen below:

 

  • In the Data Mover drop-down, select the desired data mover.
  • In the Device Name drop-down, select the desired physical interface.
  • In the Address field, enter the desired IP address.
  • In the Netmask field, enter the subnet mask associated with the IP address previously entered.
  • In the MTU field, enter 1500.
  • Click OK.

EMC VNX VG2 Single Link Interface Configuration – Screen 1.jpg

   EMC VNX VG2 Single Link Interface Configuration – Screen 1

 

On the Interfaces screen, you will see the configuration of the single interface.

 

EMC VNX VG2 Interface Verification.jpg

   EMC VNX VG2 Interface Verification

 

b. File System Configuration

 

Click on Storage, then click on Storage Configuration.

 

EMC VNX VG2 File System Configuration – Screen 1.jpg

   EMC VNX VG2 File System Configuration – Screen 1

 

Click on File Systems.

 

EMC VNX VG2 File System Configuration – Screen 2.jpg

   EMC VNX VG2 File System Configuration – Screen 2

 

Click on Create at the bottom, left.

 

EMC VNX VG2 File System Configuration – Screen 3.jpg

   EMC VNX VG2 File System Configuration – Screen 3

 

In the popup, enter the followin fields:

 

  • In the File System Name field, enter a desired file system name.
  • In the Storage Capacity field, select 20 GB. Click OK.

EMC VNX VG2 File System Configuration – Screen 4.jpg

   EMC VNX VG2 File System Configuration – Screen 4

 

On the File Systems screen, confirm the new file system has been created.

 

EMC VNX VG2 File System Verification.jpg

   EMC VNX VG2 File System Verification

 

c. CIFS Share Configuration

 

Click on Storage. Click on Shared Folders.

 

EMC VNX VG2 CIFS Share Configuration – Screen 1.jpg

   EMC VNX VG2 CIFS Share Configuration – Screen 1

 

Click on CIFS.

 

EMC VNX VG2 CIFS Share Configuration – Screen 2.jpg

   EMC VNX VG2 CIFS Share Configuration – Screen 2

 

Click on Create at the bottom, left.

 

EMC VNX VG2 CIFS Share Configuration – Screen 3.jpg

   EMC VNX VG2 CIFS Share Configuration – Screen 3

 

On the popup screen, fill in the following values:

 

  • In the CIFS Share Name field, enter the desired CIFS share name.
  • In the File System dropdown, select the appropriate file system previously created.
  • Click OK.

EMC VNX VG2 CIFS Share Configuration – Screen 4.jpg

   EMC VNX VG2 CIFS Share Configuration – Screen 4

 

On the Shares screen, confirm the share is created.

 

EMC VNX VG2 CIFS Share Verification.jpg

   EMC VNX VG2 CIFS Share Verification

 

Click on CIFS Servers tab and then click on Create at the bottom, left.

 

EMC VNX VG2 CIFS Server Configuration – Screen 1.jpg

   EMC VNX VG2 CIFS Server Configuration – Screen 1

 

On the popup screen, fill in the following fields:

 

  • For the Server Type, select Standalone.
  • In the NetBIOS Name field, enter desired NetBIOS name.
  • In the Workgroup field, enter the desired workgroup name.
  • In the Set Local Admin Password field, enter a desired password.
  • In the Confirm Admin Password field, repeat the desired password.
  • Check the boxes for both interfaces in the Interfaces
  • Click OK.

EMC VNX VG2 CIFS Server Configuration – Screen 2.jpg

   EMC VNX VG2 CIFS Server Configuration – Screen 2

 

==========

IMPORTANT!

An EMC VNX VG2 standalone CIFS server's administrator password must be changed from any Windows computer before it can be used after CIFS server creation. From any Windows computer with connectivity to the EMC VG2, go to Start > Windows Security > Change a Password. In the top field, enter <CIFS_Server_Name>\Administrator, where <CIFS_Server_Name> is the CIFS server name created through EMC Unisphere. In the second field, enter the old password (possibly nasadmin). In the third field, enter the new password (possibly nasadmin). In the bottom field, confirm the new password.

==========

 

On the CIFS Servers screen, verify the CIFS volume is created.

 

EMC VNX VG2 CIFS Server Verification.jpg

   EMC VNX VG2 CIFS Server Verification

 

d. NFS Export Configuration

 

Click on Storage and then Click on Shared Folders.

 

EMC VNX VG2 NFS Export Configuration – Screen 1.jpg

   EMC VNX VG2 NFS Export Configuration – Screen 1

 

Click on NFS.

 

EMC VNX VG2 NFS Export Configuration – Screen 2.jpg

   EMC VNX VG2 NFS Export Configuration – Screen 2

 

Click on Create on the bottom, left.

 

EMC VNX VG2 NFS Export Configuration – Screen 3.jpg

   EMC VNX VG2 NFS Export Configuration – Screen 3

 

On the popup screen, fill in the following fields:

 

  • In the File System dropdown menu, select the desired file system.
  • In the Read/Write Hosts field, enter 0.0.0.0/0.0.0.0 to allow all hosts to read and write to the NFS export.
  • In the Root Hosts field, enter 0.0.0.0/0.0.0.0 to allow all hosts root access to the NFS export.
  • Click OK.

EMC VNX VG2 NFS Export Configuration – Screen 4.jpg

   EMC VNX VG2 NFS Export Configuration – Screen 4

 

On the NFS Exports screen, confirm the NFS export is created.

 

EMC VNX VG2 NFS Export Verification.jpg

   EMC VNX VG2 NFS Export Verification

 

Step 3. Windows Host Configuration

 

a. Configure Windows 2012 Server Hosts for Ethernet Teaming

Configure Windows 2012 Server NIC teaming interface for connectivity to VCS cluster.

 

Windows 2012 NIC Teaming.jpg

   Windows 2012 NIC Teaming

 

b. Configure Windows 2008 Server Hosts for Ethernet Teaming

Configure Windows 2008 Server NIC teaming interface for connectivity to VCS cluster using the

Brocade Host Connectivity Manager.

 

Windows 2008 NIC Team using Brocade Host Connectivity Manager.jpg

   Windows 2008 NIC Team using Brocade Host Connectivity Manager

 

c. Map EMC VNX VG2 Network Shares on Windows 2012 Server

Map network drives on Windows 2012 Server hosts.

 

Windows 2012 NIC Team Configuration – Screen 1.jpg

   Windows 2012 NIC Team Configuration – Screen 1

 

Windows 2012 NIC Team Configuration – Screen 2.jpg 

   Windows 2012 NIC Team Configuration – Screen 2

 

d. Map Network Drives on Windows 2008 Server

Map network drives on Windows 2008 Server hosts.

 

Windows 2008 Network Drive Mapping – Screen 1.jpg 

   Windows 2008 Network Drive Mapping – Screen 1

 

Windows 2008 Network Drive Mapping – Screen 2.jpg 

   Windows 2008 Network Drive Mapping – Screen 2

 

Step 4. Red Hat Linux Host Configuration

 

a. Configure NIC Bonding

The following are the entries within /etc/sysconfig/network-scripts/ on Red Hat hosts to enable Ethernet bonding, or NIC bonding.

 

< =========== >

ifcfg-eth0

DEVICE=eth0

BOOTPROTO=none

ONBOOT=yes

MASTER=bond0

SLAVE=yes

USERCTL=no

NM_CONTROLLED=no

 

ifcfg-eth1

DEVICE=eth1

BOOTPROTO=none

ONBOOT=yes

MASTER=bond0

SLAVE=yes

USERCTL=no

NM_CONTROLLED=no

 

ifcfg-bond0

DEVICE=bond0

IPADDR=9.79.100.21

NETMASK=255.255.0.0

ONBOOT=yes

BOOTPROTO=none

USERCTL=no

NM_CONTROLLED=no

BONDING_OPTS="mode=802.3ad miimon=100 downdelay=5000 updelay=5000"

< =========== >

 

b. Mount NFS Disk Shares

The following commands mount EMC VNX VG2 NFS shares on hosts running Red Hat 6.5.

 

< =========== >

mount -t nfs 9.79.40.1:/REDHAT_66.109 /mnt/vg2

mount -t nfs 9.79.40.1:/REDHAT_79.141 /mnt/vg2

< =========== >

 

Step 5. Medusa I/O Generation Configuration

The following shows the configuration of the Medusa IO data patterns used in the test cases.

 

a. Standard I/O with 64KB Blocks

For test scenarios using standard I/O (64 KB testing size), configure Medusa for the following command line result:

 

< =========== >

pain 2GB -b64KB -v90 -H1 -l35 -Y1 -M90

< =========== >

 

b. Maximum I/O with 1 MB Blocks

For test scenarios using maximum bandwidth I/O (1 MB testing size), configure Medusa for the following command line result:

 

< =========== >

maim 2GB -b1MB -Q8 -n -u -q5 -w -o -Y1 -M90 --perf-mode

< =========== >

 

c. Microsoft Exchange Server I/O

For test scenarios using Microsoft Exchange Server Simulation (Medusa pre-configured Storage Simulation test), configure Medusa for the following command line result:

 

< =========== >

maim 2GB -%r50@4KB -%w25@64KB -%w25@4KB -Q1 -n -u -q5 -o -l69 -Y1 -M90

< =========== >

 

d. File Server I/O

For test scenarios using File Server Simulation (Medusa pre-configured Storage Simulation test), configure Medusa for the following command line result:

 

< =========== >

maim 2GB -%10:r80@512B,w20@512B -%5:r80@1KB,w20@1KB -%5:r80@2KB,w20@2KB -%60:r80@4KB,w20@4KB -%2:r50@8KB,w50@8KB -%4:r75@16KB,w25@16KB -%4:r75@32KB,w25@32KB -%10:r80@64KB,w20@64KB -Q1 -n -u -o -l69 -Y1 -M90

< =========== >

 

Step 6. Brocade Network Advisor Discovery

 

From the BNA Desktop Client, navigate to the Discover menu and select IP Products.

 

Brocade Network Advisor Configuration – Screen 1.jpg 

   Brocade Network Advisor Configuration – Screen 1

 

In the Discover Setup – IP window, select Add.

 

Brocade Network Advisor Configuration – Screen 2.jpg

   Brocade Network Advisor Configuration – Screen 2

 

In the Add product window, enter any VCS cluster member’s management IP address. Click OK.

 

Brocade Network Advisor Configuration – Screen 3.jpg

   Brocade Network Advisor Configuration – Screen 3

 

In the Discover Setup – IP window, observe the discovered VCS fabric.

 

Brocade Network Advisor Discovery Validation.jpg

   Brocade Network Advisor Discovery Validation

 

Test Cases

 

These test cases are designed to verify both basic and advanced functionality features between the Brocade VCS cluster and both host and storage devices, as well as stress all devices and confirm successful error recovery.

 

1.1

Ethernet Storage – Base Functionality

1.1.1

Storage Device – Physical Connection and Speed Negotiation

1.1.2

NAS Connectivity

1.1.3

vLAG Configuration

1.2

Ethernet Storage – Advanced Functionality

1.2.1

Storage Device – Jumbo Frame/MTU Size Validation

1.2.2

NAS Bandwidth Validation

1.2.3

Storage Device – w/Congested Fabric

1.2.4

Storage Device – NAS Protocol Jammer CRC Corruption on ISL Port

1.2.5

Storage Device – NAS Protocol Jammer Packet Corruption on ISL Port

1.2.6

Storage Device – NAS Protocol Jammer Packet Loss on ISL Port

1.2.7

Storage Device – NAS Protocol Jammer CRC Corruption on Storage Port

1.2.8

Storage Device – NAS Protocol Jammer Packet Corruption on Storage Port

1.2.9

Storage Device – NAS Protocol Jammer Packet Loss on Storage Port

1.3

Stress and Error Recovery

1.3.1

Storage Device Fabric I/O Integrity – Congested Fabric

1.3.2

Storage Device Integrity – Device Recovery from Port Toggle – Manual Cable Pull

1.3.3

Storage Device Integrity – Device Recovery from ISL Port Relocation

1.3.4

Storage Device Stress – Device Recovery from Device Port Toggle – Extended Run

1.3.5

Storage Device Recovery – ISL Port Toggle – Extended Run

1.3.6

Storage Device Recovery – All-ISL Port Toggle

1.3.7

Storage Device Recovery – VDX8770 Line Card Maintenance

1.3.8

Storage Device Recovery – Switch Offline

1.3.9

Storage Device Recovery – Switch Firmware Download

1.3.10

Workload Simulation Test Suite – Microsoft Exchange Server

1.3.11

Workload Simulation Test Suite – File Server Simulation

1.4

Brocade Network Advisor

1.4.1

Ethernet Fabric Discovery

1.4.2

Ethernet Fabric Addition and Removal

1.4.3

Ethernet Fabric Configuration Backup and Restoration

1.4.4

Ethernet Fabric Firmware Download

Test Case Descriptions

 

Lines in bold with an < == indicate important output used to validate the test results.

 

1.1 Ethernet Storage – Base Functionality

 

1.1.1 Storage Device – Physical Connection and Speed Negotiation

 

Test Objective

Verify device connectivity to VDX switch with all supported speed settings. Configure storage port for NAS connectivity. Validate base connectivity.

 

Results

  1. PASS. All interfaces up and operational at expected speed settings. Brocade VDX ‘show interface’ commands reflect expected interface speed.

 

< =========== >

CASTOR-VCS20-2# show interface tengigabitethernet 11/1/9

TenGigabitEthernet 11/1/9 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71d6

    Current address is 0027.f81c.71d6

Pluggable media present

Interface index (ifindex) is 47651782785

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full < ==

...

 

CASTOR-VCS20-2# show interface tengigabitethernet 12/0/9

TenGigabitEthernet 12/0/9 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0005.3365.296f

    Current address is 0005.3365.296f

Pluggable media present

Interface index (ifindex) is 51942555656

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full < ==

...

 

CASTOR-VCS20-2# show interface tengigabitethernet 11/1/10

TenGigabitEthernet 11/1/10 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71d7

    Current address is 0027.f81c.71d7

Pluggable media present

Interface index (ifindex) is 47651815552

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full < ==

...

< =========== >

 

1.1.2 NAS Connectivity

 

Test Objective

Verify host to File Share connectivity with CIFS and NFS with multiple simultaneous connections.

 

Results

  1. PASS. All network drives on all Windows and Red Hat hosts are successfully mapped.

 

< =========== >

PS C:\Users\Administrator> net use

New connections will be remembered.

 

Status       Local     Remote                    Network

-------------------------------------------------------------------------------

OK               L:        \\9.79.40.1\WINDOWS_68.114

                                                               Microsoft Windows Network

OK              M:        \\9.79.40.2\WINDOWS_68.114

                                                               Microsoft Windows Network

                       \\TSCLIENT\C               Microsoft Terminal Services

The command completed successfully.

< =========== >

 

 

< =========== >

C:\Users\Administrator>net use

New connections will be remembered.

 

 

Status       Local     Remote                    Network

-------------------------------------------------------------------------------

OK              L:          \\9.79.40.1\WINDOWS_68.128

                                                                 Microsoft Windows Network

OK              M:          \\9.79.40.2\WINDOWS_68.128

                                                                 Microsoft Windows Network

                       \\TSCLIENT\C                Microsoft Terminal Services

The command completed successfully.

< =========== >

 

 

< =========== >

[root@rhel65079141 ~]# df

Filesystem                                     1K-blocks  Used           Available  Use% Mounted on

...

9.79.40.1:/REDHAT_79.141     20651520 16786048   3865472  82%    /mnt/vg2 < ==

< =========== >

 

 

< =========== >

[root@rhel65066109 ~]# df

Filesystem                                  1K-blocks     Used            Available  Use%    Mounted on

...

9.79.40.1:/REDHAT_66.109   20651520    16786048   3865472  82%      /mnt/vg2 < ==

< =========== >

 

1.1.3 vLAG Configuration

 

Test Objective

Configure vLAG connectivity from Storage Ports to 2 separate VDX switches. Verify data integrity through vLAG.

 

Results

  1. PASS. All port-channel interfaces are operational and in sync.

 

< =========== >

CASTOR-VCS20-2# show port-channel 41

 LACP Aggregator: Po 41 (vLAG)

 Aggregator type: Standard

 Ignore-split is enabled

  Member rbridges:

    rbridge-id: 11 (1)

    rbridge-id: 12 (1)

  Admin Key: 0041 - Oper Key 0041

  Partner System ID - 0x0014,00-60-16-68-cb-e7

  Partner Oper Key 4135

 Member ports on rbridge-id 11:

   Link: Te 11/1/9 (0xB18448081) sync: 1      < ==

 

 Member ports on rbridge-id 12:

   Link: Te 12/0/9 (0xC18048008) sync: 1   *  < ==

 

CASTOR-VCS20-2# show port-channel 101

 LACP Aggregator: Po 101 (vLAG)

 Aggregator type: Standard

 Ignore-split is enabled

  Member rbridges:

    rbridge-id: 1 (1)

    rbridge-id: 2 (1)

  Admin Key: 0101 - Oper Key 0101

  Partner System ID - 0x0000,00-90-fa-6c-01-ae

  Partner Oper Key 0000

 Member ports on rbridge-id 1:

   Link: Te 1/0/1 (0x118008000) sync: 1      < ==

 

 Member ports on rbridge-id 2:

   Link: Te 2/0/1 (0x218008000) sync: 1   *  < ==

 

CASTOR-VCS20-2# show port-channel 102

 LACP Aggregator: Po 102 (vLAG)

 Aggregator type: Standard

 Ignore-split is enabled

  Member rbridges:

    rbridge-id: 1 (1)

    rbridge-id: 2 (1)

  Admin Key: 0102 - Oper Key 0102

  Partner System ID - 0xffff,8c-7c-ff-10-84-00

  Partner Oper Key 0017

 Member ports on rbridge-id 1:

   Link: Te 1/0/2 (0x118010001) sync: 1      < ==

 

 Member ports on rbridge-id 2:

   Link: Te 2/0/2 (0x218010001) sync: 1   *  < ==

 

CASTOR-VCS20-2# show port-channel 103

 LACP Aggregator: Po 103 (vLAG)

 Aggregator type: Standard

 Ignore-split is enabled

  Member rbridges:

    rbridge-id: 1 (1)

    rbridge-id: 2 (1)

  Admin Key: 0103 - Oper Key 0103

  Partner System ID - 0xffff,8c-7c-ff-24-eb-00

  Partner Oper Key 0033

 Member ports on rbridge-id 1:

   Link: Te 1/0/3 (0x118018002) sync: 1      < ==

 

 Member ports on rbridge-id 2:

   Link: Te 2/0/3 (0x218018002) sync: 1   *  < ==

 

CASTOR-VCS20-2# show port-channel 104

 LACP Aggregator: Po 104 (vLAG)

 Aggregator type: Standard

 Ignore-split is enabled

  Member rbridges:

    rbridge-id: 1 (1)

    rbridge-id: 2 (1)

  Admin Key: 0104 - Oper Key 0104

  Partner System ID - 0xffff,00-00-c9-b1-e5-c2

  Partner Oper Key 0033

 Member ports on rbridge-id 1:

   Link: Te 1/0/4 (0x118020003) sync: 1      < ==

 

 Member ports on rbridge-id 2:

   Link: Te 2/0/4 (0x218020003) sync: 1   *  < ==

< =========== >

 

1.2 Ethernet Storage – Advanced Functionality

 

1.2.1 Storage Device – Jumbo Frame/MTU Size Validation

 

Test Objective

Perform I/O validation testing while incrementing MTU size from minimum to maximum with reasonable increments. Include Jumbo frame sizes as well as maximum negotiated/supported between device and switch.

 

Test Configuration 

1. Within EMC Unisphere, navigate to Settings -> Network. Then, highlight the desired network interface and click Properties. Change the entry for MTU to the desired value. Finally, click OK.

 

EMC VNX VG2 Interface MTU Configuration.jpg 

   EMC VNX VG2 Interface MTU Configuration

 

2. For Red Hat hosts, add “MTU=9000” to /etc/sysconfig/network-scripts/ifcfg-bond0 and then execute service network restart.

 

< =========== >

[root@ilo65205 ~]# more /etc/sysconfig/network-scripts/ifcfg-bond0

DEVICE=bond0

IPADDR=9.79.100.21

NETMASK=255.255.0.0

ONBOOT=yes

BOOTPROTO=none

MTU=9000

USERCTL=no

NM_CONTROLLED=no

BONDING_OPTS="mode=802.3ad miimon=100 downdelay=5000 updelay=5000"

[root@ilo65205 ~]#

< =========== >

 

3. For Windows 2012 Server host, reconfigure individual NIC team members for increased MTU size. Perform Disable and Enable on NIC Team interface within Windows to apply packet size change.

 

Windows 2012 Server Emulex NIC MTU Configuration.jpg 

   Windows 2012 Server Emulex NIC MTU Configuration

 

4. For Windows 2008 Server host, reconfigure NIC team interface.

 

Windows 2008 Server Brocade NIC MTU Configuration.jpg

   Windows 2008 Server Brocade NIC MTU Configuration

 

5. On VDX devices, configure as follows:

 

< =========== >

rbridge-id 1

 interface ve 979

  ip mtu 9018

rbridge-id 2

 interface ve 979

  ip mtu 9018

rbridge-id 11

 interface ve 979

  ip mtu 9018

rbridge-id 12

 interface ve 979

  ip mtu 9018

interface TenGigabitEthernet 11/1/10

 mtu 9216

interface Port-Channel 41

 mtu 9216

interface Port-Channel 101

 mtu 9216

interface Port-Channel 102

 mtu 9216

interface Port-Channel 103

 mtu 9216

interface Port-Channel 104

 mtu 9216

< =========== >

 

Results

  1. PASS. Non-fragmented ping packets were successfully responded to and all jumbo frame storage traffic was error-free.

 

< =========== >

PS C:\Users\Administrator> ping 9.79.40.1 -l 8972 -f

 

Pinging 9.79.40.1 with 8972 bytes of data&colon;

Reply from 9.79.40.1: bytes=8972 time<1ms TTL=255

Reply from 9.79.40.1: bytes=8972 time<1ms TTL=255

Reply from 9.79.40.1: bytes=8972 time<1ms TTL=255

Reply from 9.79.40.1: bytes=8972 time<1ms TTL=255

 

Ping statistics for 9.79.40.1:

    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss), < ==

Approximate round trip times in milli-seconds:

    Minimum = 0ms, Maximum = 0ms, Average = 0ms

< =========== >

 

 

< =========== >

C:\Users\Administrator>ping 9.79.40.1 -l 8972 -f

 

Pinging 9.79.40.1 with 8972 bytes of data&colon;

Reply from 9.79.40.1: bytes=8972 time<1ms TTL=255

Reply from 9.79.40.1: bytes=8972 time<1ms TTL=255

Reply from 9.79.40.1: bytes=8972 time<1ms TTL=255

Reply from 9.79.40.1: bytes=8972 time<1ms TTL=255

 

Ping statistics for 9.79.40.1:

    Packets: Sent = 4, Received = 4, Lost = 0 (0% loss), < ==

Approximate round trip times in milli-seconds:

    Minimum = 0ms, Maximum = 0ms, Average = 0ms

< =========== >

 

 

< =========== >

[root@rhel65079141 ~]# ping -c 4 -M do -s 8972 9.79.40.1

PING 9.79.40.1 (9.79.40.1) 8972(9000) bytes of data.

8980 bytes from 9.79.40.1: icmp_seq=1 ttl=255 time=0.311 ms

8980 bytes from 9.79.40.1: icmp_seq=2 ttl=255 time=0.260 ms

8980 bytes from 9.79.40.1: icmp_seq=3 ttl=255 time=0.136 ms

8980 bytes from 9.79.40.1: icmp_seq=4 ttl=255 time=0.135 ms

 

--- 9.79.40.1 ping statistics ---

4 packets transmitted, 4 received, 0% packet loss, time 3000ms < ==

rtt min/avg/max/mdev = 0.135/0.210/0.311/0.078 ms

< =========== >

 

 

< =========== >

[root@rhel65066109 ~]# ping -c 4 -M do -s 8972 9.79.40.1

PING 9.79.40.1 (9.79.40.1) 8972(9000) bytes of data.

8980 bytes from 9.79.40.1: icmp_seq=1 ttl=255 time=1.28 ms

8980 bytes from 9.79.40.1: icmp_seq=2 ttl=255 time=0.178 ms

8980 bytes from 9.79.40.1: icmp_seq=3 ttl=255 time=0.162 ms

8980 bytes from 9.79.40.1: icmp_seq=4 ttl=255 time=0.164 ms

 

--- 9.79.40.1 ping statistics ---

4 packets transmitted, 4 received, 0% packet loss, time 3001ms < ==

rtt min/avg/max/mdev = 0.162/0.446/1.281/0.482 ms

< =========== >

 

Jumbo Frame MTU Size Medusa Results.jpg

   Jumbo Frame MTU Size Medusa Results

 

< =========== >

CASTOR-VCS20-12# show interface port-channel 101

Port-channel 101 is up, line protocol is up

Hardware is AGGREGATE, address is 50eb.1a22.1988

    Current address is 50eb.1a22.1988

Interface index (ifindex) is 671088741

Minimum number of links to bring Port-channel up is 1

MTU 9216 bytes

LineSpeed Actual     : 20000 Mbit

Allowed Member Speed : 10000 Mbit

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:30:13

Queueing strategy: fifo

Receive Statistics:

    13256753 packets, 82210860186 bytes

    Unicasts: 13247081, Multicasts: 9520, Broadcasts: 152

    64-byte pkts: 2138345, Over 64-byte pkts: 107, Over 127-byte pkts: 1212699

    Over 255-byte pkts: 3, Over 511-byte pkts: 399, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 9905200 < ==

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    12186917 packets, 80377778266 bytes

    Unicasts: 12182136, Multicasts: 3852, Broadcasts: 929

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 1383.149280 Mbits/sec, 20924 packets/sec, 6.92% of line-rate

    Output 4.312592 Mbits/sec, 5234 packets/sec, 0.02% of line-rate

Time since last interface status change: 00:47:49

 

CASTOR-VCS20-12# show interface port-channel 102

Port-channel 102 is up, line protocol is up

Hardware is AGGREGATE, address is 50eb.1a22.1989

    Current address is 50eb.1a22.1989

Interface index (ifindex) is 671088742

Minimum number of links to bring Port-channel up is 1

MTU 9216 bytes

LineSpeed Actual     : 20000 Mbit

Allowed Member Speed : 10000 Mbit

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:30:13

Queueing strategy: fifo

Receive Statistics:

    10838805 packets, 71891808664 bytes

    Unicasts: 10838389, Multicasts: 265, Broadcasts: 151

    64-byte pkts: 1089211, Over 64-byte pkts: 194, Over 127-byte pkts: 1081496

    Over 255-byte pkts: 3, Over 511-byte pkts: 397, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 8667504 < ==

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    10822574 packets, 71683413123 bytes

    Unicasts: 10821236, Multicasts: 408, Broadcasts: 930

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 0.096556 Mbits/sec, 101 packets/sec, 0.00% of line-rate

    Output 3.701984 Mbits/sec, 58 packets/sec, 0.02% of line-rate

Time since last interface status change: 00:47:14

 

CASTOR-VCS20-12# show interface port-channel 103

Port-channel 103 is up, line protocol is up

Hardware is AGGREGATE, address is 50eb.1a22.1986

    Current address is 50eb.1a22.1986

Interface index (ifindex) is 671088743

Minimum number of links to bring Port-channel up is 1

MTU 9216 bytes

LineSpeed Actual     : 20000 Mbit

Allowed Member Speed : 10000 Mbit

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:30:13

Queueing strategy: fifo

Receive Statistics:

    8429654 packets, 43731362848 bytes

    Unicasts: 8429404, Multicasts: 238, Broadcasts: 12

    64-byte pkts: 140, Over 64-byte pkts: 2549248, Over 127-byte pkts: 636873

    Over 255-byte pkts: 512, Over 511-byte pkts: 0, Over 1023-byte pkts: 1

    Over 1518-byte pkts(Jumbo): 5242880 < ==

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    6414890 packets, 42356829860 bytes

    Unicasts: 6413387, Multicasts: 434, Broadcasts: 1069

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 0.182208 Mbits/sec, 230 packets/sec, 0.00% of line-rate

    Output 7.419496 Mbits/sec, 115 packets/sec, 0.04% of line-rate

Time since last interface status change: 00:51:51

 

CASTOR-VCS20-12# show interface port-channel 104

Port-channel 104 is up, line protocol is up

Hardware is AGGREGATE, address is 50eb.1a22.1987

    Current address is 50eb.1a22.1987

Interface index (ifindex) is 671088744

Minimum number of links to bring Port-channel up is 1

MTU 9216 bytes

LineSpeed Actual     : 20000 Mbit

Allowed Member Speed : 10000 Mbit

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:30:13

Queueing strategy: fifo

Receive Statistics:

    9345559 packets, 48111688912 bytes

    Unicasts: 9345304, Multicasts: 243, Broadcasts: 12

    64-byte pkts: 132, Over 64-byte pkts: 2862426, Over 127-byte pkts: 715321

    Over 255-byte pkts: 512, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 5767168 < ==

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    7171867 packets, 47559348082 bytes

    Unicasts: 7170363, Multicasts: 435, Broadcasts: 1069

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 0.362360 Mbits/sec, 458 packets/sec, 0.00% of line-rate

    Output 19.076376 Mbits/sec, 292 packets/sec, 0.10% of line-rate

Time since last interface status change: 00:51:31

 

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/10

TenGigabitEthernet 11/1/10 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71d7

    Current address is 0027.f81c.71d7

Pluggable media present

Interface index (ifindex) is 47651815552

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:30:13

Queueing strategy: fifo

Receive Statistics:

    36583506 packets, 241993464330 bytes

    Unicasts: 36583514, Multicasts: 0, Broadcasts: 0

    64-byte pkts: 2332863, Over 64-byte pkts: 1389554, Over 127-byte pkts: 3698140

    Over 255-byte pkts: 9, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 29162944 < ==

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    41855104 packets, 245954688877 bytes

    Unicasts: 41853780, Multicasts: 255, Broadcasts: 1081

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 403.755360 Mbits/sec, 12421 packets/sec, 4.04% of line-rate

    Output 1693.082184 Mbits/sec, 28974 packets/sec, 16.93% of line-rate

Time since last interface status change: 1d02h13m

< =========== >

 

1.2.2 NAS Bandwidth Validation

 

Test Objective

Validate maximum sustained bandwidth to storage port via CIFS/NFS. After 15 minutes, verify I/O completes error-free.

 

Results

  1. PASS. All I/O completes error-free. All host and storage ports show bandwidth under maximum capacity.

 

< =========== >

CASTOR-VCS20-12# show interface port-channel 101

Port-channel 101 is up, line protocol is up

Hardware is AGGREGATE, address is 50eb.1a22.1988

    Current address is 50eb.1a22.1988

Interface index (ifindex) is 671088741

Minimum number of links to bring Port-channel up is 1

MTU 2500 bytes

LineSpeed Actual     : 20000 Mbit

Allowed Member Speed : 10000 Mbit

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:16

Queueing strategy: fifo

Receive Statistics:

    46625934 packets, 70729161217 bytes

    Unicasts: 46621059, Multicasts: 4804, Broadcasts: 71

    64-byte pkts: 27235, Over 64-byte pkts: 48, Over 127-byte pkts: 256

    Over 255-byte pkts: 7763, Over 511-byte pkts: 573, Over 1023-byte pkts: 46590059

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    1327041 packets, 90402174 bytes

    Unicasts: 1324596, Multicasts: 1942, Broadcasts: 503

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 1027.846896 Mbits/sec, 84693 packets/sec, 5.14% of line-rate < ==

    Output 1.304028 Mbits/sec, 2401 packets/sec, 0.01% of line-rate

Time since last interface status change: 21:10:17

 

CASTOR-VCS20-12# show interface port-channel 102

Port-channel 102 is up, line protocol is up

Hardware is AGGREGATE, address is 50eb.1a22.1989

    Current address is 50eb.1a22.1989

Interface index (ifindex) is 671088742

Minimum number of links to bring Port-channel up is 1

MTU 2500 bytes

LineSpeed Actual     : 20000 Mbit

Allowed Member Speed : 10000 Mbit

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:16

Queueing strategy: fifo

Receive Statistics:

    45731833 packets, 68893352931 bytes

    Unicasts: 45731623, Multicasts: 135, Broadcasts: 75

    64-byte pkts: 354108, Over 64-byte pkts: 169, Over 127-byte pkts: 1751

    Over 255-byte pkts: 1680, Over 511-byte pkts: 1996, Over 1023-byte pkts: 45372129

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    2701055 packets, 251890572 bytes

    Unicasts: 2700349, Multicasts: 207, Broadcasts: 499

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 852.822656 Mbits/sec, 70765 packets/sec, 4.26% of line-rate < ==

    Output 2.988576 Mbits/sec, 3972 packets/sec, 0.01% of line-rate

Time since last interface status change: 21:10:19

 

CASTOR-VCS20-12# show interface port-channel 103

Port-channel 103 is up, line protocol is up

Hardware is AGGREGATE, address is 50eb.1a22.1986

    Current address is 50eb.1a22.1986

Interface index (ifindex) is 671088743

Minimum number of links to bring Port-channel up is 1

MTU 2500 bytes

LineSpeed Actual     : 20000 Mbit

Allowed Member Speed : 10000 Mbit

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:16

Queueing strategy: fifo

Receive Statistics:

    58569169 packets, 87985020788 bytes

    Unicasts: 58569042, Multicasts: 121, Broadcasts: 6

    64-byte pkts: 75, Over 64-byte pkts: 555849, Over 127-byte pkts: 65030

    Over 255-byte pkts: 8188, Over 511-byte pkts: 27832, Over 1023-byte pkts: 57912195

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    3109691 packets, 439705681 bytes

    Unicasts: 3108902, Multicasts: 221, Broadcasts: 568

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 909.828864 Mbits/sec, 75666 packets/sec, 4.55% of line-rate < ==

    Output 3.941504 Mbits/sec, 3507 packets/sec, 0.02% of line-rate

Time since last interface status change: 21:10:16

 

CASTOR-VCS20-12# show interface port-channel 104

Port-channel 104 is up, line protocol is up

Hardware is AGGREGATE, address is 50eb.1a22.1987

    Current address is 50eb.1a22.1987

Interface index (ifindex) is 671088744

Minimum number of links to bring Port-channel up is 1

MTU 2500 bytes

LineSpeed Actual     : 20000 Mbit

Allowed Member Speed : 10000 Mbit

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:16

Queueing strategy: fifo

Receive Statistics:

    58651068 packets, 88091583744 bytes

    Unicasts: 58650940, Multicasts: 122, Broadcasts: 6

    64-byte pkts: 74, Over 64-byte pkts: 559504, Over 127-byte pkts: 66072

    Over 255-byte pkts: 10466, Over 511-byte pkts: 37499, Over 1023-byte pkts: 57977453

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    3122092 packets, 440822201 bytes

    Unicasts: 3121303, Multicasts: 221, Broadcasts: 568

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 844.687232 Mbits/sec, 70224 packets/sec, 4.22% of line-rate < ==

    Output 3.591824 Mbits/sec, 3232 packets/sec, 0.02% of line-rate

Time since last interface status change: 21:10:17

 

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/10

TenGigabitEthernet 11/1/10 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71d7

    Current address is 0027.f81c.71d7

Pluggable media present

Interface index (ifindex) is 47651815552

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:15:16

Queueing strategy: fifo

Receive Statistics:

    10240201 packets, 1220093644 bytes

    Unicasts: 10240201, Multicasts: 0, Broadcasts: 0

    64-byte pkts: 2938477, Over 64-byte pkts: 3518572, Over 127-byte pkts: 3782886

    Over 255-byte pkts: 266, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0

Transmit Statistics:

    209339638 packets, 315352169323 bytes

    Unicasts: 209338935, Multicasts: 130, Broadcasts: 573

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 13.842536 Mbits/sec, 14701 packets/sec, 0.14% of line-rate

    Output 3649.534592 Mbits/sec, 302689 packets/sec, 36.50% of line-rate < ==

Time since last interface status change: 03:57:18

< =========== >

 

EMC VNX VG2 storage array is at maximum CPU utilization.

 

EMC VNX VG2 CPU Utilization Graph.jpg

   EMC VNX VG2 CPU Utilization Graph

 

All Medusa I/O traffic completed without errors.

 

NAS Bandwidth Medusa Results.jpg

   NAS Bandwidth Medusa Results

 

1.2.3 Storage Device – w/Congested Fabric

 

Test Objective

Create network bottleneck through a single Ethernet Fabric ISL. Configure VDX switch for AUTONAS. Configure multiple ‘NAS to host’ data streams sufficient to saturate ISLs’ available bandwidth for 30 minutes.  Verify file I/O completes error-free. Add L3 FCoE and L2 Ethernet traffic to fill available bandwidth. File I/O compares are disabled.

 

Test Configuration

1. Configure NAS auto-QoS on VDX as follows:

 

< =========== >

nas auto-qos

nas server-ip 9.79.40.1/32 vlan 979

< =========== >

 

2. Add IXIA connections:

 

VCS Fabric Ports for IXIA Traffic Generator.jpg 

   VCS Fabric Ports for IXIA Traffic Generator

 

3. Configure VDX as follows:

 

< =========== >

interface TenGigabitEthernet 11/1/31

 cee default

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 no shutdown

!

interface TenGigabitEthernet 12/0/31

 cee default

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 no shutdown

!

interface TenGigabitEthernet 11/1/32

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 fcoeport default

 no shutdown

!

interface TenGigabitEthernet 12/0/32

 no fabric isl enable

 no fabric trunk enable

 switchport

 switchport mode access

 switchport access vlan 979

 fcoeport default

 no shutdown

!

interface TenGigabitEthernet 11/1/43

 shutdown

!

interface TenGigabitEthernet 11/1/44

 shutdown

!

interface TenGigabitEthernet 11/1/45

 shutdown

!

interface TenGigabitEthernet 11/1/46

 shutdown

!

interface TenGigabitEthernet 11/1/47

 shutdown

!

< =========== >

 

Results

  1. PASS. NAS I/O completes error-free through bandwidth congestion.

 

< =========== >

 

Storage Device Congested Fabric Medusa Results.jpg

   Storage Device Congested Fabric Medusa Results

 

< =========== >

M4-VCS20-11# show fabric isl

 

Rbridge-id: 11   #ISLs: 1

 

 Src      Src                Nbr       Nbr  

Index   Interface       Index   Interface          Nbr-WWN                               BW   Trunk  Nbr-Name

-------------------------------------------------------------------------------------------------------------------------------------------

59      Te 11/1/48       111    Te 12/0/48      10:00:00:05:33:65:29:60   10G   Yes   "CASTOR-VCS20-12" < ==

 

M4-VCS20-11# show interface tengigabitethernet 12/0/48

TenGigabitEthernet 12/0/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0005.3365.2996

    Current address is 0005.3365.2996

Pluggable media present

Interface index (ifindex) is 51943833653

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:30:20

Queueing strategy: fifo

Receive Statistics:

    1365325336 packets, 2057528326787 bytes

    Unicasts: 1365324687, Multicasts: 652, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 13691272, Over 127-byte pkts: 2173634

    Over 255-byte pkts: 2711501, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 1346748941

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 4007

Transmit Statistics:

    1460468125 packets, 2233743986986 bytes

    Unicasts: 1460467105, Multicasts: 1020, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 5638, TrillportCtrlFrames: 3986

Rate info:

    Input 9043.561188 Mbits/sec, 750119 packets/sec, 90.44% of line-rate

    Output 9818.212256 Mbits/sec, 802479 packets/sec, 98.18% of line-rate < ==

Time since last interface status change: 07:08:47

 

CASTOR-VCS20-12# show qos queue interface tengigabitethernet 12/0/48

Interface TenGigabitEthernet 12/0/48

              RX                     RX                                          TX                     TX

  CoS   Packets             Bytes                      TC        Packets             Bytes

  ------------------------------------    ------------------------------------------------------------------

    0      673378779     1028921959335      0              0                    0

    1              0                 0                                1              4                    400

    2       18573954       2386344080            2              0                     0

    3      673378194     1026228367656      3           586516721    898543616572 < ==

    4              0                 0                                4            0                 0

    5              0                 0                                5            289522200    449203120344 < ==

    6              0                 0                                6            584997087    898554371867 < ==

    7           4007            6115190                   7            3994                5891311

  untag            0                 0                            untag            0                 0

 

CASTOR-VCS20-12# show qos queue interface tengigabitethernet 12/0/31

Interface TenGigabitEthernet 12/0/31

                  RX                RX                                             TX                        TX

  CoS        Packets       Bytes                          TC        Packets             Bytes

  ------------------------------------    -----------------------------------------------------------------------

    0              0                    0                               0              0                       0

    1              0                    0                              1               4                       256

    2              0                    0                               2              0                       0

    3              0                    0                               3              0                       0

    4              0                    0                               4              0                       0

    5              0                    0                               5              0                       0

    6              0                    0                               6              673686631    1010528301674 < ==

    7              0                    0                               7             62                      7445

  untag    673631554     1010447331000   untag    673687081     1010528885375 < ==

 

CASTOR-VCS20-12# show qos queue interface tengigabitethernet 12/0/32

Interface TenGigabitEthernet 12/0/32

                  RX                RX                    TX                TX

  CoS        Packets             Bytes     TC        Packets             Bytes

  ------------------------------------    -----------------------------------------------------------------

    0              0                 0                                0              0                 0

    1              0                 0                                 1              4               256

    2              0                 0                                 2              0                 0

    3      673679783     1010519319808      3          673733608  1010600412000 < ==

    4              0                 0                                 4              0                 0

    5              0                 0                                 5              0                 0

    6              0                 0                                 6           1287            282902

    7              0                 0                                 7            288             26204

  untag         60              5940                     untag       1352            291202

 

CASTOR-VCS20-12# show qos queue interface port-channel 101

Interface TenGigabitEthernet 1/0/1 

                  RX                RX                                         TX                   TX

  CoS        Packets      Bytes                         TC        Packets        Bytes

  ------------------------------------    -----------------------------------------------------------

    0              0                 0                                0              0                 0

    1              0                 0                                1           1024            395880

    2              0                                                2              0                 0

    3           4619            295616                     3              0                 0

    4              0                   0                              4              0                 0

    5              0                   0                              5              0                 0

    6              0                   0                              6             62              5624

    7              0                   0                              7           1875            240116

  untag     45582042     69183931313    untag      2961            641620 < ==

 

Interface TenGigabitEthernet 2/0/1

                  RX                RX                                         TX                TX

  CoS        Packets       Bytes                     TC        Packets          Bytes

  ------------------------------------    -------------------------------------------------------------

    0              0                 0                             0              0                 0

    1              0                 0                             1            171             86394

    2              0                 0                             2              0                 0

    3           4617            295488                  3              0                 0

    4              0                 0                             4              0                 0

    5              0                 0                             5          3962184       262380880

    6              0                 0                             6            901            108886

    7              0                 0                             7           1877            240311

  untag     35279887    53547524031    untag    3965136     262816663 < ==

 

CASTOR-VCS20-12# show qos queue interface port-channel 102

Interface TenGigabitEthernet 1/0/2

                  RX                RX                                               TX            TX

  CoS        Packets       Bytes                        TC        Packets        Bytes

  ------------------------------------    ---------------------------------------------------------

    0              0                 0                                0              0                 0

    1              0                 0                                1            863            321524

    2              0                 0                                2              0                 0

    3              0                 0                                3              0                 0

    4              0                 0                                4              0                 0

    5              0                 0                                5          6283209      549761382

    6              0                 0                                6              0                 0

    7              0                 0                                7            121             15668

  untag     85293781   129187965330    untag      6284200     550099178 < ==

 

Interface TenGigabitEthernet 2/0/2

                  RX                RX                             TX                TX

  CoS        Packets       Bytes     TC          Packets           Bytes

  ------------------------------------    ------------------------------------

    0              0                 0                 0              0                 0

    1              0                 0                 1            241            111802

    2              0                 0                 2              0                 0

    3              0                 0                 3              0                 0

    4              0                 0                 4              0                 0

    5              0                 0                 5              0                 0

    6              0                 0                 6           1109            189072

    7              0                 0                 7            122             15735

  untag          327          91398    untag       1472            316609

 

CASTOR-VCS20-12# show qos queue interface port-channel 103

Interface TenGigabitEthernet 1/0/3

                  RX                RX                                     TX                TX

  CoS        Packets       Bytes                   TC        Packets        Bytes

  ------------------------------------    -----------------------------------------------------------

    0              0                 0                            0              0                 0

    1              0                 0                             1            248             42191

    2              0                 0                             2              0                 0

    3              0                 0                             3              0                 0

    4              0                 0                             4              0                 0

    5              0                 0                              5              0                 0

    6              0                 0                             6              5               320

    7              0                 0                             7            121             15668

  untag     64977495   98406308402    untag      374             58179 < ==

 

Interface TenGigabitEthernet 2/0/3

                  RX                RX                          TX                TX

  CoS        Packets       Bytes     TC        Packets             Bytes

  ------------------------------------    ---------------------------------------------

    0              0                 0                 0              0                 0

    1              0                 0                 1            247             97509

    2              0                 0                 2              0                 0

    3              0                 0                 3              0                 0

    4              0                 0                 4              0                 0

    5              0                 0                 5           4345608      552483272

    6              0                 0                 6           4393            577318

    7              0                 0                 7            122             15735

  untag         2388        256208    untag      4350373     553174208

 

CASTOR-VCS20-12# show qos queue interface port-channel 104

Interface TenGigabitEthernet 1/0/4

                  RX                RX                                         TX                TX

  CoS        Packets      Bytes                       TC        Packets        Bytes

  ------------------------------------    -------------------------------------------------------

    0              0                 0                              0              0                 0

    1              0                 0                              1            260             45742

    2              0                 0                              2              0                 0

    3              0                 0                              3              0                 0

    4              0                 0                              4              0                 0

    5              0                 0                              5              0                 0

    6              0                 0                              6              5               320

    7              0                 0                              7            121            14948

  untag     58420230   88497070802    untag        386            61010 < ==

 

Interface TenGigabitEthernet 2/0/4

                  RX                RX                              TX                TX

  CoS        Packets      Bytes          TC        Packets        Bytes

  ------------------------------------    --------------------------------------------------

    0              0                 0                0              0                 0

    1              0                 0                 1            242             99230

    2              0                 0                 2              0                 0

    3              0                 0                 3              0                 0

    4              0                 0                 4              0                 0

    5              0                 0                 5          3996665      503057266

    6              0                 0                 6           4396            577624

    7              0                 0                 7            122             15003

  untag         2380        259498    untag     4001431     503749871

< =========== >

 

1.2.4 Storage Device – NAS Protocol Jammer CRC Corruption on ISL Port

 

Test Objective

Perform CIFS/NFS jammer testing using CRC corruption with a burst of 10 CRC errors on ISL link, in each direction sequentially, while I/O is running from a single host. Verify I/O recovers successfully.

 

Test Configuration

1. Shutdown all ISL interfaces on M4-VCS20-11 with the exception of one ISL to CASTOR-VCS20-12.

2. Connect Ethernet jammer hardware in-line with remaining ISL between M4-VCS20-11 and CASTOR-VCS20-12.

 

< =========== >

interface TenGigabitEthernet 11/1/43

 shutdown

interface TenGigabitEthernet 11/1/44

 shutdown

interface TenGigabitEthernet 11/1/45

 shutdown

interface TenGigabitEthernet 11/1/46

 shutdown

interface TenGigabitEthernet 11/1/47

 shutdown

< =========== >

 

Results

  1. PASS. All I/O completes error-free through Ethernet jammer CRC corruption on ISL port.

 

CIFS, CRC ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 12/0/48

TenGigabitEthernet 12/0/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0005.3365.2996

    Current address is 0005.3365.2996

Pluggable media present

Interface index (ifindex) is 51943833653

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:33

Queueing strategy: fifo

Receive Statistics:

    1608410 packets, 2292936333 bytes

    Unicasts: 1608382, Multicasts: 18, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 89209, Over 127-byte pkts: 44606

    Over 255-byte pkts: 3, Over 511-byte pkts: 0, Over 1023-byte pkts: 32768

    Over 1518-byte pkts(Jumbo): 1441824

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 67

Transmit Statistics:

    2121061 packets, 3113928578 bytes

    Unicasts: 2121036, Multicasts: 25, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 62

Rate info:

    Input 7.083880 Mbits/sec, 7504 packets/sec, 0.07% of line-rate

    Output 1390.996176 Mbits/sec, 112545 packets/sec, 13.91% of line-rate

Time since last interface status change: 00:10:52

< =========== >

 

NAS Protocol Jammer CRC Corruption on ISL Port Medusa Result 1.jpg

   NAS Protocol Jammer CRC Corruption on ISL Port Medusa Result 1

 

NFS, CRC ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 12/0/48

TenGigabitEthernet 12/0/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0005.3365.2996

    Current address is 0005.3365.2996

Pluggable media present

Interface index (ifindex) is 51943833653

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:33

Queueing strategy: fifo

Receive Statistics:

    991737 packets, 1380871902 bytes

    Unicasts: 991713, Multicasts: 14, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 64162, Over 127-byte pkts: 10

    Over 255-byte pkts: 32060, Over 511-byte pkts: 19467, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 876038

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 52

Transmit Statistics:

    1941946 packets, 2298992695 bytes

    Unicasts: 1941923, Multicasts: 23, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 46

Rate info:

    Input 1501.916968 Mbits/sec, 123064 packets/sec, 15.02% of line-rate

    Output 53.428820 Mbits/sec, 64206 packets/sec, 0.53% of line-rate

Time since last interface status change: 00:14:48

< =========== >

 

NAS Protocol Jammer CRC Corruption on ISL Port Medusa Result 2.jpg

   NAS Protocol Jammer CRC Corruption on ISL Port Medusa Result 2

 

CIFS, CRC ERROR BURST ON WRITE TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/48

TenGigabitEthernet 11/1/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71fd

    Current address is 0027.f81c.71fd

Pluggable media present

Interface index (ifindex) is 47653061254

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:32

Queueing strategy: fifo

Receive Statistics:

    2202029 packets, 3239139235 bytes

    Unicasts: 2202051, Multicasts: 13, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 81866, Over 127-byte pkts: 32772

    Over 255-byte pkts: 0, Over 511-byte pkts: 4, Over 1023-byte pkts: 46387

    Over 1518-byte pkts(Jumbo): 2041019

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 24

Transmit Statistics:

    1613789 packets, 2293497437 bytes

    Unicasts: 1613771, Multicasts: 20, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 24

Rate info:

    Input 1391.554056 Mbits/sec, 112591 packets/sec, 13.92% of line-rate

    Output 7.086800 Mbits/sec, 7507 packets/sec, 0.07% of line-rate

Time since last interface status change: 00:18:06

< =========== >

 

NAS Protocol Jammer CRC Corruption on ISL Port Medusa Result 3.jpg

   NAS Protocol Jammer CRC Corruption on ISL Port Medusa Result 3

 

NFS, CRC ERROR BURST ON WRITE TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/48

TenGigabitEthernet 11/1/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71fd

    Current address is 0027.f81c.71fd

Pluggable media present

Interface index (ifindex) is 47653061254

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:32

Queueing strategy: fifo

Receive Statistics:

    2067904 packets, 2281727525 bytes

    Unicasts: 2067894, Multicasts: 13, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 588951, Over 127-byte pkts: 25609

    Over 255-byte pkts: 2, Over 511-byte pkts: 31597, Over 1023-byte pkts: 2

    Over 1518-byte pkts(Jumbo): 1421746

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 26

Transmit Statistics:

    1272688 packets, 1811422758 bytes

    Unicasts: 1272683, Multicasts: 5, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 26

Rate info:

    Input 52.585728 Mbits/sec, 63207 packets/sec, 0.53% of line-rate

    Output 1478.441920 Mbits/sec, 121141 packets/sec, 14.78% of line-rate

Time since last interface status change: 00:20:07

< =========== >

 

NAS Protocol Jammer CRC Corruption on ISL Port Medusa Result 4.jpg

   NAS Protocol Jammer CRC Corruption on ISL Port Medusa Result 4

 

1.2.5 Storage Device – NAS Protocol Jammer Packet Corruption on ISL Port

 

Test Objective

Perform CIFS/NFS jammer testing using packet corruption with a burst of 10 packet errors on ISL link, in each direction sequentially, while I/O is running from a single host. Verify I/O recovers successfully.

 

Test Configuration

1. Shutdown all ISL interfaces on M4-VCS20-11 with the exception of one ISL to CASTOR-VCS20-12.

2. Connect Ethernet jammer hardware in-line with remaining ISL between M4-VCS20-11 and CASTOR-VCS20-12.

 

< =========== >

interface TenGigabitEthernet 11/1/43

 shutdown

interface TenGigabitEthernet 11/1/44

 shutdown

interface TenGigabitEthernet 11/1/45

 shutdown

interface TenGigabitEthernet 11/1/46

 shutdown

interface TenGigabitEthernet 11/1/47

 shutdown

< =========== >

 

Results

  1. PASS. All I/O completes error-free through Ethernet jammer packet corruption on ISL port.

 

CIFS, PACKET ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 12/0/48

TenGigabitEthernet 12/0/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0005.3365.2996

    Current address is 0005.3365.2996

Pluggable media present

Interface index (ifindex) is 51943833653

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:32

Queueing strategy: fifo

Receive Statistics:

    1619126 packets, 2294128794 bytes

    Unicasts: 1619113, Multicasts: 3, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 96387, Over 127-byte pkts: 48170

    Over 255-byte pkts: 0, Over 511-byte pkts: 0, Over 1023-byte pkts: 32768

    Over 1518-byte pkts(Jumbo): 1441801

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 27

Transmit Statistics:

    2282277 packets, 3362953002 bytes

    Unicasts: 2282269, Multicasts: 8, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 25

Rate info:

    Input 7.128296 Mbits/sec, 7551 packets/sec, 0.07% of line-rate

    Output 1399.340384 Mbits/sec, 113222 packets/sec, 13.99% of line-rate

Time since last interface status change: 00:22:41

< =========== >

 

NAS Protocol Jammer Packet Corruption on ISL Port Medusa Result 1.jpg

   NAS Protocol Jammer Packet Corruption on ISL Port Medusa Result 1

 

NFS, PACKET ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 12/0/48

TenGigabitEthernet 12/0/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0005.3365.2996

    Current address is 0005.3365.2996

Pluggable media present

Interface index (ifindex) is 51943833653

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:32

Queueing strategy: fifo

Receive Statistics:

    90775 packets, 13879486 bytes

    Unicasts: 90754, Multicasts: 11, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 60509, Over 127-byte pkts: 14

    Over 255-byte pkts: 30243, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 9

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 24

Transmit Statistics:

    1391111 packets, 2122790344 bytes

    Unicasts: 1391089, Multicasts: 22, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 23

Rate info:

    Input 5.033288 Mbits/sec, 4121 packets/sec, 0.05% of line-rate

    Output 771.034432 Mbits/sec, 63160 packets/sec, 7.71% of line-rate

Time since last interface status change: 00:24:40

< =========== >

 

NAS Protocol Jammer Packet Corruption on ISL Port Medusa Result 2.jpg

   NAS Protocol Jammer Packet Corruption on ISL Port Medusa Result 2

 

CIFS, PACKET ERROR BURST ON WRITE TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/48

TenGigabitEthernet 11/1/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71fd

    Current address is 0027.f81c.71fd

Pluggable media present

Interface index (ifindex) is 47653061254

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:35

Queueing strategy: fifo

Receive Statistics:

    2921778 packets, 4351069586 bytes

    Unicasts: 2921793, Multicasts: 20, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 81893, Over 127-byte pkts: 32783

    Over 255-byte pkts: 3, Over 511-byte pkts: 4, Over 1023-byte pkts: 62379

    Over 1518-byte pkts(Jumbo): 2744716

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 62

Transmit Statistics:

    1661774 packets, 2299215413 bytes

    Unicasts: 1661774, Multicasts: 3, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 62

Rate info:

    Input 1396.042088 Mbits/sec, 112933 packets/sec, 13.96% of line-rate

    Output 7.149304 Mbits/sec, 7533 packets/sec, 0.07% of line-rate

Time since last interface status change: 00:54:21

< =========== >

 

NAS Protocol Jammer Packet Corruption on ISL Port Medusa Result 3.jpg

   NAS Protocol Jammer Packet Corruption on ISL Port Medusa Result 3

 

NFS, PACKET ERROR BURST ON WRITE TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/48

TenGigabitEthernet 11/1/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71fd

    Current address is 0027.f81c.71fd

Pluggable media present

Interface index (ifindex) is 47653061254

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:32

Queueing strategy: fifo

Receive Statistics:

    2165600 packets, 2306914531 bytes

    Unicasts: 2165604, Multicasts: 9, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 672463, Over 127-byte pkts: 29239

    Over 255-byte pkts: 0, Over 511-byte pkts: 31827, Over 1023-byte pkts: 10

    Over 1518-byte pkts(Jumbo): 1432061

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0, TrillportCtrlFrames: 56

Transmit Statistics:

    1440443 packets, 2066385011 bytes

    Unicasts: 1440433, Multicasts: 10, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 56

Rate info:

    Input 51.830144 Mbits/sec, 62282 packets/sec, 0.52% of line-rate

    Output 1456.865740 Mbits/sec, 119392 packets/sec, 14.57% of line-rate

Time since last interface status change: 00:56:05

< =========== >

 

NAS Protocol Jammer Packet Corruption on ISL Port Medusa Result 4.jpg

   NAS Protocol Jammer Packet Corruption on ISL Port Medusa Result 4

 

1.2.6 Storage Device – NAS Protocol Jammer Packet Loss on ISL Port

 

Test Objective

Perform CIFS/NFS jammer testing using packet loss with a burst of 10 packet drops on ISL link, in each direction sequentially, while I/O is running from a single host. Verify I/O recovers successfully.

 

Test Configuration

1. Shutdown all ISL interfaces on M4-VCS20-11 with the exception of one ISL to CASTOR-VCS20-12.

2. Connect Ethernet jammer hardware in-line with remaining ISL between M4-VCS20-11 and CASTOR-VCS20-12.

 

< =========== >

interface TenGigabitEthernet 11/1/43

 shutdown

interface TenGigabitEthernet 11/1/44

 shutdown

interface TenGigabitEthernet 11/1/45

 shutdown

interface TenGigabitEthernet 11/1/46

 shutdown

interface TenGigabitEthernet 11/1/47

 shutdown

< =========== >

 

Results

  1. PASS. All I/O completes error-free through Ethernet jammer packet loss on ISL port.

 

CIFS, PACKET DROP BURST ON READ TRAFFIC

 

NAS Protocol Jammer Packet Loss on ISL Port Medusa Result 1.jpg

   NAS Protocol Jammer Packet Loss on ISL Port Medusa Result 1

 

NFS, PACKET DROP BURST ON READ TRAFFIC

 

NAS Protocol Jammer Packet Loss on ISL Port Medusa Result 2.jpg

   NAS Protocol Jammer Packet Loss on ISL Port Medusa Result 2

 

CIFS, PACKET DROP BURST ON WRITE TRAFFIC

 

NAS Protocol Jammer Packet Loss on ISL Port Medusa Result 3.jpg

   NAS Protocol Jammer Packet Loss on ISL Port Medusa Result 3

 

NFS, PACKET DROP BURST ON WRITE TRAFFIC

 

NAS Protocol Jammer Packet Loss on ISL Port Medusa Result 4.jpg

   NAS Protocol Jammer Packet Loss on ISL Port Medusa Result 4

 

1.2.7 Storage Device – NAS Protocol Jammer CRC Corruption on Storage Port

 

Test Objective

Perform CIFS/NFS jammer testing using CRC corruption with a burst of 10 CRC errors on storage port link, in each direction sequentially, while I/O is running from a single host. Verify I/O recovers successfully.

 

Results

  1. PASS. All I/O completes error-free through Ethernet jammer packet corruption on storage port.

 

CIFS, CRC ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/10

TenGigabitEthernet 11/1/10 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71d7

    Current address is 0027.f81c.71d7

Pluggable media present

Interface index (ifindex) is 47651815552

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:31

Queueing strategy: fifo

Receive Statistics:

    1203397 packets, 1699009164 bytes

    Unicasts: 1203425, Multicasts: 0, Broadcasts: 0

    64-byte pkts: 58753, Over 64-byte pkts: 0, Over 127-byte pkts: 29364

    Over 255-byte pkts: 0, Over 511-byte pkts: 0, Over 1023-byte pkts: 1115280

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0

Transmit Statistics:

    1407950 packets, 2012486889 bytes

    Unicasts: 1407914, Multicasts: 4, Broadcasts: 34

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 1818.188232 Mbits/sec, 149895 packets/sec, 18.18% of line-rate

    Output 8.925440 Mbits/sec, 11654 packets/sec, 0.09% of line-rate

Time since last interface status change: 00:44:43

< =========== >

 

NAS Protocol Jammer CRC Corruption on Storage Port Medusa Result 1.jpg

   NAS Protocol Jammer CRC Corruption on Storage Port Medusa Result 1

 

NFS, CRC ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/10

TenGigabitEthernet 11/1/10 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71d7

    Current address is 0027.f81c.71d7

Pluggable media present

Interface index (ifindex) is 47651815552

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:32

Queueing strategy: fifo

Receive Statistics:

    89116 packets, 11107760 bytes

    Unicasts: 89106, Multicasts: 0, Broadcasts: 0

    64-byte pkts: 2, Over 64-byte pkts: 59421, Over 127-byte pkts: 29693

    Over 255-byte pkts: 0, Over 511-byte pkts: 0, Over 1023-byte pkts: 0

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0

Transmit Statistics:

    1365754 packets, 2045889106 bytes

    Unicasts: 1365747, Multicasts: 2, Broadcasts: 5

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 4.303312 Mbits/sec, 4316 packets/sec, 0.04% of line-rate

    Output 792.998680 Mbits/sec, 66172 packets/sec, 7.93% of line-rate

Time since last interface status change: 00:51:22

< =========== >

 

NAS Protocol Jammer CRC Corruption on Storage Port Medusa Result 2.jpg

   NAS Protocol Jammer CRC Corruption on Storage Port Medusa Result 2

 

CIFS, CRC ERROR BURST ON WRITE TRAFFIC

 

NAS Protocol Jammer CRC Corruption on Storage Port Medusa Result 3.jpg

   NAS Protocol Jammer CRC Corruption on Storage Port Medusa Result 3

 

NFS, CRC ERROR BURST ON WRITE TRAFFIC

 

NAS Protocol Jammer CRC Corruption on Storage Port Medusa Result 4.jpg

   NAS Protocol Jammer CRC Corruption on Storage Port Medusa Result 4

 

1.2.8 Storage Device – NAS Protocol Jammer Packet Corruption on Storage Port

 

Test Objective

Perform CIFS/NFS jammer testing using packet corruption with a burst of 10 packet errors on storage port link, in each direction sequentially, while I/O is running from a single host. Verify I/O recovers successfully.

 

Results

  1. PASS. All I/O completes error-free through Ethernet jammer packet corruption on storage port.

 

CIFS, PACKET ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/10

TenGigabitEthernet 11/1/10 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71d7

    Current address is 0027.f81c.71d7

Pluggable media present

Interface index (ifindex) is 47651815552

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:32

Queueing strategy: fifo

Receive Statistics:

    1323007 packets, 1871165942 bytes

    Unicasts: 1323021, Multicasts: 0, Broadcasts: 0

    64-byte pkts: 63044, Over 64-byte pkts: 0, Over 127-byte pkts: 31508

    Over 255-byte pkts: 0, Over 511-byte pkts: 0, Over 1023-byte pkts: 1228455

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0

Transmit Statistics:

    1513237 packets, 2159682477 bytes

    Unicasts: 1513221, Multicasts: 6, Broadcasts: 11

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 1645.073976 Mbits/sec, 135630 packets/sec, 16.45% of line-rate

    Output 8.077008 Mbits/sec, 10548 packets/sec, 0.08% of line-rate

Time since last interface status change: 00:56:18

< =========== >

 

NAS Protocol Jammer Packet Corruption on Storage Port Medusa Result 1.jpg

   NAS Protocol Jammer Packet Corruption on Storage Port Medusa Result 1

 

NFS, PACKET ERROR BURST ON READ TRAFFIC

< =========== >

CASTOR-VCS20-12# show interface tengigabitethernet 11/1/10

TenGigabitEthernet 11/1/10 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0027.f81c.71d7

    Current address is 0027.f81c.71d7

Pluggable media present

Interface index (ifindex) is 47651815552

MTU 2500 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 00:00:32

Queueing strategy: fifo

Receive Statistics:

    754936 packets, 998476264 bytes

    Unicasts: 754972, Multicasts: 0, Broadcasts: 0

    64-byte pkts: 4, Over 64-byte pkts: 64175, Over 127-byte pkts: 32079

    Over 255-byte pkts: 4, Over 511-byte pkts: 14319, Over 1023-byte pkts: 644355

    Over 1518-byte pkts(Jumbo): 0

    Runts: 0, Jabbers: 0, CRC: 10, Overruns: 0 < ==

    Errors: 0, Discards: 0

Transmit Statistics:

    1818775 packets, 2235806195 bytes

    Unicasts: 1818784, Multicasts: 4, Broadcasts: 6

    Underruns: 0

    Errors: 0, Discards: 0

Rate info:

    Input 1568.717536 Mbits/sec, 130939 packets/sec, 15.69% of line-rate

    Output 41.545952 Mbits/sec, 68319 packets/sec, 0.42% of line-rate

Time since last interface status change: 00:57:51

< =========== >

 

NAS Protocol Jammer Packet Corruption on Storage Port Medusa Result 2.jpg

   NAS Protocol Jammer Packet Corruption on Storage Port Medusa Result 2

 

CIFS, PACKET ERROR BURST ON WRITE TRAFFIC

 

NAS Protocol Jammer Packet Corruption on Storage Port Medusa Result 3.jpg

   NAS Protocol Jammer Packet Corruption on Storage Port Medusa Result 3

 

NFS, PACKET ERROR BURST ON WRITE TRAFFIC

 

NAS Protocol Jammer Packet Corruption on Storage Port Medusa Result 4.jpg 

   NAS Protocol Jammer Packet Corruption on Storage Port Medusa Result 4

 

1.2.9 Storage Device – NAS Protocol Jammer Packet Loss on Storage Port

 

Test Objective

Perform CIFS/NFS jammer testing using packet loss with a burst of 10 lost packets on ISL link, in each direction sequentially, while I/O is running from a single host. Verify I/O recovers successfully.

 

Results

  1. PASS. All I/O completes error-free through Ethernet jammer packet loss on storage port.

 

CIFS, PACKET DROP BURST ON READ TRAFFIC

 

NAS Protocol Jammer Packet Loss on Storage Port Medusa Result 1.jpg

   NAS Protocol Jammer Packet Loss on Storage Port Medusa Result 1

 

NFS, PACKET DROP BURST ON READ TRAFFIC

 

NAS Protocol Jammer Packet Loss on Storage Port Medusa Result 2.jpg

   NAS Protocol Jammer Packet Loss on Storage Port Medusa Result 2

 

CIFS, PACKET DROP BURST ON WRITE TRAFFIC

 

NAS Protocol Jammer Packet Loss on Storage Port Medusa Result 3.jpg

   NAS Protocol Jammer Packet Loss on Storage Port Medusa Result 3

 

NFS, PACKET DROP BURST ON WRITE TRAFFIC

 

NAS Protocol Jammer Packet Loss on Storage Port Medusa Result 4.jpg

   NAS Protocol Jammer Packet Loss on Storage Port Medusa Result 4

 

1.3 Stress and Error Recovery

 

1.3.1 Storage Device Fabric I/O Integrity – Congested Fabric

 

Test Objective

  1. Configure fabric and devices for maximum link and device saturation.
  2. Configure VDX switch for AUTONAS.
  3. Add L3 FCoE traffic (COS 3), CIFS/NFS traffic (COS 2) and L2 Ethernet traffic (COS 0) to fill all available bandwidth.
  4. From all initiators, start a mixture of READ/WRITE/VERIFY traffic with random data patterns continuously to all targets for 12 hours. 
  5. Verify no unexpected change in I/O throughput occurs.
  6. File I/O compares are enabled.

 

Test Configuration

See test configuration for test 1.2.3.

 

Results

  1. PASS. All I/O completes error-free through VCS fabric congestion.

Storage Device Fabric IO Integrity – Congested Fabric Medusa Result.jpg

   Storage Device Fabric IO Integrity – Congested Fabric Medusa Result

 

< =========== >

M4-VCS20-11# show fabric isl

 

Rbridge-id: 11   #ISLs: 1

 

 Src       Src                Nbr      Nbr  

Index   Interface       Index   Interface          Nbr-WWN                               BW   Trunk  Nbr-Name

--------------------------------------------------------------------------------------------------------------------------------------------

59      Te 11/1/48       111    Te 12/0/48      10:00:00:05:33:65:29:60   10G   Yes   "CASTOR-VCS20-12" < ==

 

M4-VCS20-11# show interface tengigabitethernet 12/0/48

TenGigabitEthernet 12/0/48 is up, line protocol is up (connected)

Hardware is Ethernet, address is 0005.3365.2996

    Current address is 0005.3365.2996

Pluggable media present

Interface index (ifindex) is 51943833653

MTU 9216 bytes

LineSpeed Actual     : 10000 Mbit

LineSpeed Configured : Auto, Duplex: Full

Priority Tag disable

IPv6 RA Guard disable

Last clearing of show interface counters: 15:13:34

Queueing strategy: fifo

Receive Statistics:

    43125097334 packets, 65477483075864 bytes

    Unicasts: 43125078000, Multicasts: 19336, Broadcasts: 0

    64-byte pkts: 0, Over 64-byte pkts: 178115175, Over 127-byte pkts: 46449454

    Over 255-byte pkts: 40169849, Over 511-byte pkts: 40116482, Over 1023-byte pkts: 46371459

    Over 1518-byte pkts(Jumbo): 42773874928

    Runts: 0, Jabbers: 0, CRC: 0, Overruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 113520

Transmit Statistics:

    43948613488 packets, 65454942789773 bytes

    Unicasts: 43948582130, Multicasts: 31358, Broadcasts: 0

    Underruns: 0

    Errors: 0, Discards: 0, TrillportCtrlFrames: 112805

Rate info:

    Input 9633.864560 Mbits/sec, 791547 packets/sec, 96.34% of line-rate

    Output 9633.862984 Mbits/sec, 803019 packets/sec, 96.34% of line-rate < ==

Time since last interface status change: 1d00h21m

 

M4-VCS20-11# show qos queue interface tengigabitethernet 12/0/48

Interface TenGigabitEthernet 12/0/48

                  RX                RX                    TX                TX

  CoS        Packets             Bytes     TC        Packets             Bytes

  ------------------------------------    ------------------------------------

    0    19455845860    29728508433291      0              0                 0 < ==

    1              0                 0      1            114             11436

    2     4196904048     6073115699946      2              0                 0 < ==

    3    19473847192    29678143120608      3    19382827873    29694492301436 < ==

    4              0                 0      4              0                 0

    5              0                 0      5     5099891621     6212409908712

    6             11               886      6    19467468673    29901996376734

    7         113534         170607720      7         112824         164010962

  untag            0                 0    untag            0                 0

 

M4-VCS20-11# show qos queue interface port-channel 101

Interface TenGigabitEthernet 1/0/1

                  RX                RX                                          TX                TX

  CoS        Packets       Bytes                       TC        Packets         Bytes

  ------------------------------------    ---------------------------------------------------------

    0              0                 0                                0              0                 0

    1              0                 0                                1          30359          11776040

    2              0                 0                                2              0                 0

    3         139172           8907008                  3              0                 0

    4              0                 0                                4              0                 0

    5              0                 0                                5              0                 0

    6              0                 0                                6           1825            154888

    7              0                 0                                7          56447           7230441

  untag    639519804 881158052769    untag     88631          19161369 < ==

 

Interface TenGigabitEthernet 2/0/1

                  RX                RX                                           TX                TX

  CoS        Packets        Bytes                        TC        Packets        Bytes

  ------------------------------------    ------------------------------------------------------------------

    0              0                 0                                0              0                   0

    1              0                 0                                1           5539               2608390

    2              0                 0                                2              0                   0

    3         139170           8906880                  3              0                  0

    4              0                 0                                4              0                   0

    5              0                 0                                5         1113571108   1587288512450

    6              0                 0                                6          26635              3216288

    7              0                 0                                7          56455              7230953

  untag    528709501  713033834010    untag   1113659917   1587301841001 < ==

 

M4-VCS20-11# show qos queue interface port-channel 102

Interface TenGigabitEthernet 1/0/2

                  RX                RX                                               TX                      TX

  CoS        Packets       Bytes                             TC        Packets            Bytes

  ------------------------------------    -----------------------------------------------------------------------------

    0              0                   0                                   0              0                      0

    1              0                   0                                   1          26181                9937409

    2              0                   0                                   2              0                       0

    3              0                   0                                  3              0                       0

    4              0                   0                                  4              0                       0

    5              0                   0                                  5           1115046895    1589519354144

    6              0                   0                                  6              7                      448

    7              0                    0                                  7           3651                 472809

  untag   1120987695   1593311466837    untag    1115076824    1589529901270 < ==

 

Interface TenGigabitEthernet 2/0/2

                  RX                RX                                  TX                TX

  CoS        Packets       Bytes            TC        Packets         Bytes

  ------------------------------------    ----------------------------------------------------------------------------

    0              0                 0                    0              0                 0

    1              0                 0                     1           6269           2881082

    2              0                 0                     2              0                 0

    3              0                 0                     3              0                 0

    4              0                 0                     4              0                 0

    5              0                 0                     5              0                 0

    6              0                 0                    6          33697           5741956

    7              0                 0                    7          3659             473321

  untag        10234       2780384    untag    43625           9096359

 

M4-VCS20-11# show qos queue interface port-channel 103

Interface TenGigabitEthernet 1/0/3

                  RX                RX                                                TX                TX

  CoS        Packets       Bytes                           TC        Packets        Bytes

  ------------------------------------    -----------------------------------------------------------------

    0              0                   0                                 0              0                 0

    1              0                   0                                 1           7636           1318384

    2              0                   0                                 2              0                 0

    3              0                   0                                 3              0                 0

    4              0                   0                                 4              0                 0

    5              0                   0                                 5              0                 0

    6              0                   0                                 6            145              9280

    7              0                   0                                 7           3651            472809

  untag   1389188554  1404395625138    untag   11432           1800473 < ==

 

Interface TenGigabitEthernet 2/0/3

                  RX                RX                                TX                TX

  CoS        Packets      Bytes              TC        Packets       Bytes

  ------------------------------------    -----------------------------------------------------------------------

    0              0                 0                     0              0                 0

    1              0                 0                     1           7334           2836835

    2              0                 0                     2              0                 0

    3              0                 0                     3              0                 0

    4              0                 0                     4              0                 0

    5              0                 0                     5         972556342  1373180010932

    6              0                 0                     6         132831          17454462

    7              0                 0                     7           3659            473321

  untag        71331       7680566    untag    972700172    1373200776298

 

M4-VCS20-11# show qos queue interface port-channel 104

Interface TenGigabitEthernet 1/0/4

                  RX                RX                                               TX                TX

  CoS        Packets        Bytes                           TC        Packets       Bytes

  ------------------------------------    --------------------------------------------------------------------------

    0              0                   0                                  0              0                 0

    1              0                   0                                  1           7687           1326926

    2              0                   0                                  2              0                 0

    3              0                   0                                  3              0                 0

    4              0                   0                                 4              0                 0

    5              0                   0                                  5              0                 0

    6              0                   0                                  6            152              9728

    7              0                   0                                  7           3651            450885

  untag   1421612884   1436970011348    untag    11490           1787539 < ==

 

Interface TenGigabitEthernet 2/0/4

                  RX                RX                             TX                TX

  CoS        Packets       Bytes          TC        Packets         Bytes

  ------------------------------------    ------------------------------------

    0              0                 0                   0              0                 0

    1              0                 0                   1           7310           2826856

    2              0                 0                   2              0                 0

    3              0                 0                   3              0                 0

    4              0                 0                   4              0                 0

    5              0                 0                   5          995767234   1405668684096

    6              0                 0                   6          132837          17456834

    7              0                 0                   7           3659               451397

  untag        72319       7839082    untag    995911040   1405689419183

< =========== >

 

1.3.2 Storage Device Integrity – Device Recovery from Port Toggle – Manual Cable Pull

 

Test Objective

Perform sequentially for each Storage Device and Adapter port. With I/O running, perform a quick port toggle every Storage Device and Adapter port.  Verify host I/O will recover.

 

Results

  1. PASS. All I/O recovers through port disconnections and reconnections.

 

1.3.3 Storage Device Integrity – Device Recovery from ISL Port Relocation

 

Test Objective

With I/O running, manually disconnect and reconnect ISL port to different port in same switch. Verify fabric integrity and file I/O recovery. Repeat test for all switch types.

 

Results

  1. PASS. The VCS fabric reforms properly and all I/O recovers through ISL port disconnections and reconnections.

 

1.3.4 Storage Device Stress – Device Recovery from Device Port Toggle – Extended Run

 

Test Objective

Sequentially toggle each Initiator and Target ports in fabric.  Verify host I/O will recover to alternate path and toggled path will recover. Run for 12 hours.

 

Results

  1. PASS. All I/O recovers through all initiator and target port disable and enables.

Device Recovery from Device Port Toggle Extended Run Medusa Result.jpg

   Device Recovery from Device Port Toggle Extended Run Medusa Result

 

1.3.5 Storage Device Recovery – ISL Port Toggle – Extended Run

 

Test Objective

Verify fabric ISL path redundancy between hosts and storage devices. Sequentially toggle each ISL path on all switches.  Host I/O may pause but should recover.  Verify host I/O throughout test. Run for 12 hours.

 

Results

  1. PASS. All I/O completes error-free through ISL port disable and enable commands.

ISL Port Toggle Extended Run Medusa Result.jpg

   ISL Port Toggle Extended Run Medusa Result

 

1.3.6 Storage Device Recovery – All-ISL Port Toggle

 

Test Objective

Verify fabric switch path redundancy between hosts and storage devices. Sequentially, and for all switches, disable all ISLs on the switch under test.  Verify I/O pauses and resume after switch fabric convergence.

 

Results

  1. PASS. All I/O completes error-free after ISL port disable and enable commands.

 

1.3.7 Storage Device Recovery – VDX8770 Line Card Maintenance

 

Test Objective

For extended time run. Verify device connectivity to VDX 8770 blades. Sequentially power off and on each Mercury line card. Verify host I/O will failover to alternate path and toggled path will recover.

 

Results

  1. PASS. All I/O completes error-free through line card power off and on commands.

VDX8770 Line Card Maintenance Medusa Result.jpg

   VDX8770 Line Card Maintenance Medusa Result

 

1.3.8 Storage Device Recovery – Switch Offline

 

Test Objective

Toggle each switch in sequential order.   Mix of chassis disable, reboot, and power cycles. For switches containing device under test, I/O will pause and then resume after switch comes online.

 

Results

  1. Chassis Disable/Enable: PASS. I/O successfully resumes after chassis enable.
  2. Reboot: PASS. I/O successfully resumes after chassis reboot.
  3. Power Cycle: PASS. I/O successfully resumes after chassis power cycle.

 

1.3.9 Storage Device Recovery – Switch Firmware Download

 

Test Objective

Sequentially perform firmware maintenance procedure on all VDX devices connected switches under test. Verify host I/O will continue after firmware download completes.

 

Test Configuration

Execute ‘firmware download’ with coldboot option from previous GA release to current GA release.

 

Results

  1. PASS. All I/O completes error-free after firmware download completes.

Switch Firmware Download ISSU on VDX8770 Medusa Result.jpg

   Switch Firmware Download ISSU on VDX8770 Medusa Result

 

1.3.10 Workload Simulation Test Suite – Microsoft Exchange Server

 

Test Objective

Validate Storage/Fabric behavior while running a Medusa Microsoft Exchange Server workload simulation test suite for 30 minutes. Verify file I/O completes error-free. File I/O compares are disabled.

 

Results

  1. PASS. All I/O completes error-free.

Microsoft Exchange Server Medusa Result.jpg

   Microsoft Exchange Server Medusa Result

 

1.3.11 Workload Simulation Test Suite – File Server Simulation

 

Test Objective

Validate Storage/Fabric behavior while running a Medusa File Server Simulation workload simulation test suite for 30 minutes. Verify file I/O completes error-free. File I/O compares are disabled.

 

Results

  1. PASS. All I/O completes error-free.

File Server Simulation Medusa Result.jpg

   File Server Simulation Medusa Result

 

1.4 Brocade Network Advisor

 

1.4.1 Ethernet Fabric Discovery

 

Test Objective

Verify BNA discovers the VCS fabric.

 

Results

  1. PASS. The VCS cluster is discovered.

Ethernet Fabric Discovery Result.jpg

   Ethernet Fabric Discovery Result

 

1.4.2 Ethernet Fabric Addition and Removal

 

Test Objective

Verify BNA recognizes VCS fabric node addition and removal. Isolate a VCS cluster member by shutting down all of its ISL ports. Verify BNA accurately reflects VCS cluster change. Reintroduce VCS cluster member previously isolated by enabling all of its ISL ports. Verify BNA accurately reflects VCS cluster change.

 

Results

  1. PASS. BNA accurately reports the VCS cluster changes during both removal and addition.

Ethernet Fabric Removal Result.jpg

   Ethernet Fabric Removal Result

 

Ethernet Fabric Addition Result.jpg

   Ethernet Fabric Addition Result

 

1.4.3 Ethernet Fabric Configuration Backup and Restoration

 

Test Objective

Verify BNA performs configuration backup and configuration restore for storage configuration. Perform BNA configuration backup, followed by configuration default on entire VCS cluster. Then, perform BNA configuration restoration using previous configuration backup. Verify configuration is successfully restored.

 

Results

  1. PASS. BNA successfully performs both configuration backup and restoration.

Ethernet Fabric Configuration Backup Result.jpg

   Ethernet Fabric Configuration Backup Result

 

Ethernet Fabric Configuration Restoration Result.jpg

   Ethernet Fabric Configuration Restoration Result

 

Ethernet Fabric Restoration Verification.jpg

   Ethernet Fabric Restoration Verification

 

1.4.4 Ethernet Fabric Firmware Download

 

Test Objective

Verify BNA performs firmware download from previous GA release to current GA release.

 

Results

1. PASS. BNA successfully performs firmware download from NOS5.0.0 to NOS5.0.1.

 

Ethernet Fabric Firmware Download Verification.jpg

   Ethernet Fabric Firmware Download Verification

 

Contributors