Unable to Bring up Copper SFP on Dell S4048-ON

Follow

Issue

I am unable to bring up link with a copper SFP on a Dell S4048-ON switch. The following message appears in /var/log/syslog:

portwd: MV88E1111 with revision 1 silicon detected in port swp45. Disabling port.

ip link show indicates the port is admin down after bringing it up:

cumulus@switch$ sudo ip link set swp45 up
cumulus@switch$ ip link show swp45
47: swp45: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN mode DEFAULT qlen 500 
    link/ether cc:37:ab:2c:9a:b1 brd ff:ff:ff:ff:ff:ff

Environment

  • Dell S4048-ON
  • Copper SFP
  • Cumulus Linux versions after 2.5.3

Resolution

Use an alternate SFP with a later revision of RJ45 module silicon.

Root Cause

Copper SFPs with Marvell revision 1 RJ45 module silicon [1] have been found to lock up the bus on the Dell S4048-ON. The portwd daemon therefore shuts down SFPs with this revision to discourage use. This behavior is not configurable.

The following is an incomplete list of SFPs previously observed to be affected by this issue.  This list will be updated as additional SFPs are confirmed to be affected.

VendorPart NumberRevision
Arista Networks SFP-1G-T 0002
CISCO-AGILENT QBCU-5798R  
CISCO-AVAGO ABCU-5710RZ-CS2 02
CISCO-AVAGO QBCU-5798R  
CISCO-EQUIV GLC-T-ENC A
FINISAR CORP. FCLF8521P2BTL-HP  A
Methode Elec. SP7041-M1-JN -

[1] http://www.marvell.com/transceivers/assets/Marvell-Alaska-Ultra-88E1111-GbE.pdf

Diagnostic Steps

You can run the attached copper_gbic_rev.py script against a particular port on a Dell S4048-ON to check the RJ45 module revision:

cumulus@switch$ sudo python copper_gbic_rev.py swp32
c10c

c10c is the affected revision 1 silicon. c20c and later revisions are not affected.

Have more questions? Submit a request

Comments

  • Avatar
    Mike Brown

    Here are a few more modules that were found with a MV88E1111 revision 1 silicon. Since this Vendor data can be overwritten by any manufacturer or distributor, the script above is the way to get the final word on the hardware revision of a 1G Copper SFP.

    # ethtool -m swp37 | grep Vend
    Vendor name : CISCO-AVAGO
    Vendor OUI : 00:17:6a
    Vendor PN : ABCU-5710RZ-CS2
    Vendor rev : 02
    # ethtool -m swp38 | grep Vend
    Vendor name : Methode Elec.
    Vendor OUI : 00:00:00
    Vendor PN : SP7041-M1-JN
    Vendor rev : -
    # ethtool -m swp39 | grep Vend
    Vendor name : Arista Networks
    Vendor OUI : 00:1c:73
    Vendor PN : SFP-1G-T
    Vendor rev : 0002
    # ethtool -m swp2 | grep Vend
    Vendor name : CISCO-EQUIV
    Vendor OUI : 00:00:00
    Vendor PN : GLC-T-ENC
    Vendor rev : A

  • Avatar
    Trap Marshall

    Thanks Mike! Added those to the table.

Powered by Zendesk