Intel NIC X540-T1 não funcional no Ubuntu Server 12.04

Question

Instalei três Intel X540-T1 em servidores rodando o Ubuntu Server 12.04, mas todos são não-funcionais, sem luzes de link, sem pacotes enviados ou recebidos, e sem conexão em ip4 ou ip6, seja configurado como dhcp ou estático. Além disso, o dmesg não detecta a conexão ou desconexão do cabo.

Atualizei o driver ixgbe padrão para a versão mais recente da Intel (3.11.33) sem alterações. O controlador ethernet está sendo relatado como X540-AT2 (que pode ser um problema que não consigo resolver como consertar), mas o subsistema é X540-T1, então acredito que isso possa ser intencional.

Alguém tem alguma experiência com isso que possa ajudar?

ifconfig eth2
    eth2      Link encap:Ethernet  HWaddr a0:36:9f:14:5f:ea
    inet addr:192.168.101.1  Bcast:192.168.101.255  Mask:255.255.255.0
    UP BROADCAST MULTICAST  MTU:1500  Metric:1<br>
    RX packets:0 errors:0 dropped:0 overruns:0 frame:0
    TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:1000 
    RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)


ethtool -i eth2
    driver: ixgbe
    version: 3.11.33
    firmware-version: 0x8000037c
    bus-info: 0000:08:00.0
    supports-statistics: yes
    supports-test: yes
    supports-eeprom-access: yes
    supports-register-dump: yes


lspci -vvnns 08:00.0
    08:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller 10 Gigabit X540-AT2 [8086:1528] (rev 01)
    Subsystem: Intel Corporation Ethernet Converged Network Adapter X540-T1 [8086:0002]
    Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
    Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
    Latency: 0, Cache Line Size: 32 bytes
    Interrupt: pin A routed to IRQ 16
    Region 0: Memory at e8000000 (64-bit, prefetchable) [size=2M]
    Region 4: Memory at e8200000 (64-bit, prefetchable) [size=16K]
    [virtual] Expansion ROM at e8280000 [disabled] [size=512K]
    Capabilities: <access denied>
    Kernel driver in use: ixgbe
    Kernel modules: ixgbe

Editar saída do dmesg:

dmesg | grep ixgbe
    [    1.684782] ixgbe 0000:08:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
    [    1.684800] ixgbe 0000:08:00.0: setting latency timer to 64
    [    1.685138] ixgbe: 0000:08:00.0: ixgbe_check_options: FCoE Offload feature enabled
    [    2.068069] ixgbe 0000:08:00.0: irq 45 for MSI/MSI-X
    [    2.068075] ixgbe 0000:08:00.0: irq 46 for MSI/MSI-X
    [    2.068079] ixgbe 0000:08:00.0: irq 47 for MSI/MSI-X
    [    2.429029] ixgbe 0000:08:00.0: (PCI Express:2.5GT/s:Width x8) a0:36:9f:14:5f:ea
    [    2.620029] ixgbe 0000:08:00.0: eth2: MAC: 3, PHY: 3, PBA No: G54042-004
    [    2.620033] ixgbe 0000:08:00.0: eth2: Enabled Features: RxQ: 2 TxQ: 2 FdirHash RSC 
    [    2.652184] ixgbe 0000:08:00.0: eth2: Intel(R) 10 Gigabit Network Connection
    [    2.652237] ixgbe 0000:10:00.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
    [    2.652254] ixgbe 0000:10:00.0: setting latency timer to 64
    [    2.652566] ixgbe: 0000:10:00.0: ixgbe_check_options: FCoE Offload feature enabled
    [    3.032057] ixgbe 0000:10:00.0: irq 48 for MSI/MSI-X
    [    3.032062] ixgbe 0000:10:00.0: irq 49 for MSI/MSI-X
    [    3.032067] ixgbe 0000:10:00.0: irq 50 for MSI/MSI-X
    [    3.393034] ixgbe 0000:10:00.0: (PCI Express:2.5GT/s:Width x8) a0:36:9f:10:a8:f2
    [    3.584019] ixgbe 0000:10:00.0: eth3: MAC: 3, PHY: 3, PBA No: G54042-004
    [    3.584023] ixgbe 0000:10:00.0: eth3: Enabled Features: RxQ: 2 TxQ: 2 FdirHash RSC 
    [    3.616178] ixgbe 0000:10:00.0: eth3: Intel(R) 10 Gigabit Network Connection

Edite a saída do sudo lspci

sudo lspci -vvnns 08:00.0
    08:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller 10 Gigabit X540-AT2 [8086:1528] (rev 01)
Subsystem: Intel Corporation Ethernet Converged Network Adapter X540-T1 [8086:0002]
Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 32 bytes
Interrupt: pin A routed to IRQ 16
Region 0: Memory at e8000000 (64-bit, prefetchable) [size=2M]
Region 4: Memory at e8200000 (64-bit, prefetchable) [size=16K]
[virtual] Expansion ROM at e8280000 [disabled] [size=512K]
Capabilities: [40] Power Management version 3
    Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold-)
    Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
    Address: 0000000000000000  Data: 0000
    Masking: 00000000  Pending: 00000000
Capabilities: [70] MSI-X: Enable+ Count=64 Masked-
    Vector table: BAR=4 offset=00000000
    PBA: BAR=4 offset=00002000
Capabilities: [a0] Express (v2) Endpoint, MSI 00
    DevCap: MaxPayload 512 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
        ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
    DevCtl: Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
        MaxPayload 128 bytes, MaxReadReq 512 bytes
    DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr- TransPend-
    LnkCap: Port #0, Speed 5GT/s, Width x8, ASPM L0s L1, Latency L0 <512ns, L1 <4us
        ClockPM- Surprise- LLActRep- BwNot-
    LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
    LnkSta: Speed 2.5GT/s, Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
    DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
    DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
    LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
         Compliance De-emphasis: -6dB
    LnkSta2: Current De-emphasis Level: -6dB
Capabilities: [100 v2] Advanced Error Reporting
    UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
    UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
    UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
    CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
    CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
    AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
Capabilities: [140 v1] Device Serial Number a0-36-9f-ff-ff-14-5f-ea
Capabilities: [150 v1] Alternative Routing-ID Interpretation (ARI)
    ARICap: MFVC- ACS-, Next Function: 0
    ARICtl: MFVC- ACS-, Function Group: 0
Capabilities: [160 v1] Single Root I/O Virtualization (SR-IOV)
    IOVCap: Migration-, Interrupt Message Number: 000
    IOVCtl: Enable- Migration- Interrupt- MSE- ARIHierarchy-
    IOVSta: Migration-
    Initial VFs: 64, Total VFs: 64, Number of VFs: 64, Function Dependency Link: 00
    VF offset: 384, stride: 2, Device ID: 1515
    Supported Page Size: 00000553, System Page Size: 00000001
    Region 0: Memory at 00000000c0e00000 (64-bit, non-prefetchable)
    Region 3: Memory at 00000000c0d00000 (64-bit, non-prefetchable)
    VF Migration: offset: 00000000, BIR: 0
Capabilities: [1d0 v1] Access Control Services
    ACSCap: SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
    ACSCtl: SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
Kernel driver in use: ixgbe
Kernel modules: ixgbe

    

Answer 1

Acontece que os protótipos NICs não falam diretamente com qualquer NIC não protótipo. Eu não tenho certeza porque exatamente. O x540-T1 no Ubuntu funciona muito bem para falar uns com os outros, pelo menos depois de instalar os drivers mais recentes da Intel (e possivelmente antes). Obrigado pela ajuda a todos.