Hanic网卡信息

[root@localhost ~]# csid -s

Built at : 2016/05/17 18:28:14 创建日期

Board : COMBO-100G2

Subtype : VHT580

S/N : 0036

Speedgr. : 2

Channels : 8/2 (RX/TX)

Firmware : ok

SW : 0xa41c0400

HW : 0x00040000

Text : HANIC_100G2_SDP 网卡型号

PCI slot : 04:00.0

NUMA : 0 连接到CPU1 - 0 CPU2 - 1

Caps : 0x0000001e

ID ver. : 0x0104

NetCope : 0x0100

Driver [combov2] szedata2cv3: active

(0x41c10700-0x41c10800) {}

(0xa41c0100-0xa41c0800) {}

(0x5d010000-0x5d011000) {}

(0xdc010000-0xdc015000) {}

[root@localhost ~]# lspci -d 1b26: -vvv | grep x8

LnkCap: Port #0, Speed 8GT/s, Width x8, ASPM unknown, Latency L0 unlimited, L1 unlimited

LnkSta: Speed 8GT/s, Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-

LnkCap: Port #0, Speed 8GT/s, Width x8, ASPM unknown, Latency L0 unlimited, L1 unlimited

LnkSta: Speed 8GT/s, Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-

x8代表可用的buffer输

[root@localhost ~]# lspci -d 1b26: -vvv

04:00.0 Ethernet controller: Netcope Technologies, a.s. COMBO-100G2-e1

Subsystem: Netcope Technologies, a.s. Device 0800

Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+

Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

Latency: 0

Interrupt: pin ? routed to IRQ 105

Region 0: Memory at a0000000 (64-bit, non-prefetchable) [size=128M]

Region 2: Memory at a8000000 (64-bit, non-prefetchable) [size=128M]

Capabilities: [80] Power Management version 3

Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)

Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-

Capabilities: [90] MSI: Enable+ Count=1/1 Maskable- 64bit+

Address: 00000000fee005b8 Data: 0000

Capabilities: [c0] Express (v2) Endpoint, MSI 00

DevCap: MaxPayload 1024 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us

ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-

DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-

RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+

MaxPayload 256 bytes, MaxReadReq 4096 bytes

DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend+

LnkCap: Port #0, Speed 8GT/s, Width x8, ASPM unknown, Latency L0 unlimited, L1 unlimited

ClockPM- Surprise- LLActRep- BwNot-

LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-

ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-

LnkSta: Speed 8GT/s, Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-

DevCap2: Completion Timeout: Range B, TimeoutDis+, LTR-, OBFF Not Supported

DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled

LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-

Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-

Compliance De-emphasis: -6dB

LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+

EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-

Capabilities: [100 v2] Advanced Error Reporting

UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-

UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-

UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-

CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-

CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+

AERCap: First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-

Capabilities: [150 v1] Device Serial Number 00-08-49-c9-49-29-70-5c

Capabilities: [300 v1] #19

Kernel driver in use: combov3

Kernel modules: combov3, szedata2-cv3

05:00.0 Ethernet controller: Netcope Technologies, a.s. COMBO-100G2-e0

Subsystem: Netcope Technologies, a.s. Device 0800

Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-

Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

Latency: 0

Region 0: Memory at 90000000 (64-bit, non-prefetchable) [size=128M]

Region 2: Memory at 98000000 (64-bit, non-prefetchable) [size=128M]

Capabilities: [80] Power Management version 3

Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)

Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-

Capabilities: [90] MSI: Enable- Count=1/1 Maskable- 64bit+

Address: 0000000000000000 Data: 0000

Capabilities: [c0] Express (v2) Endpoint, MSI 00

DevCap: MaxPayload 1024 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us

ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-

DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-

RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+

MaxPayload 256 bytes, MaxReadReq 4096 bytes

DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend+

LnkCap: Port #0, Speed 8GT/s, Width x8, ASPM unknown, Latency L0 unlimited, L1 unlimited

ClockPM- Surprise- LLActRep- BwNot-

LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-

ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-

LnkSta: Speed 8GT/s, Width x8, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-

DevCap2: Completion Timeout: Range B, TimeoutDis+, LTR-, OBFF Not Supported

DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled

LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-

Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-

Compliance De-emphasis: -6dB

LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+

EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-

Capabilities: [100 v2] Advanced Error Reporting

UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-

UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-

UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-

CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-

CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+

AERCap: First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-

Capabilities: [150 v1] Device Serial Number 00-08-49-c9-49-29-70-5c

Capabilities: [300 v1] #19

Kernel driver in use: combov3

Kernel modules: combov3, szedata2-cv3

[root@localhost ~]# ll /dev/combosix/

total 0

crw-rw-rw-. 1 root combo-rw 246, 0 Jul 28 19:02 0

drwxr-xr-x. 2 root combo-rw 60 Jul 28 19:02 by-pci-slot

drwxr-xr-x. 3 root combo-rw 60 Jul 28 19:02 by-serial-no

[root@localhost ~]# ll /dev/combosix/0

crw-rw-rw-. 1 root combo-rw 246, 0 Jul 28 19:02 /dev/combosix/0

作为配置实用

[root@localhost ~]# ll /dev/szedataII0

crw-rw-rw-. 1 root combo-rw 245, 0 Jul 28 19:02 /dev/szedataII0

作为数据传输使用

[root@localhost ~]# obufctl

------------------ OBUF Status ----

Interface : 0

OBUF : ENABLED

OBUF speed : 100 Gb/s

---- OBUF Packets/Frames Stats ----

Packets : 10205285059

Transmitted : 10491033040748

Err packets : 0

---------------- OBUF Settings ----

MAC address : 00:00:00:00:00:00

查看以太网状态，即输出使用状态

[root@localhost ~]# ibufctl

-------------------------------------- IBUF Status ----

Interface number : 0

Link status : ON

IBUF : ENABLED

PACODAG overflow occurred : False

DFIFO overflow occurred : False

IBUF speed : 100 Gb/s

------------------------ IBUF Packets/Frames Stats ----

Packets : 11455927619 总包数 = Received + Discarded + Buf overflow

Received : 11455927619

Discarded : 0

Buf overflow : 0

Error packets : 0

------------------------------------ IBUF Settings ----

Frame error from MII [1] : enabled

CRC check [2] : enabled

Minimum frame length [4] : enabled

* length : 64 B

MTU frame length [8] : enabled

* length : 1526 B (max 16352 B)

MAC address check [16] : enabled

* mode : [0x0] promiscuous

Maximal MAC addresses : 16

输入数据包状态

[root@localhost ~]# ibufctl -h

Usage: ibufctl [-AchMorVS] [-a mode] [-b base_addr] [-d path] [-e 0|1]

[-i interface] [-l length] [-m mask] [-s speed]

[-u length] [-v level] [-x file]

Only one command may be used at a time.

-a mode Set MAC check mode

-b base_addr IBUF base address (hex)

-d path Path to device file to use

-e 0|1 Enable(1)/disable(0) interface

-i interface Select interface (default 0)

-l length The minimal frame length allowed

-m mask Set error mask 0-31

-s speed Set speed to 10|100|1000 Mb/s (usable only for 1 Gb/s copper

interfaces)

-u length The maximal frame length allowed in bytes

-x file File design.xml used for component space mapping

-v level Verbose level (0-2)

-A Print status of all interfaces or affect all interfaces if used

with other option

-c Clear MAC list

-h Show this text

-M Read list of MAC addresses (max 16) with validity bit from stdin

-o Show MAC list

-r Reset IBUF frame counters

-V Show version

-S Show etherStats counters

[root@localhost ~]# sze2

sze2fastwrite sze2loopback sze2multiread sze2pcap sze2write

sze常用命令，使用-h查看相关参数

[root@localhost ~]# lsof /dev/szedataII0

COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME

sze2fastw 4676 root mem CHR 245,0 16845 /dev/szedataII0

sze2fastw 4676 root 3u CHR 245,0 0t0 16845 /dev/szedataII0

[root@localhost ~]# killall sze2fastwrite

csboot之前必须确保fastwrite已经停止

安装csboot时光纤端口会出现红绿灯交替闪烁

[root@localhost ~]# dmactl -p

RX DMA Channel 0

Received : 0

Discarded : 153073913 经过hash之后值为0，所以都在一个通道

RX DMA Channel 1

Received : 0

Discarded : 0

RX DMA Channel 2

Received : 0

Discarded : 0

RX DMA Channel 3

Received : 0

Discarded : 0

RX DMA Channel 4

Received : 0

Discarded : 0

RX DMA Channel 5

Received : 0

Discarded : 0

RX DMA Channel 6

Received : 0

Discarded : 0

RX DMA Channel 7

Received : 0

Discarded : 0

查看dma传输通道信息

[root@localhost ~]# sze2multiread -i 999999 &

运行后台程序

sze2multi 4853 root 10u CHR 245,0 0t0 26724 /dev/szedataII0

sze2multi 4853 root 11u CHR 245,0 0t0 26724 /dev/szedataII0

[root@localhost ~]# dmactl -p

RX DMA Channel 0

Received : 812851843

Discarded : 1709405067

RX DMA Channel 1

Received : 0

Discarded : 0

RX DMA Channel 2

Received : 0

Discarded : 0

RX DMA Channel 3

Received : 0

Discarded : 0

RX DMA Channel 4

Received : 0

Discarded : 0

RX DMA Channel 5

Received : 0

Discarded : 0

RX DMA Channel 6

Received : 0

Discarded : 0

RX DMA Channel 7

Received : 0

Discarded : 0

启动多线程测试获取包数据的程序后的状态

以下是用来测试的常用程序

sze2pcap 产生全0数据包，并将其写入

sze2fastwrite 快速

sze2loopback

sze2multiread 从buffer中读取数据只为了测试

[root@localhost ~]# hanic4ctl

----------------------------- Hanic4 Core Settings ----

Interface number : 0

Packet sampling ratio : 0/16

Flow sampling ratio : 0/16

Hash mask : Interface, IPVersion, SrcIP, DstIP, L4Protocol, SrcPort, DstPort

Bidirectional hashing : disabled

Distribution mode : hash

------------- Hanic4 Core Discarded Packets/Frames ----

Total discarded : 0

Discarded by filter : 0

Discarded by sampler : 0

[root@localhost ~]# hanic4ctl -c1

使用该命令可以循环使用通道数 开启分布模式

[root@localhost ~]# hanic4ctl

----------------------------- Hanic4 Core Settings ----

Interface number : 0

Packet sampling ratio : 0/16

Flow sampling ratio : 0/16

Hash mask : Interface, IPVersion, SrcIP, DstIP, L4Protocol, SrcPort, DstPort

Bidirectional hashing : disabled

Distribution mode : round robin

------------- Hanic4 Core Discarded Packets/Frames ----

Total discarded : 0

Discarded by filter : 0

Discarded by sampler : 0

[root@localhost ~]# dmactl -p

RX DMA Channel 0

Received : 2228377025

Discarded : 1709405067

RX DMA Channel 1

Received : 12354582

Discarded : 0

RX DMA Channel 2

Received : 12354585

Discarded : 0

RX DMA Channel 3

Received : 12354585

Discarded : 0

RX DMA Channel 4

Received : 12354587

Discarded : 0

RX DMA Channel 5

Received : 12354587

Discarded : 0

RX DMA Channel 6

Received : 12354588

Discarded : 0

RX DMA Channel 7

Received : 12354588

Discarded : 0

[root@localhost ~]# filter4ctl

----------------------------- Hanic4 Filter Status ----

Filter : ON

Rule matching : disabled

Default action : allow 0-15

-------------- Hanic4 Filter Functional Parameters ----

Component version : 1.4

Pattern match version : not supported

IP support : v4 and v6

Matching strength : 3-tuples

Trimming length range : 65-4094

Send interfaces range : 0-0

DMA channels range : 0-15

---------------- Hanic4 Filter Capacity Parameters ----

IP prefix memory : 16384 records

IPv4 double capacity : supported

Protocol memory : 3x2048 records

Port memory : 3x2048 records

Action memory : 8192 records

如何修改过滤器数

创建过虑文件 filter.txt

写入内容 default allow 0-3

[root@localhost ~]# filter4ctl -F filter.txt

------------------------- Parsing filter rule file -------------------------

Finished with 0 errors and 0 warnings.

Parsing finished successfully, 0 rules recognized.

------------------------- Configuring filter -------------------------

Configuration Optimization:

Finished successfully removing a total of 0 records.

Filter Capacity Requirements Estimation:

IP prefix memory : 1/16384 records (0.00610352%)

Protocol memory : 0/ 6144 records (0%)

Source port memory : 0/ 6144 records (0%)

Destination port memory : 0/ 6144 records (0%)

Action memory : 0/ 8192 records (0%)

Configuration Mapping Process:

Finished successfully after 0 state rehashings and 0 records duplicated.

Filter Capacity Requirements After Map:

IP prefix memory : 1/16384 records (0.00610352%)

Protocol memory : 0/ 6144 records (0%)

Source port memory : 0/ 6144 records (0%)

Destination port memory : 0/ 6144 records (0%)

Action memory : 0/ 8192 records (0%)

Uploading Configuration into Firmware Filter:

Finished successfully.

Firmware filter configured successfully!

[root@localhost ~]# dmactl -p

RX DMA Channel 0

Received : 147187642

Discarded : 0

RX DMA Channel 1

Received : 147187701

Discarded : 0

RX DMA Channel 2

Received : 147187716

Discarded : 0

RX DMA Channel 3

Received : 147187730

Discarded : 0

RX DMA Channel 4

Received : 0

Discarded : 0

RX DMA Channel 5

Received : 0

Discarded : 0

RX DMA Channel 6

Received : 0

Discarded : 0

RX DMA Channel 7

Received : 0

Discarded : 0

修改后的分布式处理状态

[root@localhost ~]# numactl -H

available: 2 nodes (0-1)

node 0 cpus: 0 2 4 6 8 10

node 0 size: 16290 MB

node 0 free: 14858 MB

node 1 cpus: 1 3 5 7 9 11

node 1 size: 16384 MB

node 1 free: 15809 MB

node distances:

node 0 1

0: 10 21

1: 21 10

[root@localhost ~]# csid -s

Built at : 2016/05/17 18:28:14

Board : COMBO-100G2

Subtype : VHT580

S/N : 0036

Speedgr. : 2

Channels : 8/2 (RX/TX)

Firmware : ok

SW : 0xa41c0400

HW : 0x00040000

Text : HANIC_100G2_SDP

PCI slot : 04:00.0

NUMA : 0

Caps : 0x0000001e

ID ver. : 0x0104

NetCope : 0x0100

Driver [combov2] szedata2cv3: active

(0x41c10700-0x41c10800) {}

(0xa41c0100-0xa41c0800) {}

(0x5d010000-0x5d011000) {}

(0xdc010000-0xdc015000) {}

前向纠错简称FEC(Forward Error Correction)，其原理是：发送方将要发送的数据附加上一定的冗余纠错码一并发送，接收方则根据纠错码对数据进行差错检测，如发现差错，由接收方进行纠正，特点：使用纠错码（纠错码编码效率低且设备复杂）、单向信道、发送方无需设置缓冲器。

sze2multiread -i 99999 &