# List of Available AINIC Metrics This section provides an overview of the AINIC statistics available, based on the environment where the device metrics exporter is running: BareMetal, Hypervisor, or Virtual Machine (VM). In a typical deployment where: * AINIC Physical Function (PF) interfaces reside on the baremetal or hypervisor. * AINIC Virtual Function (VF) interfaces are assigned to guest VMs. ## Exporter Running on BareMetal / Hypervisor When the metrics exporter runs on the host system, it can collect the following metrics: * AINIC Port statistics * PF interfaces: LIF, Queue Pair, RDMA & Ethtool statistics * VF interfaces: LIF & Queue Pair statistics ## Exporter Running Inside a VM When the metrics exporter runs inside a guest VM, the following metrics are available: * VF interfaces: RDMA & Ethtool stats ## Supported AINIC metrics list The following table contains a full list of AINIC Metrics that are available using the Device Metrics Exporter. > **Note on Priority Field Naming**: Priority fields now use underscore format (`ETH_FRAMES_RX_PRI_0` through `PRI_7` and `ETH_FRAMES_TX_PRI_0` through `PRI_7`) for improved readability. The old format without underscores (`PRI0` through `PRI7`) remains fully supported for backward compatibility - **no config changes are required**. Both formats enable the same metrics. New configurations should use the underscore format. > > **Important**: Backward compatibility support for the old naming convention (without underscores) will be removed in a future release. Please migrate existing configurations to use the new underscore format. | Baremetal | Hypervisor| Guest VM | Metric | Description | |------------|-----------|------------|--------------------------------------------------|-----------------------------------------------------------------------------| | ✓ | ✓ | ✗ | NIC_TOTAL | Number of NIC nodes on the host | | ✓ | ✓ | ✗ | NIC_MAX_SPEED | Maximum NIC speed in Gbps | | | | | --- Port stats --- | | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_OK | Total number of valid network frames that were successfully received | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_ALL | Total number of all frames received by the device | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_BAD_FCS | Total number of frames rcvd with FCS error on a port | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_BAD_ALL | Total number of bad frames received on a port | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_PAUSE | Total number of pause frames received on a network port | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_BAD_LENGTH | Total number of frames received that have an incorrect or invalid length | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_UNDERSIZED | Total number of frames rcvd that are smaller than minimum frame size | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_OVERSIZED | Total number of frames rcvd that exceed max frame size allowed | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_FRAGMENTS | Total number of frames received that are fragments of larger packets | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_JABBER | Total number of frames received that are considered jabber frames | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_PRIPAUSE | Total number of priority pause frames received | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_STOMPED_CRC | Total number of frames received that had valid CRC but were stomped | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_TOO_LONG | Total number of frames rcvd that exceed max allowable size for frames | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_DROPPED | Total frames rcvd but dropped due to reasons such as buffer overflows etc | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_UNICAST | Total number of unicast frames received | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_MULTICAST | Total number of multicast frames received | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_BROADCAST | Total number of broadcast frames received | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_PRI_0 | Total number of frames received on priority 0 | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_PRI_1 | Total number of frames received on priority 1 | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_PRI_2 | Total number of frames received on priority 2 | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_PRI_3 | Total number of frames received on priority 3 | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_PRI_4 | Total number of frames received on priority 4 | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_PRI_5 | Total number of frames received on priority 5 | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_PRI_6 | Total number of frames received on priority 6 | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_RX_PRI_7 | Total number of frames received on priority 7 | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_TX_OK | Total number of valid network frames that were successfully transmitted | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_TX_ALL | Total number of all frames transmitted by the device | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_TX_BAD | Total number of transmitted frames that are considered bad | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_TX_PAUSE | Total number of pause frames transmitted | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_TX_PRIPAUSE | Total number of priority pause frames transmitted | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_TX_LESS_THAN_64B | Total number of tx frames smaller than min frame size i.e 64 bytes | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_TX_TRUNCATED | Total number of frames that were transmitted but truncated | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_TX_UNICAST | Total number of unicast frames transmitted | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_TX_MULTICAST | Total number of multicast frames transmitted | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_TX_BROADCAST | Total number of broadcast frames transmitted | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_TX_PRI_0 | Total number of frames transmitted on priority 0 | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_TX_PRI_1 | Total number of frames transmitted on priority 1 | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_TX_PRI_2 | Total number of frames transmitted on priority 2 | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_TX_PRI_3 | Total number of frames transmitted on priority 3 | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_TX_PRI_4 | Total number of frames transmitted on priority 4 | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_TX_PRI_5 | Total number of frames transmitted on priority 5 | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_TX_PRI_6 | Total number of frames transmitted on priority 6 | | ✓ | ✓ | ✗ | NIC_PORT_STATS_FRAMES_TX_PRI_7 | Total number of frames transmitted on priority 7 | | ✓ | ✓ | ✗ | NIC_PORT_STATS_OCTETS_RX_OK | Total number of octets (bytes) successfully received | | ✓ | ✓ | ✗ | NIC_PORT_STATS_OCTETS_RX_ALL | Total number of all octets (bytes) received | | ✓ | ✓ | ✗ | NIC_PORT_STATS_OCTETS_TX_OK | Total number of octets (bytes) successfully transmitted | | ✓ | ✓ | ✗ | NIC_PORT_STATS_OCTETS_TX_ALL | Total number of all octets (bytes) transmitted | | ✓ | ✓ | ✗ | NIC_PORT_STATS_RSFEC_CORRECTABLE_WORD | Total number of RS-FEC correctable words received or transmitted | | ✓ | ✓ | ✗ | NIC_PORT_STATS_RSFEC_UNCORRECTABLE_WORD | Total number of RS-FEC uncorrectable words received or transmitted | | ✓ | ✓ | ✗ | NIC_PORT_STATS_RSFEC_CH_SYMBOL_ERR_CNT | Total count of channel symbol errors detected by the RS-FEC mechanism | | | | | --- Port rate stats --- | | | ✓ | ✓ | ✗ | NIC_PORT_STATS_TX_PPS | Port transmit rate in packets per second | | ✓ | ✓ | ✗ | NIC_PORT_STATS_TX_BPS | Port transmit rate in bits per second | | ✓ | ✓ | ✗ | NIC_PORT_STATS_RX_PPS | Port receive rate in packets per second | | ✓ | ✓ | ✗ | NIC_PORT_STATS_RX_BPS | Port receive rate in bits per second | | | | | --- Port status --- | | | ✓ | ✓ | ✗ | NIC_PORT_STATUS_LINK_DOWN_COUNT | Count of link down (flap) events reported by the port's link state machine | | | | | | | | | | | --- LIF (PF/VF) stats --- | | | ✓ | ✓ | ✗ | NIC_LIF_STATS_RX_UNICAST_PACKETS | Total number of unicast packets received by the LIF | | ✓ | ✓ | ✗ | NIC_LIF_STATS_RX_UNICAST_DROP_PACKETS | Number of unicast packets that were dropped during reception | | ✓ | ✓ | ✗ | NIC_LIF_STATS_RX_MULTICAST_DROP_PACKETS | Number of multicast packets that were dropped during reception | | ✓ | ✓ | ✗ | NIC_LIF_STATS_RX_BROADCAST_DROP_PACKETS | Number of broadcast packets that were dropped during reception | | ✓ | ✓ | ✗ | NIC_LIF_STATS_RX_DMA_ERRORS | Number of errors encountered while performing DMA during pkt reception | | ✓ | ✓ | ✗ | NIC_LIF_STATS_TX_UNICAST_PACKETS | Total number of unicast packets transmitted by the LIF | | ✓ | ✓ | ✗ | NIC_LIF_STATS_TX_UNICAST_DROP_PACKETS | Number of unicast packets that were dropped during transmission | | ✓ | ✓ | ✗ | NIC_LIF_STATS_TX_MULTICAST_DROP_PACKETS | Number of multicast packets that were dropped during transmission | | ✓ | ✓ | ✗ | NIC_LIF_STATS_TX_BROADCAST_DROP_PACKETS | Number of broadcast packets that were dropped during transmission | | ✓ | ✓ | ✗ | NIC_LIF_STATS_TX_DMA_ERRORS | Number of errors encountered while performing DMA during pkt transmission | | | | | | | | | | | --- RDMA (RoCE Interface) stats --- | | | ✓ | ✓ | ✓ | RDMA_TX_UCAST_PKTS | Tx RDMA Unicast Packets | | ✓ | ✓ | ✓ | RDMA_TX_CNP_PKTS | Tx RDMA Congestion Notification Packets | | ✓ | ✓ | ✓ | RDMA_RX_UCAST_PKTS | Rx RDMA Ucast Pkts | | ✓ | ✓ | ✓ | RDMA_RX_CNP_PKTS | Rx RDMA Congestion Notification Packets | | ✓ | ✓ | ✓ | RDMA_RX_ECN_PKTS | Rx RDMA Explicit Congestion Notification Packets | | ✓ | ✓ | ✓ | RDMA_REQ_RX_PKT_SEQ_ERR | Request Rx packet sequence errors | | ✓ | ✓ | ✓ | RDMA_REQ_RX_RNR_RETRY_ERR | Request Rx receiver not ready retry errors | | ✓ | ✓ | ✓ | RDMA_REQ_RX_RMT_ACC_ERR | Request Rx remote access errors | | ✓ | ✓ | ✓ | RDMA_REQ_RX_RMT_REQ_ERR | Request Rx remote request errors | | ✓ | ✓ | ✓ | RDMA_REQ_RX_OPER_ERR | Request Rx remote oper errors | | ✓ | ✓ | ✓ | RDMA_REQ_RX_IMPL_NAK_SEQ_ERR | Request Rx implicit negative acknowledgment errors | | ✓ | ✓ | ✓ | RDMA_REQ_RX_CQE_ERR | Request Rx completion queue errors | | ✓ | ✓ | ✓ | RDMA_REQ_RX_CQE_FLUSH | Request Rx completion queue flush count | | ✓ | ✓ | ✓ | RDMA_REQ_RX_DUP_RESP | Request Rx duplicate response errors | | ✓ | ✓ | ✓ | RDMA_REQ_RX_INVALID_PKTS | Request Rx invalid pkts | | ✓ | ✓ | ✓ | RDMA_REQ_TX_LOC_ERR | Request Tx local errors | | ✓ | ✓ | ✓ | RDMA_REQ_TX_LOC_OPER_ERR | Request Tx local operation errors | | ✓ | ✓ | ✓ | RDMA_REQ_TX_MEM_MGMT_ERR | Request Tx memory management errors | | ✓ | ✓ | ✓ | RDMA_REQ_TX_RETRY_EXCD_ERR | Request Tx Retry exceeded errors | | ✓ | ✓ | ✓ | RDMA_REQ_TX_LOC_SGL_INV_ERR | Request Tx local signal inversion errors | | ✓ | ✓ | ✓ | RDMA_RESP_RX_DUP_REQUEST | Response Rx duplicate request count | | ✓ | ✓ | ✓ | RDMA_RESP_RX_OUTOF_BUF | Response Rx out of buffer count | | ✓ | ✓ | ✓ | RDMA_RESP_RX_OUTOUF_SEQ | Response Rx out of sequence count | | ✓ | ✓ | ✓ | RDMA_RESP_RX_CQE_ERR | Response Rx completion queue errors | | ✓ | ✓ | ✓ | RDMA_RESP_RX_CQE_FLUSH | Response Rx completion queue flush | | ✓ | ✓ | ✓ | RDMA_RESP_RX_LOC_LEN_ERR | Response Rx local length errors | | ✓ | ✓ | ✓ | RDMA_RESP_RX_INVALID_REQUEST | Response Rx invalid requests count | | ✓ | ✓ | ✓ | RDMA_RESP_RX_LOC_OPER_ERR | Response Rx local operation errors | | ✓ | ✓ | ✓ | RDMA_RESP_RX_OUTOF_ATOMIC | Response Rx without atomic guarantee count | | ✓ | ✓ | ✓ | RDMA_RESP_TX_PKT_SEQ_ERR | Response Tx packet sequence error count | | ✓ | ✓ | ✓ | RDMA_RESP_TX_RMT_INVAL_REQ_ERR | Response Tx remote invalid request count | | ✓ | ✓ | ✓ | RDMA_RESP_TX_RMT_ACC_ERR | Response Tx remote access error count | | ✓ | ✓ | ✓ | RDMA_RESP_TX_RMT_OPER_ERR | Response Tx remote operation error count | | ✓ | ✓ | ✓ | RDMA_RESP_TX_RNR_RETRY_ERR | Response Tx retry not required error count | | ✓ | ✓ | ✓ | RDMA_RESP_TX_LOC_SGL_INV_ERR | Response Tx local signal inversion error count | | ✓ | ✓ | ✓ | RDMA_RESP_RX_S0_TABLE_ERR | Response rx S0 Table error count | | | | | | | | | | | -- RoCE LIF-Aggregated Queue-Pair stats | | | | | | -- LIF Send Queue Requester stats -- | | | ✓ | ✓ | ✗ | LIF_QP_SQ_REQ_TX_NUM_PACKET_TOTAL | LIF Total SQ Requester Tx Packets (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_SQ_REQ_TX_NUM_SEND_MSGS_WITH_RKE_TOTAL | LIF Total SQ Req Tx Send Msgs with Remote Key Error (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_SQ_REQ_TX_NUM_LOCAL_ACK_TIMEOUTS_TOTAL | LIF Total SQ Req local ACK timeouts (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_SQ_REQ_TX_RNR_TIMEOUT_TOTAL | LIF Total SQ Req RNR timeouts (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_SQ_REQ_TX_TIMES_SQ_DRAINED_TOTAL | LIF Total times SQ moved to drained state (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_SQ_REQ_TX_NUM_CNP_SENT_TOTAL | LIF Total CNPs sent for SQ (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_SQ_REQ_RX_NUM_PACKET_TOTAL | LIF Total packets received on SQ (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_SQ_REQ_RX_NUM_PKTS_WITH_ECN_MARKING_TOTAL | LIF Total SQ pkts with ECN marking (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_SQ_QCN_CURR_BYTE_COUNTER_TOTAL | LIF Total SQ QCN current byte counter (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_SQ_QCN_NUM_BYTE_COUNTER_EXPIRED_TOTAL | LIF Total SQ QCN byte counter expirations (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_SQ_QCN_NUM_TIMER_EXPIRED_TOTAL | LIF Total SQ QCN timer expirations (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_SQ_QCN_NUM_ALPHA_TIMER_EXPIRED_TOTAL | LIF Total SQ QCN alpha timer expirations (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_SQ_QCN_NUM_CNP_RCVD_TOTAL | LIF Total CNPs received on SQ (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_SQ_QCN_NUM_CNP_PROCESSED_TOTAL | LIF Total CNPs processed by QCN on SQ (sum of all QPs) | | | | | -- LIF Receive Queue Responder stats -- | | | ✓ | ✓ | ✗ | LIF_QP_RQ_RSP_TX_NUM_PACKET_TOTAL | LIF Total RQ Responder Tx packets (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_RSP_TX_RNR_ERROR_TOTAL | LIF Total RNR errors sent by RQ (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_RSP_TX_NUM_SEQUENCE_ERROR_TOTAL | LIF Total NAKs sent by RQ due to sequence error (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_RSP_TX_NUM_RP_BYTE_THRES_HIT_TOTAL | LIF Total RP byte threshold hits on RQ (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_RSP_TX_NUM_RP_MAX_RATE_HIT_TOTAL | LIF Total RP max rate hits on RQ (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_RSP_RX_NUM_PACKET_TOTAL | LIF Total RQ Responder Rx packets (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_RSP_RX_NUM_SEND_MSGS_WITH_RKE_TOTAL | LIF Total RQ send msgs with Remote Key Error (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_RSP_RX_NUM_PKTS_WITH_ECN_MARKING_TOTAL | LIF Total RQ pkts with ECN marking (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_RSP_RX_NUM_CNPS_RECEIVED_TOTAL | LIF Total CNPs received on RQ (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_RSP_RX_MAX_RECIRC_EXCEEDED_DROP_TOTAL | LIF Total RQ pkts dropped due to max recirculations (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_RSP_RX_NUM_MEM_WINDOW_INVALID_TOTAL | LIF Total ops rejected due to invalid memory window (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_RSP_RX_NUM_DUPL_WITH_WR_SEND_OPC_TOTAL | LIF Total duplicate Send operation pkts on RQ (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_RSP_RX_NUM_DUPL_READ_BACKTRACK_TOTAL | LIF Total duplicate pkts causing backtrack (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_RSP_RX_NUM_DUPL_READ_ATOMIC_DROP_TOTAL | LIF Total duplicate pkts causing RDMA op drop (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_QCN_CURR_BYTE_COUNTER_TOTAL | LIF Total RQ QCN current byte counter (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_QCN_NUM_BYTE_COUNTER_EXPIRED_TOTAL | LIF Total RQ QCN byte counter expirations (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_QCN_NUM_TIMER_EXPIRED_TOTAL | LIF Total RQ QCN timer expirations (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_QCN_NUM_ALPHA_TIMER_EXPIRED_TOTAL | LIF Total RQ QCN alpha timer expirations (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_QCN_NUM_CNP_RCVD_TOTAL | LIF Total CNPs received on RQ (sum of all QPs) | | ✓ | ✓ | ✗ | LIF_QP_RQ_QCN_NUM_CNP_PROCESSED_TOTAL | LIF Total CNPs processed by QCN on RQ (sum of all QPs) | | | | | | | | | | | --- RoCE Queue-Pair stats --- | | | | | | -- Send Queue Requester stats -- | | | ✓ | ✓ | ✗ | QP_SQ_REQ_TX_NUM_PACKET | SQ Requester Tx Number of Packets | | ✓ | ✓ | ✗ | QP_SQ_REQ_TX_NUM_SEND_MSGS_WITH_RKE | SQ Requester Tx Number Send Msg with Remote Key Error | | ✓ | ✓ | ✗ | QP_SQ_REQ_TX_NUM_LOCAL_ACK_TIMEOUTS | SQ Requester Number of local ACK timeouts for a Tx msg on QP | | ✓ | ✓ | ✗ | QP_SQ_REQ_TX_RNR_TIMEOUT | SQ Requester Number of send operation timeouts due to Receiver Not Ready NAK| | ✓ | ✓ | ✗ | QP_SQ_REQ_TX_TIMES_SQ_DRAINED | SQ Requester Number of times SQ moved to drained state after Tx complete | | ✓ | ✓ | ✗ | QP_SQ_REQ_TX_NUM_CNP_SENT | SQ Requester Number of Congestion Notification Packets sent for the SQ | | ✓ | ✓ | ✗ | QP_SQ_REQ_RX_NUM_PACKET | Number of Packets received on SQ | | ✓ | ✓ | ✗ | QP_SQ_REQ_RX_NUM_PKTS_WITH_ECN_MARKING | Num Pkts received on SQ with Explicit congestion Notification bit set | | ✓ | ✓ | ✗ | QP_SQ_QCN_CURR_BYTE_COUNTER | Current Byte counter used by Quantized congestion notification algo on SQ | | ✓ | ✓ | ✗ | QP_SQ_QCN_NUM_BYTE_COUNTER_EXPIRED | QCN byte counter threshold hit count for the SQ | | ✓ | ✓ | ✗ | QP_SQ_QCN_NUM_TIMER_EXPIRED | QCN dedicated timer expiry count for the SQ | | ✓ | ✓ | ✗ | QP_SQ_QCN_NUM_ALPHA_TIMER_EXPIRED | QCN Alpha timer expiry count for the SQ | | ✓ | ✓ | ✗ | QP_SQ_QCN_NUM_CNP_RCVD | QCN congestion notification pkt count rcvd on the SQ | | ✓ | ✓ | ✗ | QP_SQ_QCN_NUM_CNP_PROCESSED | Count of CNPs successfully processed by QCN algo on the SQ | | | | | -- Receive Queue Responder stats -- | | | ✓ | ✓ | ✗ | QP_RQ_RSP_TX_NUM_PACKET | RQ Responder Tx number of Packets | | ✓ | ✓ | ✗ | QP_RQ_RSP_TX_RNR_ERROR | Count of Receiver Not Ready errors sent by RQ | | ✓ | ✓ | ✗ | QP_RQ_RSP_TX_NUM_SEQUENCE_ERROR | Count of Negative ACK sent by RQ due to Out of Sequence incoming msg | | ✓ | ✓ | ✗ | QP_RQ_RSP_TX_NUM_RP_BYTE_THRES_HIT | Number of times RP Byte threshold hit on RQ | | ✓ | ✓ | ✗ | QP_RQ_RSP_TX_NUM_RP_MAX_RATE_HIT | Number of times Response Pkt max rate was hit affect Tx responses | | ✓ | ✓ | ✗ | QP_RQ_RSP_RX_NUM_PACKET | RQ Responder Rx number of Packets | | ✓ | ✓ | ✗ | QP_RQ_RSP_RX_NUM_SEND_MSGS_WITH_RKE | RQ Responder count of send msgs with Remote Key Error | | ✓ | ✓ | ✗ | QP_RQ_RSP_RX_NUM_PKTS_WITH_ECN_MARKING | Number of packets received on RQ with Explicit Congestion Notification set | | ✓ | ✓ | ✗ | QP_RQ_RSP_RX_NUM_CNPS_RECEIVED | Number of Congestion Notification Packets received on RQ | | ✓ | ✓ | ✗ | QP_RQ_RSP_RX_MAX_RECIRC_EXCEEDED_DROP | Number of incoming pkts on RQ dropped due to max internal recirculations hit| | ✓ | ✓ | ✗ | QP_RQ_RSP_RX_NUM_MEM_WINDOW_INVALID | Number of RDMA operations rejected due to invalid memory window access | | ✓ | ✓ | ✗ | QP_RQ_RSP_RX_NUM_DUPL_WITH_WR_SEND_OPC | Number of incoming duplicate Send operation packets on RQ | | ✓ | ✓ | ✗ | QP_RQ_RSP_RX_NUM_DUPL_READ_BACKTRACK | Count of duplicate packets that resulted in backtracking of Packet Seq Num | | ✓ | ✓ | ✗ | QP_RQ_RSP_RX_NUM_DUPL_READ_ATOMIC_DROP | Count of duplicate pkts that resulted in drop of RDMA operations | | ✓ | ✓ | ✗ | QP_RQ_QCN_CURR_BYTE_COUNTER | Current Byte counter used by Quantized congestion notification algo on RQ | | ✓ | ✓ | ✗ | QP_RQ_QCN_NUM_BYTE_COUNTER_EXPIRED | QCN byte counter threshold hit count for the RQ | | ✓ | ✓ | ✗ | QP_RQ_QCN_NUM_TIMER_EXPIRED | QCN dedicated timer expiry count for the RQ | | ✓ | ✓ | ✗ | QP_RQ_QCN_NUM_ALPHA_TIMER_EXPIRED | QCN Alpha timer expiry count for the RQ | | ✓ | ✓ | ✗ | QP_RQ_QCN_NUM_CNP_RCVD | QCN congestion notification pkt count rcvd on the RQ | | ✓ | ✓ | ✗ | QP_RQ_QCN_NUM_CNP_PROCESSED | Count of CNPs successfully processed by QCN algo on the RQ | | | | | | | | | | | --- Ethtool stats --- | | | ✓ | ✓ | ✓ | ETH_TX_PACKETS | Count of transmitted packets | | ✓ | ✓ | ✓ | ETH_TX_BYTES | Count of transmitted bytes | | ✓ | ✓ | ✓ | ETH_RX_PACKETS | Count of received packets | | ✓ | ✓ | ✓ | ETH_RX_BYTES | Count of received bytes | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_BROADCAST | Count of broadcast frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_MULTICAST | Count of multicast frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_BROADCAST | Count of broadcast frames transmitted | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_MULTICAST | Count of multicast frames transmitted | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_PAUSE | Count of pause frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_PAUSE | Count of pause frames transmitted | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_PRIPAUSE | Count of priority pause frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_PRIPAUSE | Count of priority pause frames transmitted | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_64B | Count of 64-byte frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_65B_127B | Count of 65-127 byte frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_128B_255B | Count of 128-255 byte frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_256B_511B | Count of 256-511 byte frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_512B_1023B | Count of 512-1023 byte frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_1024B_1518B | Count of 1024-1518 byte frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_1519B_2047B | Count of 1519-2047 byte frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_2048B_4095B | Count of 2048-4095 byte frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_4096B_8191B | Count of 4096-8191 byte frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_BAD_FCS | Count of frames received with bad FCS | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_PRI_0 | Count of priority 0 frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_PRI_1 | Count of priority 1 frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_PRI_2 | Count of priority 2 frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_PRI_3 | Count of priority 3 frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_PRI_4 | Count of priority 4 frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_PRI_5 | Count of priority 5 frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_PRI_6 | Count of priority 6 frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_PRI_7 | Count of priority 7 frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_PRI_0 | Count of priority 0 frames transmitted | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_PRI_1 | Count of priority 1 frames transmitted | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_PRI_2 | Count of priority 2 frames transmitted | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_PRI_3 | Count of priority 3 frames transmitted | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_PRI_4 | Count of priority 4 frames transmitted | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_PRI_5 | Count of priority 5 frames transmitted | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_PRI_6 | Count of priority 6 frames transmitted | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_PRI_7 | Count of priority 7 frames transmitted | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_DROPPED | Count of frames dropped on receive | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_ALL | Total number of frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_BAD_ALL | Total number of bad frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_ALL | Total number of frames transmitted | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_BAD | Total number of bad frames transmitted | | ✓ | ✓ | ✓ | ETH_HW_TX_DROPPED | Count of hardware transmitted dropped frames | | ✓ | ✓ | ✓ | ETH_HW_RX_DROPPED | Count of hardware received dropped frames | | ✓ | ✓ | ✓ | ETH_RX_0_DROPPED | Count of packets dropped on receive queue 0 | | ✓ | ✓ | ✓ | ETH_RX_1_DROPPED | Count of packets dropped on receive queue 1 | | ✓ | ✓ | ✓ | ETH_RX_2_DROPPED | Count of packets dropped on receive queue 2 | | ✓ | ✓ | ✓ | ETH_RX_3_DROPPED | Count of packets dropped on receive queue 3 | | ✓ | ✓ | ✓ | ETH_RX_4_DROPPED | Count of packets dropped on receive queue 4 | | ✓ | ✓ | ✓ | ETH_RX_5_DROPPED | Count of packets dropped on receive queue 5 | | ✓ | ✓ | ✓ | ETH_RX_6_DROPPED | Count of packets dropped on receive queue 6 | | ✓ | ✓ | ✓ | ETH_RX_7_DROPPED | Count of packets dropped on receive queue 7 | | ✓ | ✓ | ✓ | ETH_RX_8_DROPPED | Count of packets dropped on receive queue 8 | | ✓ | ✓ | ✓ | ETH_RX_9_DROPPED | Count of packets dropped on receive queue 9 | | ✓ | ✓ | ✓ | ETH_RX_10_DROPPED | Count of packets dropped on receive queue 10 | | ✓ | ✓ | ✓ | ETH_RX_11_DROPPED | Count of packets dropped on receive queue 11 | | ✓ | ✓ | ✓ | ETH_RX_12_DROPPED | Count of packets dropped on receive queue 12 | | ✓ | ✓ | ✓ | ETH_RX_13_DROPPED | Count of packets dropped on receive queue 13 | | ✓ | ✓ | ✓ | ETH_RX_14_DROPPED | Count of packets dropped on receive queue 14 | | ✓ | ✓ | ✓ | ETH_RX_15_DROPPED | Count of packets dropped on receive queue 15 | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_OK | Count of frames received successfully | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_OK | Count of frames transmitted successfully | | ✓ | ✓ | ✓ | ETH_OCTETS_RX_OK | Count of octets/bytes received successfully | | ✓ | ✓ | ✓ | ETH_OCTETS_TX_OK | Count of octets/bytes transmitted successfully | | ✓ | ✓ | ✓ | ETH_OCTETS_TX_TOTAL | Total count of octets/bytes transmitted | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_UNICAST | Count of unicast frames received | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_UNICAST | Count of unicast frames transmitted | | ✓ | ✓ | ✓ | ETH_FRAMES_RX_8192B_9215B | Count of frames received with size 8192-9215 bytes | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_8192B_9215B | Count of frames transmitted with size 8192-9215 bytes | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_64B | Count of frames transmitted with size 64 bytes | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_65B_127B | Count of frames transmitted with size 65-127 bytes | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_128B_255B | Count of frames transmitted with size 128-255 bytes | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_256B_511B | Count of frames transmitted with size 256-511 bytes | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_512B_1023B | Count of frames transmitted with size 512-1023 bytes | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_1024B_1518B | Count of frames transmitted with size 1024-1518 bytes | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_1519B_2047B | Count of frames transmitted with size 1519-2047 bytes | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_2048B_4095B | Count of frames transmitted with size 2048-4095 bytes | | ✓ | ✓ | ✓ | ETH_FRAMES_TX_4096B_8191B | Count of frames transmitted with size 4096-8191 bytes | ## Notes * To reduce Prometheus memory footprint, LIF-aggregated QP stats (metrics prefixed with `LIF_QP_*`) are enabled by default. Per-QP stats (metrics prefixed with `QP_*`) are **disabled by default** and can be enabled via configuration. * For short-lived debugging, per-QP metrics can be temporarily exposed via `/metrics?debug=qp`. This debug mode temporarily enables all QP_* metrics without modifying the configuration file. ## Port Stats example ```json nic_port_stats_frames_rx_bad_all{nic_hostname="ubuntu",nic_id="0",nic_serial_number="FPL25180020",port_name="eth1/1"} 0 nic_port_stats_frames_rx_bad_all{nic_hostname="ubuntu",nic_id="1",nic_serial_number="FPL244500E4",port_name="eth1/1"} 0 nic_port_stats_frames_rx_bad_fcs{nic_hostname="ubuntu",nic_id="0",nic_serial_number="FPL25180020",port_name="eth1/1"} 0 nic_port_stats_frames_rx_bad_fcs{nic_hostname="ubuntu",nic_id="1",nic_serial_number="FPL244500E4",port_name="eth1/1"} 0 ``` ## LIF Stats example ```json nic_lif_stats_rx_unicast_drop_packets{lif_name="enp132s0",nic_hostname="ubuntu",nic_id="1",nic_serial_number="FPL244500E4"} 0 nic_lif_stats_rx_unicast_drop_packets{lif_name="enp132s0v0",nic_hostname="ubuntu",nic_id="1",nic_serial_number="FPL244500E4"} 0 nic_lif_stats_rx_unicast_drop_packets{lif_name="enp68s0",nic_hostname="ubuntu",nic_id="0",nic_serial_number="FPL25180020"} 0 nic_lif_stats_rx_unicast_drop_packets{lif_name="eth0_vf1",nic_hostname="ubuntu",nic_id="0",nic_serial_number="FPL25180020"} 0 nic_lif_stats_rx_unicast_packets{lif_name="enp132s0",nic_hostname="ubuntu",nic_id="1",nic_serial_number="FPL244500E4"} 128530 nic_lif_stats_rx_unicast_packets{lif_name="enp132s0v0",nic_hostname="ubuntu",nic_id="1",nic_serial_number="FPL244500E4"} 6.2882736e+07 nic_lif_stats_rx_unicast_packets{lif_name="enp68s0",nic_hostname="ubuntu",nic_id="0",nic_serial_number="FPL25180020"} 22 nic_lif_stats_rx_unicast_packets{lif_name="eth0_vf1",nic_hostname="ubuntu",nic_id="0",nic_serial_number="FPL25180020"} 0 ``` ## RDMA Stats example ```json rdma_tx_ucast_pkts{nic_hostname="ubuntu",rdma_if_name="ionic_0"} 3.244137635e+09 rdma_tx_ucast_pkts{nic_hostname="ubuntu",rdma_if_name="roceo3"} 1.6392e+07 rdma_tx_ucast_pkts{nic_hostname="ubuntu",rdma_if_name="rocep132s0"} 0 rdma_tx_ucast_pkts{nic_hostname="ubuntu",rdma_if_name="rocep33s0f0"} 0 rdma_tx_ucast_pkts{nic_hostname="ubuntu",rdma_if_name="rocep33s0f1"} 0 rdma_rx_ucast_pkts{nic_hostname="ubuntu",rdma_if_name="ionic_0"} 3.26044101e+09 rdma_rx_ucast_pkts{nic_hostname="ubuntu",rdma_if_name="roceo3"} 22955 rdma_rx_ucast_pkts{nic_hostname="ubuntu",rdma_if_name="rocep132s0"} 0 rdma_rx_ucast_pkts{nic_hostname="ubuntu",rdma_if_name="rocep33s0f0"} 0 rdma_rx_ucast_pkts{nic_hostname="ubuntu",rdma_if_name="rocep33s0f1"} 0 ``` ## Ethernet Stats example ```json eth_rx_bytes{lif_name="enp132s0",nic_hostname="ubuntu-gpu",nic_id="1",nic_serial_number="FPL244500E4",nic_uuid="42424650-4c32-3434-3530-304534000000"} 1.69319739e+08 eth_rx_bytes{lif_name="enp68s0",nic_hostname="ubuntu-gpu",nic_id="0",nic_serial_number="FPL25180020",nic_uuid="42424650-4c32-3531-3830-303230000000"} 2.12384938e+08 eth_rx_bytes{lif_name="enp68s0v0",nic_hostname="ubuntu-gpu",nic_id="0",nic_serial_number="FPL25180020",nic_uuid="42424650-4c32-3531-3830-303230000000"} 2.12328598e+08 eth_rx_packets{lif_name="enp132s0",nic_hostname="ubuntu-gpu",nic_id="1",nic_serial_number="FPL244500E4",nic_uuid="42424650-4c32-3434-3530-304534000000"} 1.920603e+06 eth_rx_packets{lif_name="enp68s0",nic_hostname="ubuntu-gpu",nic_id="0",nic_serial_number="FPL25180020",nic_uuid="42424650-4c32-3531-3830-303230000000"} 2.179336e+06 eth_rx_packets{lif_name="enp68s0v0",nic_hostname="ubuntu-gpu",nic_id="0",nic_serial_number="FPL25180020",nic_uuid="42424650-4c32-3531-3830-303230000000"} 2.178601e+06 eth_tx_bytes{lif_name="enp132s0",nic_hostname="ubuntu-gpu",nic_id="1",nic_serial_number="FPL244500E4",nic_uuid="42424650-4c32-3434-3530-304534000000"} 8.2451426e+07 eth_tx_bytes{lif_name="enp68s0",nic_hostname="ubuntu-gpu",nic_id="0",nic_serial_number="FPL25180020",nic_uuid="42424650-4c32-3531-3830-303230000000"} 1.689054e+06 eth_tx_bytes{lif_name="enp68s0v0",nic_hostname="ubuntu-gpu",nic_id="0",nic_serial_number="FPL25180020",nic_uuid="42424650-4c32-3531-3830-303230000000"} 6.7955573e+07 eth_tx_packets{lif_name="enp132s0",nic_hostname="ubuntu-gpu",nic_id="1",nic_serial_number="FPL244500E4",nic_uuid="42424650-4c32-3434-3530-304534000000"} 512803 eth_tx_packets{lif_name="enp68s0",nic_hostname="ubuntu-gpu",nic_id="0",nic_serial_number="FPL25180020",nic_uuid="42424650-4c32-3531-3830-303230000000"} 19909 eth_tx_packets{lif_name="enp68s0v0",nic_hostname="ubuntu-gpu",nic_id="0",nic_serial_number="FPL25180020",nic_uuid="42424650-4c32-3531-3830-303230000000"} 423136 ```