Изпечатай

[Ipolit]

Здравейте,
имам 20 компютъра, вързани в един суич, които трябва да се свързват постоянно с един LTSP сървър с максимално допустима скорост.
Суичът е Mikrotik CSS326-24G-2S+RM - 24 гигабитови порта и 2 SFP +
На сървъра сложих Supermicro AOC-STGN-i1S, което е с чип  Intel 82599ES - 1 SFP + порт
Сървърът е с Ubuntu 12.04
И системата работи, но не съвсем.
Около 10 пъти на ден мрежовата връзка се разпада за около секунда-две

Код:

Sep  8 08:54:05 LtspServer kernel: [832875.459449] ixgbe 0000:01:00.0 eth2: NIC Link is Down
Sep  8 08:54:07 LtspServer kernel: [832877.460694] ixgbe 0000:01:00.0 eth2: NIC Link is Up 10 Gbps, Flow Control: TX

Разстоянието между суича и сървъра е 20 метра и респективно не се продават готови SFP-та със заработен кабел и се чудя дали това може да е проблемът. Ползвам SFP + с оптични кабели.
На някакъв форум прочетох, че трябвало да се ползва специален кабел с   Intel 82599ES, но дали е вярно - не знам. Готовите кабели са 3 или 5 метра. Тъй или иначе ще ми е трудно да преместя микротика по-близо до сървъра.
Някой ако е имал подобен проблем, моля да сподели как го е решил.

[BRADATA]

Първо какви са ти SFP модулите и второ - какво казват микротик логовете. Защото аз имам постоянно проблеми с микротик и сфп модули, които не са техни.

[Ipolit]

Няма грешки на микротика.
А sfp тата не ги знам какви какъв модел са, но са означени като SFP+ short range

[Ipolit]

В ето тази тема https://communities.intel.com/thread/103283 казват, че зависи от кабела и sfp-тата.
Мама му стара, не ми се опъват 20 кабела на 50 метра, че да приближа микротика.

[Slevin_]

В ето тази тема https://communities.intel.com/thread/103283 казват, че зависи от кабела и sfp-тата.

В посочената тема пише, че проблема се дължи на шум от reference clock -а  --> https://communities.intel.com/message/409039#409039

[Acho]

А не може ли Mikroтik-а да отиде по-близо до комповете ?

[Ipolit]

може, ама трябва да пусна нови кабели от компютрите до микротика. Сегашните са по 20 метра, трябва да ги махна и да сложа нови по 40 примерно, което си е играчка.
Окачени тавани, кабелни скари - грозна картина

А това, че проблемът е reference clock, не знам какво мога да направя. Какво е reference clock - нещо в sfp модула ли?

[pgmgm]

Изхвърли микротика, и бягай далече от него!
Това е съвсем сериозно!

[Slevin_]

А това, че проблемът е reference clock, не знам какво мога да направя. Какво е reference clock - нещо в sfp модула ли?

Онази тема според мен не се вписва точно при теб.
По скоро е свързана с фирма(компания), която разработва мрежов контролер на базата на чипа 82599, очевидно са имали проблем с linkstate при 10 Gbit,
Накрая са установили, че проблема е създаден заради използването на некачествен осцилатор за reference clock в мрежоввия им контролер.

Опитай да промениш нещо в постановката при теб: оптични пач корди, SFP трансивъри...

[BRADATA]

Я дай изхода от:

Код:

ethtool ethX
ethtool -m ethX
ethtool -S ethX

Ето примерен изход от моя машина:

Код:

root@pve1:~# ethtool eth2
Settings for eth2:
        Supported ports: [ FIBRE ]
        Supported link modes:   10000baseT/Full
        Supported pause frame use: No
        Supports auto-negotiation: No
        Advertised link modes:  10000baseT/Full
        Advertised pause frame use: Symmetric
        Advertised auto-negotiation: No
        Speed: 10000Mb/s
        Duplex: Full
        Port: FIBRE
        PHYAD: 0
        Transceiver: external
        Auto-negotiation: off
        Supports Wake-on: d
        Wake-on: d
        Current message level: 0x00000007 (7)
                               drv probe link
        Link detected: yes
root@pve1:~# ethtool -S eth2
NIC statistics:
     rx_packets: 17305484368
     tx_packets: 6974864907
     rx_bytes: 13274398108020
     tx_bytes: 10718583513139
     rx_errors: 0
     tx_errors: 0
     rx_dropped: 0
     tx_dropped: 0
     multicast: 1466584541
     collisions: 0
     rx_over_errors: 0
     rx_crc_errors: 0
     rx_frame_errors: 0
     rx_fifo_errors: 0
     rx_missed_errors: 32467
     tx_aborted_errors: 0
     tx_carrier_errors: 0
     tx_fifo_errors: 0
     tx_heartbeat_errors: 0
     rx_pkts_nic: 17305484368
     tx_pkts_nic: 6974864907
     rx_bytes_nic: 13409194186809
     tx_bytes_nic: 10776121268883
     lsc_int: 2
     tx_busy: 0
     non_eop_descs: 2148683086
     broadcast: 2201766469
     rx_no_buffer_count: 0
     tx_timeout_count: 0
     tx_restart_queue: 0
     rx_long_length_errors: 0
     rx_short_length_errors: 0
     tx_flow_control_xon: 40
     rx_flow_control_xon: 0
     tx_flow_control_xoff: 498
     rx_flow_control_xoff: 0
     rx_csum_offload_errors: 85856
     alloc_rx_page_failed: 0
     alloc_rx_buff_failed: 0
     rx_no_dma_resources: 0
     hw_rsc_aggregated: 0
     hw_rsc_flushed: 0
     fdir_match: 6096353408
     fdir_miss: 6076195207
     fdir_overflow: 205
     fcoe_bad_fccrc: 0
     fcoe_last_errors: 0
     rx_fcoe_dropped: 0
     rx_fcoe_packets: 0
     rx_fcoe_dwords: 0
     fcoe_noddp: 0
     fcoe_noddp_ext_buff: 0
     tx_fcoe_packets: 0
     tx_fcoe_dwords: 0
     os2bmc_rx_by_bmc: 0
     os2bmc_tx_by_bmc: 0
     os2bmc_tx_by_host: 0
     os2bmc_rx_by_host: 0
     tx_hwtstamp_timeouts: 0
     rx_hwtstamp_cleared: 0
     tx_queue_0_packets: 353701350
     tx_queue_0_bytes: 405619498485
     tx_queue_0_bp_napi_yield: 0
     tx_queue_0_bp_misses: 0
     tx_queue_0_bp_cleaned: 0
     tx_queue_1_packets: 378083587
     tx_queue_1_bytes: 477948209593
     tx_queue_1_bp_napi_yield: 0
     tx_queue_1_bp_misses: 0
     tx_queue_1_bp_cleaned: 0
     tx_queue_2_packets: 444449225
     tx_queue_2_bytes: 513166089920
     tx_queue_2_bp_napi_yield: 0
     tx_queue_2_bp_misses: 0
     tx_queue_2_bp_cleaned: 0
     tx_queue_3_packets: 444163447
     tx_queue_3_bytes: 515602254693
     tx_queue_3_bp_napi_yield: 0
     tx_queue_3_bp_misses: 0
     tx_queue_3_bp_cleaned: 0
     tx_queue_4_packets: 433352340
     tx_queue_4_bytes: 462509470500
     tx_queue_4_bp_napi_yield: 0
     tx_queue_4_bp_misses: 0
     tx_queue_4_bp_cleaned: 0
     tx_queue_5_packets: 389536305
     tx_queue_5_bytes: 436025309386
     tx_queue_5_bp_napi_yield: 0
     tx_queue_5_bp_misses: 0
     tx_queue_5_bp_cleaned: 0
     tx_queue_6_packets: 334823957
     tx_queue_6_bytes: 395651097836
     tx_queue_6_bp_napi_yield: 0
     tx_queue_6_bp_misses: 0
     tx_queue_6_bp_cleaned: 0
     tx_queue_7_packets: 265186984
     tx_queue_7_bytes: 341106903000
     tx_queue_7_bp_napi_yield: 0
     tx_queue_7_bp_misses: 0
     tx_queue_7_bp_cleaned: 0
     tx_queue_8_packets: 623188389
     tx_queue_8_bytes: 1254437676956
     tx_queue_8_bp_napi_yield: 0
     tx_queue_8_bp_misses: 0
     tx_queue_8_bp_cleaned: 0
     tx_queue_9_packets: 499401230
     tx_queue_9_bytes: 1117979885536
     tx_queue_9_bp_napi_yield: 0
     tx_queue_9_bp_misses: 0
     tx_queue_9_bp_cleaned: 0
     tx_queue_10_packets: 547711175
     tx_queue_10_bytes: 1009925910218
     tx_queue_10_bp_napi_yield: 0
     tx_queue_10_bp_misses: 0
     tx_queue_10_bp_cleaned: 0
     tx_queue_11_packets: 468182329
     tx_queue_11_bytes: 886905604604
     tx_queue_11_bp_napi_yield: 0
     tx_queue_11_bp_misses: 0
     tx_queue_11_bp_cleaned: 0
     tx_queue_12_packets: 393899826
     tx_queue_12_bytes: 686435058292
     tx_queue_12_bp_napi_yield: 0
     tx_queue_12_bp_misses: 0
     tx_queue_12_bp_cleaned: 0
     tx_queue_13_packets: 319561410
     tx_queue_13_bytes: 525394214118
     tx_queue_13_bp_napi_yield: 0
     tx_queue_13_bp_misses: 0
     tx_queue_13_bp_cleaned: 0
     tx_queue_14_packets: 271481062
     tx_queue_14_bytes: 413149329076
     tx_queue_14_bp_napi_yield: 0
     tx_queue_14_bp_misses: 0
     tx_queue_14_bp_cleaned: 0
     tx_queue_15_packets: 236490466
     tx_queue_15_bytes: 313710749471
     tx_queue_15_bp_napi_yield: 0
     tx_queue_15_bp_misses: 0
     tx_queue_15_bp_cleaned: 0
     tx_queue_16_packets: 7620142
     tx_queue_16_bytes: 22919480909
     tx_queue_16_bp_napi_yield: 0
     tx_queue_16_bp_misses: 0
     tx_queue_16_bp_cleaned: 0
     tx_queue_17_packets: 22869256
     tx_queue_17_bytes: 43334690712
     tx_queue_17_bp_napi_yield: 0
     tx_queue_17_bp_misses: 0
     tx_queue_17_bp_cleaned: 0
     tx_queue_18_packets: 105394834
     tx_queue_18_bytes: 440639327538
     tx_queue_18_bp_napi_yield: 0
     tx_queue_18_bp_misses: 0
     tx_queue_18_bp_cleaned: 0
     tx_queue_19_packets: 74144282
     tx_queue_19_bytes: 50381057587
     tx_queue_19_bp_napi_yield: 0
     tx_queue_19_bp_misses: 0
     tx_queue_19_bp_cleaned: 0
     tx_queue_20_packets: 62746935
     tx_queue_20_bytes: 44467729522
     tx_queue_20_bp_napi_yield: 0
     tx_queue_20_bp_misses: 0
     tx_queue_20_bp_cleaned: 0
     tx_queue_21_packets: 60545326
     tx_queue_21_bytes: 46106184545
     tx_queue_21_bp_napi_yield: 0
     tx_queue_21_bp_misses: 0
     tx_queue_21_bp_cleaned: 0
     tx_queue_22_packets: 40550007
     tx_queue_22_bytes: 37159751166
     tx_queue_22_bp_napi_yield: 0
     tx_queue_22_bp_misses: 0
     tx_queue_22_bp_cleaned: 0
     tx_queue_23_packets: 39922901
     tx_queue_23_bytes: 37292345647
     tx_queue_23_bp_napi_yield: 0
     tx_queue_23_bp_misses: 0
     tx_queue_23_bp_cleaned: 0
     tx_queue_24_packets: 6394337
     tx_queue_24_bytes: 36884845135
     tx_queue_24_bp_napi_yield: 0
     tx_queue_24_bp_misses: 0
     tx_queue_24_bp_cleaned: 0
     tx_queue_25_packets: 10353134
     tx_queue_25_bytes: 23937964180
     tx_queue_25_bp_napi_yield: 0
     tx_queue_25_bp_misses: 0
     tx_queue_25_bp_cleaned: 0
     tx_queue_26_packets: 18745973
     tx_queue_26_bytes: 37976658343
     tx_queue_26_bp_napi_yield: 0
     tx_queue_26_bp_misses: 0
     tx_queue_26_bp_cleaned: 0
     tx_queue_27_packets: 25689194
     tx_queue_27_bytes: 34430359573
     tx_queue_27_bp_napi_yield: 0
     tx_queue_27_bp_misses: 0
     tx_queue_27_bp_cleaned: 0
     tx_queue_28_packets: 29143034
     tx_queue_28_bytes: 34018395350
     tx_queue_28_bp_napi_yield: 0
     tx_queue_28_bp_misses: 0
     tx_queue_28_bp_cleaned: 0
     tx_queue_29_packets: 22689409
     tx_queue_29_bytes: 20510473808
     tx_queue_29_bp_napi_yield: 0
     tx_queue_29_bp_misses: 0
     tx_queue_29_bp_cleaned: 0
     tx_queue_30_packets: 22289029
     tx_queue_30_bytes: 29163923029
     tx_queue_30_bp_napi_yield: 0
     tx_queue_30_bp_misses: 0
     tx_queue_30_bp_cleaned: 0
     tx_queue_31_packets: 22554032
     tx_queue_31_bytes: 23793064411
     tx_queue_31_bp_napi_yield: 0
     tx_queue_31_bp_misses: 0
     tx_queue_31_bp_cleaned: 0
     tx_queue_32_packets: 0
     tx_queue_32_bytes: 0
     tx_queue_32_bp_napi_yield: 0
     tx_queue_32_bp_misses: 0
     tx_queue_32_bp_cleaned: 0
     tx_queue_33_packets: 0
     tx_queue_33_bytes: 0
     tx_queue_33_bp_napi_yield: 0
     tx_queue_33_bp_misses: 0
     tx_queue_33_bp_cleaned: 0
     tx_queue_34_packets: 0
     tx_queue_34_bytes: 0
     tx_queue_34_bp_napi_yield: 0
     tx_queue_34_bp_misses: 0
     tx_queue_34_bp_cleaned: 0
     tx_queue_35_packets: 0
     tx_queue_35_bytes: 0
     tx_queue_35_bp_napi_yield: 0
     tx_queue_35_bp_misses: 0
     tx_queue_35_bp_cleaned: 0
     tx_queue_36_packets: 0
     tx_queue_36_bytes: 0
     tx_queue_36_bp_napi_yield: 0
     tx_queue_36_bp_misses: 0
     tx_queue_36_bp_cleaned: 0
     tx_queue_37_packets: 0
     tx_queue_37_bytes: 0
     tx_queue_37_bp_napi_yield: 0
     tx_queue_37_bp_misses: 0
     tx_queue_37_bp_cleaned: 0
     tx_queue_38_packets: 0
     tx_queue_38_bytes: 0
     tx_queue_38_bp_napi_yield: 0
     tx_queue_38_bp_misses: 0
     tx_queue_38_bp_cleaned: 0
     tx_queue_39_packets: 0
     tx_queue_39_bytes: 0
     tx_queue_39_bp_napi_yield: 0
     tx_queue_39_bp_misses: 0
     tx_queue_39_bp_cleaned: 0
     tx_queue_40_packets: 0
     tx_queue_40_bytes: 0
     tx_queue_40_bp_napi_yield: 0
     tx_queue_40_bp_misses: 0
     tx_queue_40_bp_cleaned: 0
     tx_queue_41_packets: 0
     tx_queue_41_bytes: 0
     tx_queue_41_bp_napi_yield: 0
     tx_queue_41_bp_misses: 0
     tx_queue_41_bp_cleaned: 0
     tx_queue_42_packets: 0
     tx_queue_42_bytes: 0
     tx_queue_42_bp_napi_yield: 0
     tx_queue_42_bp_misses: 0
     tx_queue_42_bp_cleaned: 0
     tx_queue_43_packets: 0
     tx_queue_43_bytes: 0
     tx_queue_43_bp_napi_yield: 0
     tx_queue_43_bp_misses: 0
     tx_queue_43_bp_cleaned: 0
     tx_queue_44_packets: 0
     tx_queue_44_bytes: 0
     tx_queue_44_bp_napi_yield: 0
     tx_queue_44_bp_misses: 0
     tx_queue_44_bp_cleaned: 0
     tx_queue_45_packets: 0
     tx_queue_45_bytes: 0
     tx_queue_45_bp_napi_yield: 0
     tx_queue_45_bp_misses: 0
     tx_queue_45_bp_cleaned: 0
     tx_queue_46_packets: 0
     tx_queue_46_bytes: 0
     tx_queue_46_bp_napi_yield: 0
     tx_queue_46_bp_misses: 0
     tx_queue_46_bp_cleaned: 0
     tx_queue_47_packets: 0
     tx_queue_47_bytes: 0
     tx_queue_47_bp_napi_yield: 0
     tx_queue_47_bp_misses: 0
     tx_queue_47_bp_cleaned: 0
     tx_queue_48_packets: 0
     tx_queue_48_bytes: 0
     tx_queue_48_bp_napi_yield: 0
     tx_queue_48_bp_misses: 0
     tx_queue_48_bp_cleaned: 0
     tx_queue_49_packets: 0
     tx_queue_49_bytes: 0
     tx_queue_49_bp_napi_yield: 0
     tx_queue_49_bp_misses: 0
     tx_queue_49_bp_cleaned: 0
     tx_queue_50_packets: 0
     tx_queue_50_bytes: 0
     tx_queue_50_bp_napi_yield: 0
     tx_queue_50_bp_misses: 0
     tx_queue_50_bp_cleaned: 0
     tx_queue_51_packets: 0
     tx_queue_51_bytes: 0
     tx_queue_51_bp_napi_yield: 0
     tx_queue_51_bp_misses: 0
     tx_queue_51_bp_cleaned: 0
     tx_queue_52_packets: 0
     tx_queue_52_bytes: 0
     tx_queue_52_bp_napi_yield: 0
     tx_queue_52_bp_misses: 0
     tx_queue_52_bp_cleaned: 0
     tx_queue_53_packets: 0
     tx_queue_53_bytes: 0
     tx_queue_53_bp_napi_yield: 0
     tx_queue_53_bp_misses: 0
     tx_queue_53_bp_cleaned: 0
     tx_queue_54_packets: 0
     tx_queue_54_bytes: 0
     tx_queue_54_bp_napi_yield: 0
     tx_queue_54_bp_misses: 0
     tx_queue_54_bp_cleaned: 0
     tx_queue_55_packets: 0
     tx_queue_55_bytes: 0
     tx_queue_55_bp_napi_yield: 0
     tx_queue_55_bp_misses: 0
     tx_queue_55_bp_cleaned: 0
     tx_queue_56_packets: 0
     tx_queue_56_bytes: 0
     tx_queue_56_bp_napi_yield: 0
     tx_queue_56_bp_misses: 0
     tx_queue_56_bp_cleaned: 0
     tx_queue_57_packets: 0
     tx_queue_57_bytes: 0
     tx_queue_57_bp_napi_yield: 0
     tx_queue_57_bp_misses: 0
     tx_queue_57_bp_cleaned: 0
     tx_queue_58_packets: 0
     tx_queue_58_bytes: 0
     tx_queue_58_bp_napi_yield: 0
     tx_queue_58_bp_misses: 0
     tx_queue_58_bp_cleaned: 0
     tx_queue_59_packets: 0
     tx_queue_59_bytes: 0
     tx_queue_59_bp_napi_yield: 0
     tx_queue_59_bp_misses: 0
     tx_queue_59_bp_cleaned: 0
     tx_queue_60_packets: 0
     tx_queue_60_bytes: 0
     tx_queue_60_bp_napi_yield: 0
     tx_queue_60_bp_misses: 0
     tx_queue_60_bp_cleaned: 0
     tx_queue_61_packets: 0
     tx_queue_61_bytes: 0
     tx_queue_61_bp_napi_yield: 0
     tx_queue_61_bp_misses: 0
     tx_queue_61_bp_cleaned: 0
     tx_queue_62_packets: 0
     tx_queue_62_bytes: 0
     tx_queue_62_bp_napi_yield: 0
     tx_queue_62_bp_misses: 0
     tx_queue_62_bp_cleaned: 0
     tx_queue_63_packets: 0
     tx_queue_63_bytes: 0
     tx_queue_63_bp_napi_yield: 0
     tx_queue_63_bp_misses: 0
     tx_queue_63_bp_cleaned: 0
     tx_queue_64_packets: 0
     tx_queue_64_bytes: 0
     tx_queue_64_bp_napi_yield: 0
     tx_queue_64_bp_misses: 0
     tx_queue_64_bp_cleaned: 0
     tx_queue_65_packets: 0
     tx_queue_65_bytes: 0
     tx_queue_65_bp_napi_yield: 0
     tx_queue_65_bp_misses: 0
     tx_queue_65_bp_cleaned: 0
     tx_queue_66_packets: 0
     tx_queue_66_bytes: 0
     tx_queue_66_bp_napi_yield: 0
     tx_queue_66_bp_misses: 0
     tx_queue_66_bp_cleaned: 0
     tx_queue_67_packets: 0
     tx_queue_67_bytes: 0
     tx_queue_67_bp_napi_yield: 0
     tx_queue_67_bp_misses: 0
     tx_queue_67_bp_cleaned: 0
     tx_queue_68_packets: 0
     tx_queue_68_bytes: 0
     tx_queue_68_bp_napi_yield: 0
     tx_queue_68_bp_misses: 0
     tx_queue_68_bp_cleaned: 0
     tx_queue_69_packets: 0
     tx_queue_69_bytes: 0
     tx_queue_69_bp_napi_yield: 0
     tx_queue_69_bp_misses: 0
     tx_queue_69_bp_cleaned: 0
     tx_queue_70_packets: 0
     tx_queue_70_bytes: 0
     tx_queue_70_bp_napi_yield: 0
     tx_queue_70_bp_misses: 0
     tx_queue_70_bp_cleaned: 0
     rx_queue_0_packets: 5528908454
     rx_queue_0_bytes: 2897584793632
     rx_queue_0_bp_poll_yield: 0
     rx_queue_0_bp_misses: 0
     rx_queue_0_bp_cleaned: 0
     rx_queue_1_packets: 482922160
     rx_queue_1_bytes: 505371226131
     rx_queue_1_bp_poll_yield: 0
     rx_queue_1_bp_misses: 0
     rx_queue_1_bp_cleaned: 0
     rx_queue_2_packets: 505040266
     rx_queue_2_bytes: 486419018123
     rx_queue_2_bp_poll_yield: 0
     rx_queue_2_bp_misses: 0
     rx_queue_2_bp_cleaned: 0
     rx_queue_3_packets: 555089882
     rx_queue_3_bytes: 479476828776
     rx_queue_3_bp_poll_yield: 0
     rx_queue_3_bp_misses: 0
     rx_queue_3_bp_cleaned: 0
     rx_queue_4_packets: 512078299
     rx_queue_4_bytes: 457135661017
     rx_queue_4_bp_poll_yield: 0
     rx_queue_4_bp_misses: 0
     rx_queue_4_bp_cleaned: 0
     rx_queue_5_packets: 473925983
     rx_queue_5_bytes: 444234985992
     rx_queue_5_bp_poll_yield: 0
     rx_queue_5_bp_misses: 0
     rx_queue_5_bp_cleaned: 0
     rx_queue_6_packets: 433550777
     rx_queue_6_bytes: 426826095769
     rx_queue_6_bp_poll_yield: 0
     rx_queue_6_bp_misses: 0
     rx_queue_6_bp_cleaned: 0
     rx_queue_7_packets: 781782220
     rx_queue_7_bytes: 481187330032
     rx_queue_7_bp_poll_yield: 0
     rx_queue_7_bp_misses: 0
     rx_queue_7_bp_cleaned: 0
     rx_queue_8_packets: 920217641
     rx_queue_8_bytes: 831137552130
     rx_queue_8_bp_poll_yield: 0
     rx_queue_8_bp_misses: 0
     rx_queue_8_bp_cleaned: 0
     rx_queue_9_packets: 920886482
     rx_queue_9_bytes: 577026038180
     rx_queue_9_bp_poll_yield: 0
     rx_queue_9_bp_misses: 0
     rx_queue_9_bp_cleaned: 0
     rx_queue_10_packets: 686280399
     rx_queue_10_bytes: 506871356028
     rx_queue_10_bp_poll_yield: 0
     rx_queue_10_bp_misses: 0
     rx_queue_10_bp_cleaned: 0
     rx_queue_11_packets: 666930265
     rx_queue_11_bytes: 496161170699
     rx_queue_11_bp_poll_yield: 0
     rx_queue_11_bp_misses: 0
     rx_queue_11_bp_cleaned: 0
     rx_queue_12_packets: 556873212
     rx_queue_12_bytes: 435761751718
     rx_queue_12_bp_poll_yield: 0
     rx_queue_12_bp_misses: 0
     rx_queue_12_bp_cleaned: 0
     rx_queue_13_packets: 530527224
     rx_queue_13_bytes: 399505783904
     rx_queue_13_bp_poll_yield: 0
     rx_queue_13_bp_misses: 0
     rx_queue_13_bp_cleaned: 0
     rx_queue_14_packets: 1531496647
     rx_queue_14_bytes: 524999100679
     rx_queue_14_bp_poll_yield: 0
     rx_queue_14_bp_misses: 0
     rx_queue_14_bp_cleaned: 0
     rx_queue_15_packets: 2121143691
     rx_queue_15_bytes: 3255460112590
     rx_queue_15_bp_poll_yield: 0
     rx_queue_15_bp_misses: 0
     rx_queue_15_bp_cleaned: 0
     rx_queue_16_packets: 5363100
     rx_queue_16_bytes: 5287370079
     rx_queue_16_bp_poll_yield: 0
     rx_queue_16_bp_misses: 0
     rx_queue_16_bp_cleaned: 0
     rx_queue_17_packets: 6534625
     rx_queue_17_bytes: 6170656283
     rx_queue_17_bp_poll_yield: 0
     rx_queue_17_bp_misses: 0
     rx_queue_17_bp_cleaned: 0
     rx_queue_18_packets: 29769631
     rx_queue_18_bytes: 11619222818
     rx_queue_18_bp_poll_yield: 0
     rx_queue_18_bp_misses: 0
     rx_queue_18_bp_cleaned: 0
     rx_queue_19_packets: 7028995
     rx_queue_19_bytes: 6443569009
     rx_queue_19_bp_poll_yield: 0
     rx_queue_19_bp_misses: 0
     rx_queue_19_bp_cleaned: 0
     rx_queue_20_packets: 6677929
     rx_queue_20_bytes: 6277847694
     rx_queue_20_bp_poll_yield: 0
     rx_queue_20_bp_misses: 0
     rx_queue_20_bp_cleaned: 0
     rx_queue_21_packets: 6663138
     rx_queue_21_bytes: 6208713822
     rx_queue_21_bp_poll_yield: 0
     rx_queue_21_bp_misses: 0
     rx_queue_21_bp_cleaned: 0
     rx_queue_22_packets: 6293841
     rx_queue_22_bytes: 6159692401
     rx_queue_22_bp_poll_yield: 0
     rx_queue_22_bp_misses: 0
     rx_queue_22_bp_cleaned: 0
     rx_queue_23_packets: 5802144
     rx_queue_23_bytes: 5711336529
     rx_queue_23_bp_poll_yield: 0
     rx_queue_23_bp_misses: 0
     rx_queue_23_bp_cleaned: 0
     rx_queue_24_packets: 3741983
     rx_queue_24_bytes: 2372074246
     rx_queue_24_bp_poll_yield: 0
     rx_queue_24_bp_misses: 0
     rx_queue_24_bp_cleaned: 0
     rx_queue_25_packets: 2901456
     rx_queue_25_bytes: 2132376448
     rx_queue_25_bp_poll_yield: 0
     rx_queue_25_bp_misses: 0
     rx_queue_25_bp_cleaned: 0
     rx_queue_26_packets: 3559983
     rx_queue_26_bytes: 2140874708
     rx_queue_26_bp_poll_yield: 0
     rx_queue_26_bp_misses: 0
     rx_queue_26_bp_cleaned: 0
     rx_queue_27_packets: 3119895
     rx_queue_27_bytes: 1971930900
     rx_queue_27_bp_poll_yield: 0
     rx_queue_27_bp_misses: 0
     rx_queue_27_bp_cleaned: 0
     rx_queue_28_packets: 2955190
     rx_queue_28_bytes: 1851155080
     rx_queue_28_bp_poll_yield: 0
     rx_queue_28_bp_misses: 0
     rx_queue_28_bp_cleaned: 0
     rx_queue_29_packets: 2176703
     rx_queue_29_bytes: 1530015383
     rx_queue_29_bp_poll_yield: 0
     rx_queue_29_bp_misses: 0
     rx_queue_29_bp_cleaned: 0
     rx_queue_30_packets: 2674744
     rx_queue_30_bytes: 1660169727
     rx_queue_30_bp_poll_yield: 0
     rx_queue_30_bp_misses: 0
     rx_queue_30_bp_cleaned: 0
     rx_queue_31_packets: 2567409
     rx_queue_31_bytes: 1702297493
     rx_queue_31_bp_poll_yield: 0
     rx_queue_31_bp_misses: 0
     rx_queue_31_bp_cleaned: 0
     rx_queue_32_packets: 0
     rx_queue_32_bytes: 0
     rx_queue_32_bp_poll_yield: 0
     rx_queue_32_bp_misses: 0
     rx_queue_32_bp_cleaned: 0
     rx_queue_33_packets: 0
     rx_queue_33_bytes: 0
     rx_queue_33_bp_poll_yield: 0
     rx_queue_33_bp_misses: 0
     rx_queue_33_bp_cleaned: 0
     rx_queue_34_packets: 0
     rx_queue_34_bytes: 0
     rx_queue_34_bp_poll_yield: 0
     rx_queue_34_bp_misses: 0
     rx_queue_34_bp_cleaned: 0
     rx_queue_35_packets: 0
     rx_queue_35_bytes: 0
     rx_queue_35_bp_poll_yield: 0
     rx_queue_35_bp_misses: 0
     rx_queue_35_bp_cleaned: 0
     rx_queue_36_packets: 0
     rx_queue_36_bytes: 0
     rx_queue_36_bp_poll_yield: 0
     rx_queue_36_bp_misses: 0
     rx_queue_36_bp_cleaned: 0
     rx_queue_37_packets: 0
     rx_queue_37_bytes: 0
     rx_queue_37_bp_poll_yield: 0
     rx_queue_37_bp_misses: 0
     rx_queue_37_bp_cleaned: 0
     rx_queue_38_packets: 0
     rx_queue_38_bytes: 0
     rx_queue_38_bp_poll_yield: 0
     rx_queue_38_bp_misses: 0
     rx_queue_38_bp_cleaned: 0
     rx_queue_39_packets: 0
     rx_queue_39_bytes: 0
     rx_queue_39_bp_poll_yield: 0
     rx_queue_39_bp_misses: 0
     rx_queue_39_bp_cleaned: 0
     rx_queue_40_packets: 0
     rx_queue_40_bytes: 0
     rx_queue_40_bp_poll_yield: 0
     rx_queue_40_bp_misses: 0
     rx_queue_40_bp_cleaned: 0
     rx_queue_41_packets: 0
     rx_queue_41_bytes: 0
     rx_queue_41_bp_poll_yield: 0
     rx_queue_41_bp_misses: 0
     rx_queue_41_bp_cleaned: 0
     rx_queue_42_packets: 0
     rx_queue_42_bytes: 0
     rx_queue_42_bp_poll_yield: 0
     rx_queue_42_bp_misses: 0
     rx_queue_42_bp_cleaned: 0
     rx_queue_43_packets: 0
     rx_queue_43_bytes: 0
     rx_queue_43_bp_poll_yield: 0
     rx_queue_43_bp_misses: 0
     rx_queue_43_bp_cleaned: 0
     rx_queue_44_packets: 0
     rx_queue_44_bytes: 0
     rx_queue_44_bp_poll_yield: 0
     rx_queue_44_bp_misses: 0
     rx_queue_44_bp_cleaned: 0
     rx_queue_45_packets: 0
     rx_queue_45_bytes: 0
     rx_queue_45_bp_poll_yield: 0
     rx_queue_45_bp_misses: 0
     rx_queue_45_bp_cleaned: 0
     rx_queue_46_packets: 0
     rx_queue_46_bytes: 0
     rx_queue_46_bp_poll_yield: 0
     rx_queue_46_bp_misses: 0
     rx_queue_46_bp_cleaned: 0
     rx_queue_47_packets: 0
     rx_queue_47_bytes: 0
     rx_queue_47_bp_poll_yield: 0
     rx_queue_47_bp_misses: 0
     rx_queue_47_bp_cleaned: 0
     rx_queue_48_packets: 0
     rx_queue_48_bytes: 0
     rx_queue_48_bp_poll_yield: 0
     rx_queue_48_bp_misses: 0
     rx_queue_48_bp_cleaned: 0
     rx_queue_49_packets: 0
     rx_queue_49_bytes: 0
     rx_queue_49_bp_poll_yield: 0
     rx_queue_49_bp_misses: 0
     rx_queue_49_bp_cleaned: 0
     rx_queue_50_packets: 0
     rx_queue_50_bytes: 0
     rx_queue_50_bp_poll_yield: 0
     rx_queue_50_bp_misses: 0
     rx_queue_50_bp_cleaned: 0
     rx_queue_51_packets: 0
     rx_queue_51_bytes: 0
     rx_queue_51_bp_poll_yield: 0
     rx_queue_51_bp_misses: 0
     rx_queue_51_bp_cleaned: 0
     rx_queue_52_packets: 0
     rx_queue_52_bytes: 0
     rx_queue_52_bp_poll_yield: 0
     rx_queue_52_bp_misses: 0
     rx_queue_52_bp_cleaned: 0
     rx_queue_53_packets: 0
     rx_queue_53_bytes: 0
     rx_queue_53_bp_poll_yield: 0
     rx_queue_53_bp_misses: 0
     rx_queue_53_bp_cleaned: 0
     rx_queue_54_packets: 0
     rx_queue_54_bytes: 0
     rx_queue_54_bp_poll_yield: 0
     rx_queue_54_bp_misses: 0
     rx_queue_54_bp_cleaned: 0
     rx_queue_55_packets: 0
     rx_queue_55_bytes: 0
     rx_queue_55_bp_poll_yield: 0
     rx_queue_55_bp_misses: 0
     rx_queue_55_bp_cleaned: 0
     rx_queue_56_packets: 0
     rx_queue_56_bytes: 0
     rx_queue_56_bp_poll_yield: 0
     rx_queue_56_bp_misses: 0
     rx_queue_56_bp_cleaned: 0
     rx_queue_57_packets: 0
     rx_queue_57_bytes: 0
     rx_queue_57_bp_poll_yield: 0
     rx_queue_57_bp_misses: 0
     rx_queue_57_bp_cleaned: 0
     rx_queue_58_packets: 0
     rx_queue_58_bytes: 0
     rx_queue_58_bp_poll_yield: 0
     rx_queue_58_bp_misses: 0
     rx_queue_58_bp_cleaned: 0
     rx_queue_59_packets: 0
     rx_queue_59_bytes: 0
     rx_queue_59_bp_poll_yield: 0
     rx_queue_59_bp_misses: 0
     rx_queue_59_bp_cleaned: 0
     rx_queue_60_packets: 0
     rx_queue_60_bytes: 0
     rx_queue_60_bp_poll_yield: 0
     rx_queue_60_bp_misses: 0
     rx_queue_60_bp_cleaned: 0
     rx_queue_61_packets: 0
     rx_queue_61_bytes: 0
     rx_queue_61_bp_poll_yield: 0
     rx_queue_61_bp_misses: 0
     rx_queue_61_bp_cleaned: 0
     rx_queue_62_packets: 0
     rx_queue_62_bytes: 0
     rx_queue_62_bp_poll_yield: 0
     rx_queue_62_bp_misses: 0
     rx_queue_62_bp_cleaned: 0
     rx_queue_63_packets: 0
     rx_queue_63_bytes: 0
     rx_queue_63_bp_poll_yield: 0
     rx_queue_63_bp_misses: 0
     rx_queue_63_bp_cleaned: 0
     rx_queue_64_packets: 0
     rx_queue_64_bytes: 0
     rx_queue_64_bp_poll_yield: 0
     rx_queue_64_bp_misses: 0
     rx_queue_64_bp_cleaned: 0
     rx_queue_65_packets: 0
     rx_queue_65_bytes: 0
     rx_queue_65_bp_poll_yield: 0
     rx_queue_65_bp_misses: 0
     rx_queue_65_bp_cleaned: 0
     rx_queue_66_packets: 0
     rx_queue_66_bytes: 0
     rx_queue_66_bp_poll_yield: 0
     rx_queue_66_bp_misses: 0
     rx_queue_66_bp_cleaned: 0
     rx_queue_67_packets: 0
     rx_queue_67_bytes: 0
     rx_queue_67_bp_poll_yield: 0
     rx_queue_67_bp_misses: 0
     rx_queue_67_bp_cleaned: 0
     rx_queue_68_packets: 0
     rx_queue_68_bytes: 0
     rx_queue_68_bp_poll_yield: 0
     rx_queue_68_bp_misses: 0
     rx_queue_68_bp_cleaned: 0
     rx_queue_69_packets: 0
     rx_queue_69_bytes: 0
     rx_queue_69_bp_poll_yield: 0
     rx_queue_69_bp_misses: 0
     rx_queue_69_bp_cleaned: 0
     rx_queue_70_packets: 0
     rx_queue_70_bytes: 0
     rx_queue_70_bp_poll_yield: 0
     rx_queue_70_bp_misses: 0
     rx_queue_70_bp_cleaned: 0
     tx_pb_0_pxon: 0
     tx_pb_0_pxoff: 0
     tx_pb_1_pxon: 0
     tx_pb_1_pxoff: 0
     tx_pb_2_pxon: 0
     tx_pb_2_pxoff: 0
     tx_pb_3_pxon: 0
     tx_pb_3_pxoff: 0
     tx_pb_4_pxon: 0
     tx_pb_4_pxoff: 0
     tx_pb_5_pxon: 0
     tx_pb_5_pxoff: 0
     tx_pb_6_pxon: 0
     tx_pb_6_pxoff: 0
     tx_pb_7_pxon: 0
     tx_pb_7_pxoff: 0
     rx_pb_0_pxon: 0
     rx_pb_0_pxoff: 0
     rx_pb_1_pxon: 0
     rx_pb_1_pxoff: 0
     rx_pb_2_pxon: 0
     rx_pb_2_pxoff: 0
     rx_pb_3_pxon: 0
     rx_pb_3_pxoff: 0
     rx_pb_4_pxon: 0
     rx_pb_4_pxoff: 0
     rx_pb_5_pxon: 0
     rx_pb_5_pxoff: 0
     rx_pb_6_pxon: 0
     rx_pb_6_pxoff: 0
     rx_pb_7_pxon: 0
     rx_pb_7_pxoff: 0
root@pve1:~# ethtool -m eth2
        Identifier                                : 0x03 (SFP)
        Extended identifier                       : 0x04 (GBIC/SFP defined by 2-wire interface ID)
        Connector                                 : 0x07 (LC)
        Transceiver codes                         : 0x10 0x00 0x00 0x00 0x00 0x00 0x00 0x00
        Transceiver type                          : 10G Ethernet: 10G Base-SR
        Encoding                                  : 0x06 (64B/66B)
        BR, Nominal                               : 10300MBd
        Rate identifier                           : 0x00 (unspecified)
        Length (SMF,km)                           : 0km
        Length (SMF)                              : 0m
        Length (50um)                             : 80m
        Length (62.5um)                           : 20m
        Length (Copper)                           : 0m
        Length (OM3)                              : 300m
        Laser wavelength                          : 850nm
        Vendor name                               : OEM             
        Vendor OUI                                : 00:00:00
        Vendor PN                                 : SFP+ SR         
        Vendor rev                                : A   
        Optical diagnostics support               : Yes
        Laser bias current                        : 24.984 mA
        Laser output power                        : 0.5650 mW / -2.48 dBm
        Receiver signal average optical power     : 0.4670 mW / -3.31 dBm
        Module temperature                        : 48.80 degrees C / 119.83 degrees F
        Module voltage                            : 3.2669 V
        Alarm/warning flags implemented           : Yes
        Laser bias current high alarm             : Off
        Laser bias current low alarm              : Off
        Laser bias current high warning           : Off
        Laser bias current low warning            : Off
        Laser output power high alarm             : Off
        Laser output power low alarm              : Off
        Laser output power high warning           : Off
        Laser output power low warning            : Off
        Module temperature high alarm             : Off
        Module temperature low alarm              : Off
        Module temperature high warning           : Off
        Module temperature low warning            : Off
        Module voltage high alarm                 : Off
        Module voltage low alarm                  : Off
        Module voltage high warning               : Off
        Module voltage low warning                : Off
        Laser rx power high alarm                 : Off
        Laser rx power low alarm                  : Off
        Laser rx power high warning               : Off
        Laser rx power low warning                : Off
        Laser bias current high alarm threshold   : 50.000 mA
        Laser bias current low alarm threshold    : 1.000 mA
        Laser bias current high warning threshold : 40.000 mA
        Laser bias current low warning threshold  : 2.000 mA
        Laser output power high alarm threshold   : 1.2589 mW / 1.00 dBm
        Laser output power low alarm threshold    : 0.1175 mW / -9.30 dBm
        Laser output power high warning threshold : 1.0000 mW / 0.00 dBm
        Laser output power low warning threshold  : 0.1479 mW / -8.30 dBm
        Module temperature high alarm threshold   : 90.00 degrees C / 194.00 degrees F
        Module temperature low alarm threshold    : -10.00 degrees C / 14.00 degrees F
        Module temperature high warning threshold : 85.00 degrees C / 185.00 degrees F
        Module temperature low warning threshold  : -5.00 degrees C / 23.00 degrees F
        Module voltage high alarm threshold       : 3.6000 V
        Module voltage low alarm threshold        : 3.0000 V
        Module voltage high warning threshold     : 3.5000 V
        Module voltage low warning threshold      : 3.0500 V
        Laser rx power high alarm threshold       : 1.2589 mW / 1.00 dBm
        Laser rx power low alarm threshold        : 0.0490 mW / -13.10 dBm
        Laser rx power high warning threshold     : 1.0000 mW / 0.00 dBm
        Laser rx power low warning threshold      : 0.0617 mW / -12.10 dBm

[mystical]

Ако имаш познати техници в някой интернет доставчик, помоли ги да ти замерят влакната с power meter. Първо се мери, ако има проблеми се чисти и после пак се мери. Процедурата се повтаря и от двата края. Когато влакното се включва в SFP модула, трябва да се внимава върха да не опре никъде, иначе множе да се зацапа и започват проблемите.

В наще среди не съм чувал, някой да използва mikrotik като суич. Вече има втора ръка Cisco на достъпна цена с 10Gb модули.

[BRADATA]

Точно за това искам тази информация от отгоре - без да се викат техници да се проверят нещата. Това са важните параматри:

Код:

        Optical diagnostics support               : Yes
        Laser bias current                        : 24.984 mA
        Laser output power                        : 0.5650 mW / -2.48 dBm
        Receiver signal average optical power     : 0.4670 mW / -3.31 dBm
        Module temperature                        : 48.80 degrees C / 119.83 degrees F
        Module voltage                            : 3.2669 V

Същата информация е достъпна и от микротика. Като се покажат и двете тук ще се види дали има оптичен проблем.

[Ipolit]

Благодаря за отговорите.
Точно това не ми го дава

Код:

ethtool -m eth2
ethtool: bad command line argument(s)
For more information run ethtool -h

Иначе разликите с твоята карта са

BRADATA - Advertised pause frame use: Symmetric
AZ - Advertised pause frame use: No

Код:

ethtool -a eth2
Pause parameters for eth2:
Autonegotiate: off
RX: off
TX: on

Спрял съм flow контрола, че микротика даваше грешки.
Но понеже проблемът се проявява десетина пъти на ден, предполагам, че става дума за някаква хардуерна глупост. Освен това се случва и в извънработно време, когато компютрите са изключени, така че не е от претоварване.

[Naka]

Пробвай с друга лан карта. Щом във форума на интел казват, че проблема се дължал на 'лош' reference clocк и проблема се оправил след смяна на clock device-a (некакво чипче) покрай 82599EN значи проблема много вероятно да е точно това.

Then, I measured a reference clock and found the cause for this issue....... So I replaced clock device near a 82599EN .... And I confirmed that the link up status is kept on 10Gbps.

Такива проблеми от вида ту го има, ту го няма и то от време на време... са много гадни щото много трудно се хващат. Нещо работи на границата на спецификацията. От друга страна ако има такъв 'рядък' проблем проиводителя на хардуера, колкото и да е марков, никога няма да си признае....Ще разправят за несъвместимости и т.н.

Тъй че ако можеш пробвай с друг хардуер.

[BRADATA]

Благодаря за отговорите.
Точно това не ми го дава

Код:

ethtool -m eth2
ethtool: bad command line argument(s)
For more information run ethtool -h

Иначе разликите с твоята карта са

BRADATA - Advertised pause frame use: Symmetric
AZ - Advertised pause frame use: No

Код:

ethtool -a eth2
Pause parameters for eth2:
Autonegotiate:   off
RX:      off
TX:      on

Спрял съм flow контрола, че микротика даваше грешки.
Но понеже проблемът се проявява десетина пъти на ден, предполагам, че става дума за някаква хардуерна глупост. Освен това се случва и в извънработно време, когато компютрите са изключени, така че не е от претоварване.

Аз имах доста проблеми с микротишките CCR неща докато не си купих микротишки SFP-та. В интерес на истината не съм тествал SFP+ връзки, но факта, че са капризни на гигабитови SFP-та е показателен. Дори оригинални CISCO SFP-та водят до забивания и рестарти.
Имай го предвид.
Пробвай също така да видиш DDM информацията на SFP-то под линукс. Важно е. А ако няма такава функционалност - по-добре го смени. Аз ползвам HiTech от КСТ.
edit:
03:00.0 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)
03:00.1 Ethernet controller: Intel Corporation 82599ES 10-Gigabit SFI/SFP+ Network Connection (rev 01)