Testing LSI based SAS expanders in supermicro cases with 48 1.5 TB seagates in raid60 is giving me:

Reads:

Code:
livecd ~ # nice -n -20 dd iflag=direct bs=1M count=50000 if=/dev/sda of=/dev/null
50000+0 records in
50000+0 records out
52428800000 bytes (52 GB) copied, 38.2311 s, 1.4 GB/s
Writes:
Code:
livecd ~ # nice -n -20 dd oflag=direct bs=1M count=50000 if=/dev/zero of=/dev/sda
50000+0 records in
50000+0 records out
52428800000 bytes (52 GB) copied, 63.796 s, 822 MB/s
Also I verify the standard areca BBU works fine with it:
Code:
livecd ~ # ./cli64 hw info
The Hardware Monitor Information
=====================================================
[Controller H/W Monitor]
  CPU Temperature  : 50 C
  Controller Temp. : 46 C
  12V              : 12.160 V
  5V               : 5.160 V
  3.3V             : 3.408 V
  DDR-II +1.8V     : 1.872 V
  CPU    +1.8V     : 1.872 V
  CPU    +1.2V     : 1.280 V
  CPU    +1.0V     : 1.072 V
  DDR-II +0.9V     : 0.928 V
  Battery Status   : 100%
[Enclosure#1 : ARECA   SAS RAID AdapterV1.0]
[Enclosure#2 : LSILOGICSASX36 A.1      7015]
  Fan 00           : 0 RPM
  Fan 01           : 0 RPM
  Fan 02           : 0 RPM
  Enclosure Temp   : 35 C
[Enclosure#3 : LSILOGICSASX36 A.1      7015]
  Fan 00           : 5550 RPM
  Fan 01           : 5280 RPM
  Fan 02           : 5550 RPM
  Enclosure Temp   : 32 C
=====================================================
GuiErrMsg<0x00>: Success.
livecd ~ # ./cli64 vsf info
  # Name             Raid Name       Level   Capacity Ch/Id/Lun  State
===============================================================================
  1 ARC-1880-VOL#000                 Raid60    80.0GB 00/00/00   Normal
  2 ARC-1880-VOL#003                 Raid60  65920.0GB 00/00/01   Normal
  3 VOL#000R60Vol2-1 Raid Set # 000  Raid6     40.0GB 00/00/00   Normal
  4 VOL#000R60Vol2-2 Raid Set # 001  Raid6     40.0GB 00/00/00   Normal
  5 VOL#003R60Vol2-1 Raid Set # 000  Raid6   32960.0GB 00/00/01   Normal
  6 VOL#003R60Vol2-2 Raid Set # 001  Raid6   32960.0GB 00/00/01   Normal
===============================================================================
GuiErrMsg<0x00>: Success.
livecd ~ # ./cli64 disk info
  # Enc# Slot#   ModelName                        Capacity  Usage
===============================================================================
  1  01  Slot#1  N.A.                                0.0GB  N.A.
  2  01  Slot#2  N.A.                                0.0GB  N.A.
  3  01  Slot#3  N.A.                                0.0GB  N.A.
  4  01  Slot#4  N.A.                                0.0GB  N.A.
  5  01  Slot#5  N.A.                                0.0GB  N.A.
  6  01  Slot#6  N.A.                                0.0GB  N.A.
  7  01  Slot#7  N.A.                                0.0GB  N.A.
  8  01  Slot#8  N.A.                                0.0GB  N.A.
  9  02  000     ST31500341AS                     1500.3GB  Raid Set # 000
 10  02  001     ST31500341AS                     1500.3GB  Raid Set # 000
 11  02  002     ST31500341AS                     1500.3GB  Raid Set # 000
 12  02  003     ST31500341AS                     1500.3GB  Raid Set # 000
 13  02  004     ST31500341AS                     1500.3GB  Raid Set # 000
 14  02  005     ST31500341AS                     1500.3GB  Raid Set # 000
 15  02  006     ST31500341AS                     1500.3GB  Raid Set # 000
 16  02  007     ST31500341AS                     1500.3GB  Raid Set # 000
 17  02  008     ST31500341AS                     1500.3GB  Raid Set # 000
 18  02  009     ST31500341AS                     1500.3GB  Raid Set # 000
 19  02  010     ST31500341AS                     1500.3GB  Raid Set # 000
 20  02  011     ST31500341AS                     1500.3GB  Raid Set # 000
 21  02  012     ST31500341AS                     1500.3GB  Raid Set # 000
 22  02  013     ST31500341AS                     1500.3GB  Raid Set # 000
 23  02  014     ST31500341AS                     1500.3GB  Raid Set # 000
 24  02  015     ST31500341AS                     1500.3GB  Raid Set # 000
 25  02  016     ST31500341AS                     1500.3GB  Raid Set # 000
 26  02  017     ST31500341AS                     1500.3GB  Raid Set # 000
 27  02  018     ST31500341AS                     1500.3GB  Raid Set # 000
 28  02  019     ST31500341AS                     1500.3GB  Raid Set # 000
 29  02  020     ST31500341AS                     1500.3GB  Raid Set # 000
 30  02  021     ST31500341AS                     1500.3GB  Raid Set # 000
 31  02  022     ST31500341AS                     1500.3GB  Raid Set # 000
 32  02  023     ST31500341AS                     1500.3GB  Raid Set # 000
 33  03  000     ST31500341AS                     1500.3GB  Raid Set # 001
 34  03  001     ST31500341AS                     1500.3GB  Raid Set # 001
 35  03  002     ST31500341AS                     1500.3GB  Raid Set # 001
 36  03  003     ST31500341AS                     1500.3GB  Raid Set # 001
 37  03  004     ST31500341AS                     1500.3GB  Raid Set # 001
 38  03  005     ST31500341AS                     1500.3GB  Raid Set # 001
 39  03  006     ST31500341AS                     1500.3GB  Raid Set # 001
 40  03  007     ST31500341AS                     1500.3GB  Raid Set # 001
 41  03  008     ST31500341AS                     1500.3GB  Raid Set # 001
 42  03  009     ST31500341AS                     1500.3GB  Raid Set # 001
 43  03  010     ST31500341AS                     1500.3GB  Raid Set # 001
 44  03  011     ST31500341AS                     1500.3GB  Raid Set # 001
 45  03  012     ST31500341AS                     1500.3GB  Raid Set # 001
 46  03  013     ST31500341AS                     1500.3GB  Raid Set # 001
 47  03  014     ST31500341AS                     1500.3GB  Raid Set # 001
 48  03  015     ST31500341AS                     1500.3GB  Raid Set # 001
 49  03  016     ST31500341AS                     1500.3GB  Raid Set # 001
 50  03  017     ST31500341AS                     1500.3GB  Raid Set # 001
 51  03  018     ST31500341AS                     1500.3GB  Raid Set # 001
 52  03  019     ST31500341AS                     1500.3GB  Raid Set # 001
 53  03  020     ST31500341AS                     1500.3GB  Raid Set # 001
 54  03  021     ST31500341AS                     1500.3GB  Raid Set # 001
 55  03  022     ST31500341AS                     1500.3GB  Raid Set # 001
 56  03  023     ST31500341AS                     1500.3GB  Raid Set # 001
===============================================================================
GuiErrMsg<0x00>: Success.
Not really liking the timeout errors I am seeing while stress testing though... init completed ok:

Code:
livecd ~ # ./cli64 event info
Date-Time            Device           Event Type            Elapsed Time Errors
===============================================================================
2010-10-10 12:07:17  Enc#2 017        Time Out Error
2010-10-10 12:00:47  Enc#2 SES2Device Time Out Error
2010-10-10 11:53:44  Enc#3 020        Time Out Error
2010-10-10 11:53:32  Enc#3 001        Time Out Error
2010-10-10 11:53:19  Enc#2 022        Time Out Error
2010-10-10 11:24:41  Enc#3 010        Time Out Error
2010-10-10 11:06:27  E2 Fan 02        Failed
2010-10-10 11:06:27  E2 Fan 01        Failed
2010-10-10 11:06:27  E2 Fan 00        Failed
2010-10-10 11:06:27  H/W MONITOR      Raid Powered On
2010-10-10 10:33:37  E2 Fan 02        Failed
2010-10-10 10:33:37  E2 Fan 01        Failed
2010-10-10 10:33:37  E2 Fan 00        Failed
2010-10-10 10:33:37  H/W MONITOR      Raid Powered On
2010-10-10 10:30:59  E2 Fan 02        Failed
2010-10-10 10:30:59  E2 Fan 01        Failed
2010-10-10 10:30:59  E2 Fan 00        Failed
2010-10-10 10:30:59  H/W MONITOR      Raid Powered On
2010-10-10 10:27:53  E2 Fan 02        Failed
2010-10-10 10:27:53  E2 Fan 01        Failed
2010-10-10 10:27:53  E2 Fan 00        Failed
2010-10-10 10:27:53  H/W MONITOR      Raid Powered On
2010-10-10 10:12:37  E2 Fan 02        Failed
2010-10-10 10:12:37  E2 Fan 01        Failed
2010-10-10 10:12:37  E2 Fan 00        Failed
2010-10-10 10:12:37  H/W MONITOR      Raid Powered On
2010-10-10 09:44:32  VOL#003R60Vol2-1 Complete Init         029:28:15
2010-10-10 09:12:45  VOL#003R60Vol2-2 Complete Init         028:56:29
2010-10-09 04:16:16  VOL#003R60Vol2-2 Start Initialize
2010-10-09 04:16:16  VOL#003R60Vol2-1 Start Initialize
2010-10-09 04:11:07  010.003.068.087  HTTP Log In
2010-10-09 04:09:25  E2 Fan 02        Failed
2010-10-09 04:09:25  E2 Fan 01        Failed
2010-10-09 04:09:25  E2 Fan 00        Failed
2010-10-09 04:09:25  H/W MONITOR      Raid Powered On
2010-10-09 04:08:10  VOL#003R60Vol2-2 Stop Initialization   001:48:04
2010-10-09 04:08:10  VOL#003R60Vol2-1 Stop Initialization   001:48:01
2010-10-09 02:20:09  VOL#003R60Vol2-1 Start Initialize
2010-10-09 02:20:08  VOL#000R60Vol2-1 Complete Init         000:02:13
2010-10-09 02:20:06  VOL#003R60Vol2-2 Start Initialize
2010-10-09 02:20:05  VOL#000R60Vol2-2 Complete Init         000:02:10
2010-10-09 02:18:07  ARC-1880-VOL#003 Create Volume
2010-10-09 02:17:55  VOL#000R60Vol2-2 Start Initialize
2010-10-09 02:17:54  VOL#000R60Vol2-1 Start Initialize
2010-10-09 02:17:53  ARC-1880-VOL#000 Create Volume
2010-10-09 02:17:31  Raid Set # 001   Create RaidSet
2010-10-09 02:17:14  Raid Set # 000   Create RaidSet