@Anvil - the 122590 (very nice score!) is with the 9260? and which drives?
Printable View
@Anvil - the 122590 (very nice score!) is with the 9260? and which drives?
@Anvil I'm up to around 105k without os, but keep in mind if it's anywhere close to that in the full suite it's going to be a huge improvement for me.
In my 30k+ run I think the hdd score was 72k, so I think I can put a pretty good score up. Though 4.8ghz scares me maybe that's why I've been putting it off. :)
@Steve,
3R0 Intel G1 :), onboard controller, the 9260 is not an option without the FP Key. (still waiting for it, maybe next week, should have been a software option and not a hardware Key)
@mbreslin,
~100K HDD score running OS should be possible using the 9260, I hope. (using FP)
I've been doing a few tests using the 9260, can't remember the exact score but it wasn't anywhere close to the ICH scores I get using the SF or C300 drives.
My ~27-28' score was performed using 2R0 SF on the ICH.
@ mbreslin - I've been doing 30x160, 30x158 depending on ambient temps a lot - 2-4 hours some evenings and even longer on the weekends.
voltages i use at just under 1.6v vcore, 1.48 vtt and cpu pll just under 2v - I'm using chilled water (way too much condensation).
Steve
Maybe we should move the pcmv discussion to one of your pcmv threads?
@mbreslin...that is amazing they recommend those settings! are they aware you have fastpath? also, adaptive read ahead is gone in the latest MSM version, actually they got rid of that three versions ago so that is very very bad advice. :(
Hi guys, this is slightly off-topic, but you have been great with contributing with IOmeter result files, so i'm posting a notice here in hope more people will notice i'm doing this.
I'm working on a little project to map storage sollution scaling by QD for 4-32KB blocks in the QD 1-32 range, wich are mostly the relevant block and QD ranges for random reads on desktop and most types of workstation. I'm hoping as many people as possible will contribute by running my IO config (takes about 20-25 minutes). I'm looking for results for any type of storage, from a 10 year old 5400RPM PATA drive, to a first gen JMicron SSD, to a velociraptor, Intel SSD, and 2-8(+) SSD/HDD arrays. Basically the more diversity i get the better. 1-N scaling of arrays would also be great (although i know this would require breaking them up, so i don't expect too much).
I already have a bunch of results for 4KB random read for SSDs, but this is a much larger project to better understand storage scaling, and illustrate it with graphs for all interrested users on XS and diskusjon.no (i'm getting results from both forums).
Link to the post with the config and more info: http://www.xtremesystems.org/forums/...0&postcount=39
@ Mr Lowfat - sorry to hear about your mobo, hope to hear you have a new on soon.
hmm i say...send me the card for testing :) how much does one of those run btw? and is it still for sale?
http://www.amazon.com/gp/offer-listi...&condition=all
$895. Same price they were at launch.
http://www.fusionio.com/products/ioxtreme/
http://www.amazon.com/Fusion-io-ioXt.../dp/B002S6CRGY
It's $900 for 80GB MLC.
The ioDrive 80GB SLC is around $3600
Hey guys, I've been in mexico for a week and just got back. I ordered the FP key off provantage for 130 bux or so. it will be here tomorrow.
I tried reading most of the thread but I have a few questions. I want to do a side by side comparison (before fast path and after)
Tonight I was going to get the optimal setup on the 2 sandforce drives I have in raid 0 and bench then I can add the key tomorrow and set up the same config so we have a comparable test bed.
but before I begin I'd like to know what the best settings/stripe size/ mobo bios settings/ lsi bios settings etc. so I have it all set for tomorrow.
I heard some of you guys say the 256kb stripe was recommended by lsi. Is this right? right now these are my current settings in the lsi Mega storage manager.
also note im on 1156 max III formula that is 8x/8x pci-e or 16x/4x Ive been benching at 4x slot cuz I dont want to lose my videocard performance. when I do the new comparison I'll swap slots so its 8x/8x so there wont be a bottleneck.
I'd love it if the next intel 1155 does x16/x16 or x16/x8 so I dont have this problem anymore. Yeah I could go get a 1366 server board and tri channel mem but what fun is that?
http://i239.photobucket.com/albums/f...apdisabled.png
http://i239.photobucket.com/albums/f...hcurrent-1.png
http://i239.photobucket.com/albums/f...th/lsibios.jpg
so far the general rule has been
LSI webios settings:
64kb stripe
wb enabled
disk cache enabled
adaptive read ahead
always write back
ncq disabled
io direct
mobo bios :
enable AHCI mode
is this still the best settings for my config or are you guys seeing better results with other settings with sandforce?
windows settings:
check mark both boxes
-enable rite back cache enabled
-turn off windows buffer flushing
disable drive indexing
disable defrag
disable superfetch/prefetch
power options / advance hard drives (turn off ) NEVER
Open perfect disk 11 run as consolidate free space
then open AS cleaner and check the box (with FF) and run it.
this was the rule with indinlinx. has it changed with sandforce?
If you had my rig guys and you wanted to do a proper before and after with my drives in raid0. would you use my above settings or would you change something?
thanks
TA
well the fastpath is reacting differently to different drives. the settings for the x-25's and the c300 and my vertex are as different as night and day tbh. i am running 128k stripe, no read ahead, direct I/O, disk cache enabled, write through, and i change the NCQ to ON, and other than that i just rock out with my :banana::banana::banana::banana: out :)
i change the cache buffer flush to 2 btw, seems to yield some good results for me :)
however, TBH you are just going to have to test, there is not a lot of information out there on these setups atm. we are the pioneers! I have a firend with 6 vertex LE on his 9260 right now, but he is also waiting on his FastPath key, so once he gets it and good stettings i will let ya know :)
okay making a back up image and trying your settings. were there any new FW when I was away? once I do my benches without the key and Im ready to install the key should I reformat and setup the raid lsi bios or can I leave it alone? will the key give me different options in lsi bios/ mega raid manager? lemme know please paul so I can get right into the good stuff. Im so excited. hey man did you listen to those songs? I included a prank call to msft activation I think u will enjoy. If you know of a free file share service please upload both so everyone in the thread knows what the hell we are talking about. ;)
Here's what LSI suggests:
http://www.lsi.com/DistributionSyste...hmark_Tips.pdf
thanks man. this is a good guide and it shows a pretty comprehensive screens to set up iometer which ive always had problems with.
:up:
on another note I worked late and got home from work at 9 pm and the package room in my bldg was already closed so I couldn't get the box that had my fastpath key. Probably better. I'm exhausted.
yes acenz those aree their suggestions but i sent them an email askign them to re-write them for fastpath. those were pre-fastpath settings...but they will work.
@TA no there arent any settings or any way to know that it works other than the increased speed and your latency will drop big time! check your latency with everest before you put the key on, then after. the results are immediate bro. no changes needed. just make sure you put the key in with the power off!
so paul you're basically saying the settings for the raid web bios /stripe size with the FP key will change from when you didnt have the key installed?
like example I have months of fine tuning with the specific raid array and found the best stripe size performance and lsi bios settings.
if I add the key those same settings might be completely different?
FOr instance: before I had a 64 kb raid 0 stripe and after the key I find a 128kb stripe is getting better performance? maybe write back was better before but now write through is better? or are you saying the iometer settings are going to need to be set to differnt values than the ones in the pDF?
hey paul do you enable or disable memory remap in the mobo bios? I noticed a pretty heavy increase in read perfomance last night when I disabled it.
no need to change iometer settings.
you will have to re-learn your controller. it will handle differently. better, but differently. write thru will be much better!
memory remap? could you explain a little better??
Guys I got my key and powered off. discharged power to the board and removed the 92604i and inserted the little key like a 2 pin jumper with a L-shaped pcb attached.
set the card back into x8 slot and boots fine. just did a quick bench with cdm. but its very marginal increase.
DO I need to get into MSM lsi config in windows and enable any settings to get this thing enabled 1st?
before key:
http://i239.photobucket.com/albums/f...h/remapdis.png
after key
http://i239.photobucket.com/albums/f...h/afterkey.png
no you dont have to enable anything. measure latency with everest (average access time)....also set to the write thru and no read ahead and give it a go. those numbers are actually not bad at all for a 2 disk array. that is pretty good. (write may be a tad low)
paul sorry for the delay. I was actually wiping those sandfore drives and starting fresh. Those last benches were all done using previous images and even after using perfect disk 11 and ssd as cleaner I thought I should start from scratch. I'm on a rig I just put together so I can be in touch while I set up windows with the new key.
here's the question1 of many.
1> did I plug the key in the correct jumper on the 9260.4i? (the manual with the key only shows a 9260-8i and the jumper is in a completely different spot on the 4i so had to guess. I think I remember because you showed us a Screen shot of your 4i and I think it was in the right spot. take a look and let me know. The reason I ask is because my performance increase was almost a decrease. so I though i plugged the key into the wrong pins.
http://i239.photobucket.com/albums/f...h/IMG_2296.jpg
http://i239.photobucket.com/albums/f...h/IMG_2290.jpg
http://i239.photobucket.com/albums/f...h/IMG_2293.jpg
2. look to the upper left of the card and there is an array of 3 pairs (6) jumper pins. does the pair in the middle need to be removed to activate the FP key? do these pins do anything? should i even have the jumpers attached? I havent touched them since I got the card. the fw on the card is 12.7.0-0007 (APP-2.70.03-0862) 5/26/10.
***Is this the best one or do you have a newer one that is better for fastpath?
**********DRIVER QUESTONS***************
3. If I flashed the card before installing the key do I need to reflash with the new key installed? do I need to reistall the drivers after the key?
4. I am on wn7 64bit. a while back u told me to use the winserver 2008 x64 drivers because they were better in terms of speed. that was before they released the new drivers in May. is this the same rule or should we use the actual win7 driver?
5. should I save the drivers on a usb and load them during win install? or just go ahead and install the drivers after I get the os all installed.
hit me back asap.
thanks.
1) Yes it's plugged into the right place.
2) Those jumpers are left alone. That's the newest firmware.
3) No. No.
4) Drive dependent.
5) After install is fine.
I'm sure ct will answer these as well. I've seen people say this to you before and at the risk of being annoying: You really need to try every setting yourself. Things like checking which is better w2008 or w7 drivers is very easy to figure out yourself, a few minutes and a reboot or two. The lsi pdf is a good place to start but to truly get the best out of your particular drives you'll need to test everything.
The best way imho is to take ideas about settings from people if they mention something you haven't thought of but otherwise just try everything. Everything.
That all said, buying a FP key for a two drive array.. You are truly hardcore sir! Good luck.
what mbreslin said is absolutely correct.
Of course the downside is that this is a major time drain.
I am doing exactly this (all this week) to find the sweet spot of # of drives/stripe size/allocation size.
So many variables - you (and all of us) need time and patience to find that sweet spot.
Which is why you won't see me benching anymore, tuning was becoming too much like actual work. This hobby is supposed to be fun!
Starring at the pcmv hdd test progress wheel can be almost hipnotic:shocked:
I could be wrong, but my understanding of FastPath is that it increases the maximum IOPS that the controller can execute, but that it has little, if any, effect if you're running below the max. For a 2-drive array at 250 MB/s for 4K/QD32, you're already running at 64000 IOPS, or 32000 per SSD. That's close to Intel's 35000 spec (which you might reach with a slightly higher QD). I doubt you'll see any improvement from FP until you hit around 90 or 100K IOPS--so somewhere between 3 and 4 Intel SSDs.
Actually, you can see an improvement in accesstime, and how quickly the array scales with QD.
I suggest running the last config i posted (1 worker, 4KB random read, QD 1-32, linear 1 QD steps) and posting the results before and after fastpath so i can plot the scaling to illustrate.
AceNZ if you look at the reuslts above it scales rather quickly with the low QD numbers. that is the attraction! the 35k number you are speaking of is with high QD. you can do it with QD of 4 on a FP enabled card.
Yes! And you drive yourself crazy thinking it seems to be going slower/faster than last time. So many times I've sworn it was taking much longer and yet I got a better score than ever before.
Nothing is worse than the full pcmv suite failing after an hour+ on the last gaming test. I'm so nervous every time on that part.
i noticed you do full runs on your submissions. i never do full runs takes too long :) i dont think ive done a full run in the last hundred or so...
In this thread? Can you tell me which post you're looking at? In #83, comparing mbreslin's 8R0 FP vs. noFP with 1W, the benefits at QD=4 look pretty minimal to me, and the big benefits don't seem to kick in until 60K IOPS or so.
http://www.xtremesystems.org/forums/...2&postcount=83
Also, if the perf at QD=4 is better with FP, then why are trans am's CDM results so similar with and without FP? Are you saying the improvement shows up in latency measurements, but not throughput?
The improvements in latency translates to improved small block throughput. The large block throughput is virtually unaffected by NAND latency and is highly dependent on internal stripe sizes and parallelization.
FastPath also seems to enable further scaling past about 80-100K IOPS, but that's not a relevant case for most common user scenarios, since it's mostly above QD 24-32.
There should be a graph you can look at for scaling at QD 1-8 that i posted, if you look at that, you'll se FP helping out.
here is 4k scaling before and after
AFTER .................................................. .................................................. ..... BEFORE :D
http://i517.photobucket.com/albums/u...omparisons.png
Paul - should your caption read "after vs before"?
Also, very nice improvement! 122K - very nice!
yea i was thinking that actually when i posted :) oh well figured it was self explanatory! i am very impressed with the performance would love to get some newer drives....but must wait...
How to confirm the Fastpath has been enabled?
Can check it in LSI Web BIOS?
nope. the only way to tell is that yer latency goes down to .08-.09 area. also your small file random will skyrocket. if you are gettting over 150 mb/s at any queue depth on 4k random, i would say its working.
The way to know for sure is to download megacli (link), then in an elevated command prompt type MegaCli fwtermlog Dsply –a0 > fw.log. In the log you will see something about upgrade key being detected, if you don't I would contact LSI.
nice tidbit! didnt know that, thanks for sharing!
@m.oreilly: Thanks! Updated my link above as well.
The 9260-8i and the 9261-8i are supposedly the same controllers, except for connector location/orientation. In that case, it should be possible to use FastPath on the 9261, right? Unfortunately, this isn't covered in the docs or on the LSI web site. Does anyone happen to know where the FastPath would attach on the 9261?
This may not help but, since you have both, look for those kind of inverted plastic back clip things that hold the key in place. One of those should be fairly obvious somewhere on the card.
(I kind of assume you've already looked and if you can't find one it doesn't seem likely that it's compatible)
Lastly try to contact LSI, depending on time of day/phase of the moon/god knows what else I receive responses from them anywhere from a few hours up to about 2 days, good luck.
I'm still waiting for my FP Key :shakes:
By the time I order the next FP Key it'll probably be offered as a software download.
Hi,
I am pleased to see the good results others are seeing with there fastpath keys installed.
I have been asking LSI evern since getting this setup going about very poor random small I/O. It seems a bit rude that they are choosing to seel us an add on to get the performance that we were initially sold the cards to expect...
Here is my current 128K sequential read 128QD IO meter
http://i767.photobucket.com/albums/x...ntial128QD.png
Here is my current 4k random read 128QD IO meter
http://i767.photobucket.com/albums/x...mRead128QD.png
I am hoping to get x4 on the 4k read with the new fast path keys.
What did people see with the write rates with the fastpath key?
dwayneberry,
what is your config, drives etc?
yes dwayne please tell...3808 mb/s!! wow!!
Hi,
The configuration I am running is 3 lsi-9260-8i each running raid 5 on 8 X25-M G2 drives. (a total of 24 drives). The three lsi raids are then combined using on OS (windows 2008 R2) stripe. It is 3.36TB in size.
I need the array to have redundancy (in case of disk failure) but also very fast, and large enough to fit a serious amount of data. This config also allows for potentially 3 disk failures (assuming different controllers).
I have several other raid setup using Areca 1231ML and 1680-xi but only the LSI controllers are currently capable of getting close to pushing the capabilities of the drives connected. On the Areca 1680-xi with 16 fast SAS drives the card is completely overwhelmed. That was why I went to the multiple cards when moving to trying to utilize the SSD drives.
The machine is a dual Xeon 5520 with 48GB mem.
The performance is great but was really hoping for more on the random access, so am hoping to see good fastpath numbers (based on what I have seen on this and other forums I am hoping for something around 4X... am I crazy? )
P.S. If I increase the read size I can get to over 4gb/s
@dwayne -- besides R5, how do you have your controllers and volumes configured? Stripe size?
you will see tremendous improvements, with a array of that scale and complexity i would highly recommend you purchase the keys. the results with raid 5 are supposed to be just as impressive. i was wondering, is it possible to run a raid 0 set across all three controllers as a bootable array? i know that arrays can be spanned over several controllers, just not sure if they are bootable or not.
i would love to see some pics of your rig!
Here are some pictures.
I know it looks bad!! It is in a better box now 2U supermico case with 24 2.5 drives across front, but it took months for the box to become available so it ran on a frankenhack setup for most of its life.
http://i767.photobucket.com/albums/x...y/IMG_9135.jpg
http://i767.photobucket.com/albums/x...y/IMG_9131.jpg
I do not have a link to a photo of it in the box but here is a link to the manufacturer site
http://www.supermicro.com/products/c...16A-R900LP.cfm
It was a squeeze to get it all in the box and if I had to do it again I would use the 9261 cards due to where the cables connect, as it is I had to very carefully butcher each cable to get its bend just right to fit cables in tight box.
Unfortunately the box is an active box in real R&D use so I cannot just re-purpose the drives. I played with raid 0 a little initially (just out of curiosity) and saw better numbers than the raid 5 but for the benefit of the redundancy etc the gain was not at all worth the risk. To be brutally honest with any kind of disk setup like this it is very difficult to push the "potenital" versus the real world use. When I am say doing oracle testing on this machine I might see peaks of usage in the 1gb/s kind of range but often it sits down around 600mb/s if I deliberately up the amount of work being asked to be done on the box thought I get very nice scaling.
I am really looking at the random io benefits of the fastpath key to truely fully realize the potential of the box.
godamn it dudes and friends in this thread! you know me as trans am my friends know me as alvin.
it doenst matter. I have gone through hell and back with the 9260-4i on every platform . amd sucks and is hit or miss depending on board. So after I got the lsi it made me move back to intel. but i always stuck to what I know. 2 ssds in raid0 off lsi and a F3 off intel for storage.
Ive gone through 2 ocz samsung ssds then 2 indinlinx barefoot supertalent ssds to currently 2 50gb vertex 2 ssd. then last weekend one of the vertex2 died. so i rma to ocz.
lemme get this straight cuz I feel like 2 ssd with the fp key is not taxing the controller the limits. Ive invested so much time and money into this controller but I still feel like my current setup is not maxing it out to its full potential/
what can I do with this setup? should I get 2 more 50gb ocz vertex 2 and stripe them so I use all the 4 sas/sata connections. or should I shut the hell up and just wait for the rma v2 to come back and just do what I have been doing....2x ssd raid0 and run the f3 off the board?
I feel like Im not using the card to its limits and as a ln2 overclocker I want to push hardware to hell and back. I feel so stupid with this post but Ive just had it. Ive invested way too much time and gone through 3 generations of ssds since i got the damn thing. I am running out of space on the F3 1tb drive as my storage. should I get a 2nd f3 and raid them as a 2nd raid or should I get 2 more 50 gb ssd vertex 2 and stripe them all together then run a 2nd 1tb f3 as a redundant set off the board or stripe them? anything you guys want to add Im all ears. Ive fing had it at this point. I should be benching this 655k on ln2 and break some hwbot records but im sitting here trying to figure out the best setup with the 9260-4i instead. ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Where's packman?
To answer your question TA/alvin, 4R0 C300 256GB (or 128GB) would take the controller close to the IOPS limit, and also give good bandwidth and storage space, but cost a lot. If you flip some pages back you will find graphs i've made, and you'll see the C300 does well at 3-4R0 with little IOPS scaling with more than 4 drives.
4R0 C300 128GB would give you:
512GB storage, about 150K IOPS read and 120K IOPS write, 1200-1400MB/s read, 500-550MB/s write. The real bonus with 9260 FP + C300 is really good IOPS scaling at lower QDs.
My advice: Wait for rma to return, use your two drives in r0, not a weak setup by any means. Then, wait patiently for intel refresh, possibly get a few gen3's.
Dynamic disks configured as a software mirror / R1 are bootable. Dynamic stripes / R0 are not.
One problem is that you can't install W7 onto a dynamic striped array, nor can you convert a regular drive to a striped drive; you have to create it as a striped drive from the start.
@Ace - Paul might be referring to the idea that multiple controllers in the same machine could communication with each other prior to the mobo looking for an os to boot.
Would be cool if it could be done.
Might need to be an sli like connector between the controllers?
thanks MB and Glrs. I think I will wait for the rma to come back as I am not about to blow cash on those c300s. If anything I was considering adding a 3rd 50gb vertex2 and raiding 3 but can I stripe across 3 disks?
or how about this.?? I noticed my 1tb f3 is almost maxed out for storage. could I get a 2nd f3 with the same model id./ no. and run the 2x50 vertex set raid 0 and the 2 f3 off the other 2 sata/sas ports in raid0? or is that just retarded to run your backup disks in raid0? crap..
that would also mean I would need a 3rd 1tb drive to back up to in order to copy my existing files to the new raid set.
any advice?
thanks steve, that is exactly what i am referring to. you can hook some controllers together for a "teaming" effect via sas-to-sas cabling. 9260 comes with a sas-to-sas cable so it seems to be common sense. did some more research you can do this with a 9260 and one other controller, but not another 9260 (BOOOO!!)
you can do it with a 8080 (why only a 3gb/s i will never understand)
it is possible they just dont allow it because it would cut into their expander buisness is my best guess. there are controllers from other companies that you can span arrays across. just not sure if they are boortable or not....and im not worried about any 3 gb.s stuff anyways.
getting ready for 12gb/s myself :)
(2012 btw is release date for dual core 300,000 iops 12gb/s device from lsi...it is pcie 3.0 !!)(they are already sampling to select OEM's btw)
I've known about the dual core thingy for a couple of months now, and seen a nibble of info on it. If i remember correctly it was up to 300K IOPS on integrated RAID, and up to 600K IOPS in pass-through softRAID.
Tip of the day.
Try to marge some 9280 with some pass through devices witch they will have some external and internal ports ;)
set the raid on the 9280 and then u will have some ROC's on passthrough and one Main ROC for raiding ;)
If you are still looking for iometer results here are mine.
http://www.2shared.com/file/PWN7QiHk...e_nocache.html
Holy :banana::banana::banana::banana:e! that QD of 1-4 is uber dude! hey Gullars could you add that to our graphs for comparison? nice results lowfat, thanks!:eek:
this is random 4k right?
here is some of your numbers
QD MB/s
1 59.75
2 99.85
3 113.06
4 114.00
etc... that is about the highest it goes, but the point is it does it at such low QD..the highest is a 127@QD27 btw
I used the config file posted by GullLars here
I didn't change any settings.
Yes, those are 4KB random ioXtreme numbers.
I'm a bit surprised by the limited scaling, but you have awesome IOPS at low QD, actually better than SteveRo's Acards.
QD 1: 15,3K IOPS
QD 2: 25,5K IOPS
QD 3: 28,9K IOPS
QD 4: 29,1K IOPS
QD 27: 32,5K IOPS
Clearly the ioXtreme hits a wall around 30K IOPS, which is a bit sad. If it hadn't it could likely have done around 100K IOPS at QD 7-8. Still, for desktop usage the stats are awesome taking the bandwidth into consideration too.
15K IOPS @ QD 1 with MLC flash :hump:
oh yea those are uber, could you put up a low QD graph (1-4 or 1-8) with his device against our recent fastpath arrays? man if only it would BOOT i would buy it right now!
content moved to the correct thread - G's rantings
I got my fastpath key today for my lsi 9260-4i card and installed. I didnt see any difference at all and hdtune shows the same result with and without fastkey? Is there anyway i can confirm that the key is properly installed and working??
Please help.
http://www.xtremesystems.org/forums/...&postcount=243
http://www.xtremesystems.org/forums/...&postcount=241
did you install the drivers? did you install from a previous image? did you try a different bench like atto or as ssd or cdm?
Yes. I installed latest drivers and firmware.
Please find enclosed fw log from the megacli. Is my ssd is not supported by fastpath?
I'm seeing this lines here...is this okie?? i'm worrying about the bold ones...
T3: Primary Key: Security disabled
T3: Upgrade Key: Security is not supported even though Upgrade Key was detected
T3: Primary Key: EnableSnapshot disabled
T3: Upgrade Key: Snapshot is not supported even though Upgrade Key was detected
T3: Primary Key: CTIO disabled
T3: Upgrade Key: CTIO is supported
T3: Primary Key: SSC disabled
T3: Upgrade Key: SSC is not supported even though Upgrade Key was detected
How many SSDs do you have on the controller?
In my testing, I didn't notice much of difference in IOPS until I got to about 4 drives / QD32 / 80K IOPS. Supposedly latency is lower at lower QD, but I didn't track that.
what are you using for those insane speeds, which ssd's?
I have 4 * intel x25-v r0 on 9260-4i. Anyone knows what lines in megacli output show that you have fastpath properly installed?
mbreslin said "The way to know for sure is to download megacli (link), then in an elevated command prompt type MegaCli fwtermlog Dsply –a0 > fw.log. In the log you will see something about upgrade key being detected, if you don't I would contact LSI. So I guess as your log states "Upgrade Key was detected" it is properly installed.
Thank you. I saw that. But i'm not seeing any difference in numbers when i run hdtune. I'm not
Familier with other tools. In my opinion i should see atleast little improvement in read?? Hope someone can help.
There are 3 two pin connectors onthe controller. JT8, jt9, jt10.
I installed fp key on jt8 (modular raidkey header)
Hope its the right spot. I checked computurd's picture.
Solaris,
HDTune is not the right tool for checking/testing the performance of the LSI controller.
You might be able to spot the difference using AS SSD, CDM.
What you should use is iometer.
Thank you. I will try other tool. I'm yet to have os on it.
Im anxious to see this. I got my 3rd ocz 50gb vertex and just simply did the optimal stripe setting from the lsi bios.
so i have 3 x 50 gb vertex2's on the 92604i now. This baby is finally starting to purr.
I'll post some ss tonight.
Trans, how will you do benching?
Im using what I know. Atto, crystal disk mark with all 0xFF (1 fill) and AS ssd.
Id love to learn how to set up iometer so I can compare with everyone else in the thread.
I get this one:
Exit Code: 0x00
Firmware Term Log Information on controller 0:
T0: LSI ROC firmware
T0: Copyright(C) LSI Corporation, 2010
T0: Firmware version 2.70.03-0862 built on May 05 2010 at 18:12:27
T0: *** HW Encryption Disabled : dcrReg=80000001
T0: setAdapterResetTime: CCR_MISC_CFG 8002ff2c
T0: DRAM_LOCAL_BASE: 80000000
T0: MEM_FIXED_SIZE: 1100000
T0: FW_DRAM_REGION_START: 81100000
T0: FW_DRAM_REGION_SIZE: 2200000
T0: MEM_POOL_BASE: 822623a8
T0: Initializing memory pool size=0109DC58 bytes
T0: Press '!' within 3 seconds to enter debugger before INIT
T3: EepromInit: Invalid CRC in ROM
T3: Crc error detected. Checking multi One wire device Network..
T3: Searching Raid Keys
T3: One Wire Devices detected e50000035bd60433 7700000349ffbc33
T3: Successfully read authenticated first page data for first Raid Key
T3: Successfully read authenticated first page data for Primary Raid Key
T3: EepromInit: Family=33, SN=bcff49030000
T3: EepromInit: Family=33, SN=04d65b030000
T3: Primary Key: Security disabled
T3: Upgrade Key: Security is not supported even though Upgrade Key was detected
T3: Primary Key: EnableSnapshot disabled
T3: Upgrade Key: Snapshot is not supported even though Upgrade Key was detected
T3: Primary Key: CTIO disabled
T3: Upgrade Key: CTIO is supported
T3: Primary Key: SSC disabled
T3: Upgrade Key: SSC is not supported even though Upgrade Key was detected
T3: Authenticating RAID key: Done!
T3: CFGI firmware version 5.0.0.1
T3: Nvdata version 2.04.03-0002 built on Apr 01 2010 at 11:52:59
******************UPdate
this is my 1st shot at iometer with the help of lowfat. he pointed me to guilars's post that inlcudes the zip on post 82
this is the 1w config in the zip file:
http://i239.photobucket.com/albums/f...1ofguilars.jpg
this is the 4w config.
http://i239.photobucket.com/albums/f...wofguilars.jpg
is this any decent?
my settings are
3x 50gb vertx2 raid 0 32kb stripe
9260-4i with fp key
win server2008 sp2 64bit bios
ncq enabled
no read ahead
write through
direct io
r/w
disk cache enabled
bkgrd init disabled
power settings in windows turn off hdd/ NEVER
indexing off
ahci on
super and prefetch are off.
ran perfect disk 11 free up space
and as cleaner with FF box checked
any other settings I should change to get better performance lemme know.
I'm stil playing with stripe sizes.
also note that the 9260 is in the 4x slot and not the 8x slot.
Ill try the x8 slot and bench again.
Trans Am.
60-65' iops is what I get (on a bad day) using 2R0 Intels.
Disable the disk caching policy, align at 4KB (in the iometer profile), you might be able to go beyond 100' iops using 3R0 Vertex 2. (90'++)
Forget about Tony Trim, it will degrade the performance on these drives.
(it sort-of works on the old Vertex though, never ever use that procedure on any of the new drives)
Bumping this old thread to mention I've got my 9260+fastpath key+cables on fleabay. breslin is in the seller name, card+key is a beast I just wanted to see how high I could go benching with it, now I need to support my rc airplane/helicopter habit. :)
this makes me teary eyed, l;ove this old thread, and now your leaving!
fine then.
:)
This thread was a lot of fun and I learned a lot, someone else can have fun with my drives/cards. :)
I'm down to a meager 3x 256gb c300 r0 on ich10r. How will I ever survive on this sluggish setup.
http://i787.photobucket.com/albums/y...KE/Capture.png
And it's gone! Someone got a steal on my 9260, card/fp key/cables 365$
:)
well that person is lucky. damn shame for you sir. i sold my 9260 for 550 on the forums. no cables :)Quote:
And it's gone! Someone got a steal on my 9260, card/fp key/cables 365$
as long as your happy though, no big deal :)