Preliminary Nvidia GPU client setup guide in Ubuntu 8.04

[direowls]

It seems like there's at least some interest in this for a guide in Ubuntu...I am a total noob at writing guides, so please bear with me as I cobble together how I did it. Everything below is assuming we are using 64-bit Ubuntu, since we already need 64-bit to run SMP in the first place. This will also be for single GPU for now, as I don't have experience with multi-GPUs under Linux even though there are working hacks out there now.

Entire credit goes to the people (Zerix01, Shelnutt2, and many others on the Stanford forum) who hacked their way through this on Ubuntu, big kudos to them:
http://www.ocforums.com/showthread.php?t=568721&page=6

and to EnablingWolf for his guide on installing NV drivers manually in Ubuntu:
http://www.ocforums.com/showthread.p...05#post5744205

Be warned that this procedure does take some poking around without a GUI. It doesn't really take any Linux knowledge per se - the commands are listed - but I'm going to assume some basic Linux knowledge like what the "/home" folder is, and how to use the Terminal to navigate in directories. And of course, I will NOT take any responsibility if you somehow blew the system up.

You will need six things:

- The ia32-libs package (check Synaptic Package Manager - you should already have this if you were running SMP before)
- The header files for your current linux kernel (I'll get to it in a minute)
- 64-bit Linux NV 177.67 drivers
- 32-bit CUDA Toolkit
- Wine 1.1.3 source code - download from http://winehq.org
- The GPU console client

I'm going to assume that a Wine recompile is not necessary anymore, the recompile only involved a small part of a file anyways - so you may be able to do this without compiling Wine from the source code by installing the old version straight from the Ubuntu repos, but I don't know...It seems that the -forcegpu switch for the GPU client will force the client to run now.

First, install Wine from the source code

This is probably the toughest and most time-consuming part of the procedure. Uninstall wine if you have it already.

- Download the source. Unzip and make note of what the folder is called. You can rename it if you want for easier typing (this renaming will be a common theme throughout the guide, just to make life a little easier)
- Open the Terminal (Applications->Accessories)
- We need to build the dependencies of Wine manually, and there's a bit to download (~couple hundred MBs), so type:

sudo apt-get build-dep wine

Mostly this installs some programming tools that Ubuntu needs to build/compile the source code and allow Wine to function.

- Navigate to where the Wine source is located. For example, For example, if you downloaded the file onto the desktop, just type

cd Desktop/(whatever the wine source folder is called)

- Once that's done, there is a list of commands we must run on Ubuntu 64-bit only. As per Zerix01 in the OCForums link, you only need to do this once.

mkdir -p `pwd`/lib32
ln -s /usr/lib32/libX11.so.6 `pwd`/lib32/libX11.so
ln -s /usr/lib32/libXext.so.6 `pwd`/lib32/libXext.so
ln -s /usr/lib32/libfreetype.so.6 `pwd`/lib32/libfreetype.so
ln -s /usr/lib32/libfontconfig.so.1 `pwd`/lib32/libfontconfig.so
ln -s /usr/lib32/libGL.so.1 `pwd`/lib32/libGL.so
ln -s /usr/lib32/libGLU.so.1 `pwd`/lib32/libGLU.so
ln -s /usr/lib32/libXrender.so.1 `pwd`/lib32/libXrender.so
ln -s /usr/lib32/libXinerama.so.1 `pwd`/lib32/libXinerama.so
ln -s /usr/lib32/libXxf86vm.so.1 `pwd`/lib32/libXxf86vm.so
ln -s /usr/lib32/libXi.so.6 `pwd`/lib32/libXi.so
ln -s /usr/lib32/libXrandr.so.2 `pwd`/lib32/libXrandr.so
ln -s /usr/lib32/liblcms.so.1 `pwd`/lib32/liblcms.so
ln -s /usr/lib32/libpng12.so.0 `pwd`/lib32/libpng.so
ln -s /usr/lib32/libcrypto.so.0.9.8 `pwd`/lib32/libcrypto.so
ln -s /usr/lib32/libssl.so.0.9.8 `pwd`/lib32/libssl.so
ln -s /usr/lib32/libxml2.so.2 `pwd`/lib32/libxml2.so
ln -s /usr/lib32/libjpeg.so.62 `pwd`/lib32/libjpeg.so
ln -s /usr/lib32/libXcomposite.so.1 `pwd`/lib32/libXcomposite.so
ln -s /usr/lib32/libcups.so.2 `pwd`/lib32/libcups.so
ln -s /usr/lib32/libXcursor.so.1 `pwd`/lib32/libXcursor.so
ln -s /usr/lib32/libdbus-1.so.3 `pwd`/lib32/libdbus-1.so
ln -s /usr/lib32/libhal.so.1 `pwd`/lib32/libhal.so
ln -s /usr/lib32/libsane.so.1 `pwd`/lib32/libsane.so
ln -s /usr/lib32/libgphoto2.so.2 `pwd`/lib32/libgphoto2.so
ln -s /usr/lib32/libgphoto2_port.so.0 `pwd`/lib32/libgphoto2_port.so
ln -s /usr/lib32/libldap-2.4.so.2 `pwd`/lib32/libldap.so
ln -s /usr/lib32/libldap_r-2.4.so.2 `pwd`/lib32/libldap_r.so
ln -s /usr/lib32/liblber-2.4.so.2 `pwd`/lib32/liblber.so
ln -s /usr/lib32/libxslt.so.1 `pwd`/lib32/libxslt.so
ln -s /usr/lib32/libcapi20.so.3 `pwd`/lib32/libcapi20.so
ln -s /usr/lib32/libjack.so.0 `pwd`/lib32/libjack.so
ln -s /usr/lib32/libodbc.so.1 `pwd`/lib32/libodbc.so

You can copy and paste this list directly into the prompt, fortunately, so you don't have to manually type each command out.

Now to compile the source:

CC="gcc-4.2 -m32" LDFLAGS="-L/lib32 -L/usr/lib32 -L`pwd`/lib32 -Wl,-rpath,/lib32 -Wl,-rpath,/usr/lib32" ./configure -v

Then:

make -j# depend && make -j#

When compiling wine, use "make -j# depend && make -j#", where # is the number of cores +1, so on a dual core it would be "make -j3". Should greatly speed up the process by allowing the threads to compile side by side.

Followed by:

sudo make install

Finally, if everything compiled smoothly without errors, copy the attached two files ("nvcuda.dll.so" and "cudart.dll.so") and paste them into the /usr/local/lib/wine folder. Make sure to remove the .txt extension.

Second, install NV drivers

Why do this when you might already have a driver installed? Envy and the Ubuntu repositories do not yet contain the beta NV drivers for Linux that allows CUDA to work (like the 177.35 drivers for Windows a while back). Others have said that the official NV drivers (173.14) do not work, so we need to manually install a beta driver and thus the fun

Go to System -> Administration -> System Monitor -> System tab, it shows which kernel version you are using in the line "Kernel Linux"

Go to Synaptic Package Manager and search for "linux header": check the box next to the header files corresponding to the version of your kernel. Apply and install.

There's one more file we need to install: search for "build-essential", find the package with that name and install it.

On the page that I linked to, halfway down there's a link to download the .run file. Download it and rename it to something you can remember (I used 17767.run). This rename will make it easier to remember when we need to type the name in a command prompt environment. Make sure you remember where you saved the file, and leave the .run extension intact!

- Ctrl+Alt+Backspace to back out to the login screen, then Ctrl+Alt+F2 to go into the terminal.
- You'll be prompted for your username and password.
- Stop the GNOME display manager by typing (you'll be prompted for the root access password):

sudo /etc/init.d/gdm stop

- Navigate to where you stored the driver file. For example, if you downloaded the file onto the desktop, just type

cd Desktop

- Run the nvidia installer package by typing

sudo sh (whatever you renamed the file to).run

The installer should run, and you'll be prompted for several things:
- The installer may find an older NV driver, allow it to overwrite with 177.67.
- The installer will fail to find anything on the Nvidia FTP, so it will ask you to build the source based on your kernel (See why we need to install the header files earlier?) Let it do so.
- Allow it to install OpenGL 32-bit libraries (need it to play games on Linux)
- Allow it to update the xorg.conf file and let it backup the old one.

If everything went smoothly, the installer will say installation is complete and dump you back into the console. You may reboot, or you may restart the GUI by typing

sudo /etc/init.d/gdm start

You may get a request in low-res asking you to reconfigure your monitor and resolution. Do so and you should be back in the GUI. Check under Applications->System Tools, there should be a new item called "Nvidia X Server Settings".


Third, install CUDA toolkit

We can only use the 32-bit CUDA toolkit for this, despite a 64-bit OS. Download the Ubuntu 7.10 32-bit version (7.10 version works fine). Use the renaming trick that we did for installing the NV drivers.

There is no need to stop GNOME anymore, so enter Terminal normally, navigate to the folder with the CUDA toolkit file, and again type:

sudo sh (whatever you renamed the file).run

I don't remember encountering any issues with this step, but my memory is a little hazy. When it finishes you can go on with the next step.

Fourth, load the CUDA wrapper in the Wine folder

While still in the terminal, navigate to the /etc/ld.so.conf.d:

cd /etc/ld.so.conf.d

We need to create a file:

sudo gedit cuda.conf

Simply type the following line in the text editor that pops up:

/usr/local/cuda/lib

Save the file as cuda.conf. The name could be anything as long as there is a .conf extension.

Fifth, run the client.

This is familiar territory - it is almost the same as running the SMP client in Linux. You can rename the GPU console file to something easier. Simply type

wine (whatever you renamed it to).exe

. Arguments such as verbosity 9 could follow the .exe command.

You can stop the client with Ctrl+C as usual, but you will need to kill the wine server files in the background with:

wineserver --kill

That should do it! Alongside an SMP client running A2 core, make sure to put the SMP client into "idle" priority in the config. On my rig, the GPU client does take a huge chunk out of the SMP production (~4600PPD down to ~3000PPD, A2 core), but a 8800GS is more than worth it. Hope this helps everyone on the team!

[[XC] Synthetickiller]

GPU, to my knowledge, doesn't have a folding client for linux, just windows. That's why you don't see it.

[Marvin_The_Martian]

Wrong, sorry Synth, there is no official client but there is a workaround which get's the nvidia gpu2 client running under wine

http://foldingforum.org/viewtopic.php?f=52&t=3744

[Shadowtester]

I would love to see a good easy to follow guide to setup smp and single or multiple gpu under linux ubuntu would be the preferred distro since its most popular

[Marvin_The_Martian]

No such thing, wine needs recompiling that's a step which isn't best offerd to n00b's I think?

But, if someone just uploads a linux built with the moddified wine included, now that would be a sweet thing

Btw, page six holds a step by step guide to get it running on Gentoo X64 ( not a linux guy, idk if it would be that diffrent across variants ).

[Shadowtester]

Yes and no gentoo is its own flavor of Linux most are either debian based .deb packages or red hat/fedora based with .rpm packages. I think the debian package/code base is the largest in the Linux world and there are several distributions based off that. Debian, Ubuntu, Knoppix to just name a few. And maybe just uploading a tar ball of the required wine source with the changes required made ready for the end user to compile on his or her own computer would be the best option that way it would be distribution independent. That is the way a lot of programs are distributed for Linux and compiling a source package with all the changes already made is not very hard.

[Shadowtester]

I just read the Gentoo a little closer this time it looks like you do not need to re-compile wine you just need to compile the nvcuda.dll using the provided source files from that thread and it should work. I think I am going to give that a try maybe this weekend if I get my pc all setup and ready in time.

[Marvin_The_Martian]

Well I'll be here hoping to hear you got it all running

I you would like, try to document what you do and maybe later on there will be the time and need to turn your experiences into a good guide for others ( as that post in the thread I linked to, maybe more purrty pics though ).

[Shadowtester]

Well my time frame is going to depend on when all the parts for my computer get here. I have a NXZT Rogue case coming with a DFI LanParty Jr P45 motherboard coming to house a Q6600 G0 with 4 gig of 1066 ram and 2 Nvida 8800GTS video cards being powered by a 700watt 80+ powersupply. I am looking forward to all that getting here around Wednesday or Thursday so I can build it and set it up over the weekend. I hope I can get 2 gpu2 clients and 2 smp clients running on it for around 14k points.

[Marvin_The_Martian]

Threat us on a nice build log, I know I would like it and I bet some others as well

[Shadowtester]

The problem is no digital camera here my cell phone does has a camera but I refuse to pay Verizon Wireless extra every month for their photo service and I never got around to hacking the camera firmware to allow downloading so I can take pictures on my phone just can not download them off the phone

[Marvin_The_Martian]

Ow but you got a few days right? Time to borrow one? Or maybe ask someone from XS who lives close to come over and help you out? Idk where you located, fat chanche I'll find an XS faher closeby, but maybe you are more lucky

And if you ask about your phone in the right section, I'm pretty sure there are some xtremesystems members capable of helping you download those images as well
Thinking about it, I do remember having read about verizon and this particular issue and that must have been here on XS. Problem is, hacking firmware will not be allowed as a subject of discussion so I'm actually glad I don't know much about the issue so I couldn't even engage in a conversation which entails more then general knowledge available everywhere.

[Shadowtester]

Way back when I first got the phone I checked into doing the hack to allow picture downloading without paying Verizon its fee but just really never needed to so never spent the time to do it. From what I remember it did not look that hard to do just reflashing the phone with new firmware which does not disable he downloading. Verizon Wireless cripples the phone so they can charge you a monthly fee to download pictures and use their nice web site to distribute the pictures either over the internet or send them to another phone. I will see what I can do to find a digital camera to use over the weekend but no promises. Getting the computer built and setup is the higher priority then getting it folding is next access to a camera is pretty low on the priority.

[Marvin_The_Martian]

Yup on all accounts

1. This forum requires that you wait 70 seconds between posts. Please try again in 38 seconds.

Btw, drop the verizon hacking already before we get in trouble :p

Pm some people who posted in the forums they run verizon ( do a search )

[Shadowtester]

No problem dropping the Verizon Hacking but can I still rag on Verizon for the ty way they treat their customers trying to make them pay for a service built into the Phone which pretty much all other carriers provide for no additional charge. I know I have a hard spot for Verizon Wireless but around here its about the only cell service available our other provider option is even worse if you can believe that.

[Marvin_The_Martian]

Hey yeah I heard enough about this limitation they have, but I also know from allot of US guys that it's their way or the highway ( eg there is only one viable option just like in your case ).

Must be tough, but on the other hand, my country has all those high speed networks now, but because I'm in abit of a hick town in a less developed region it seems I don't get any hsdpa or umts connectivity through my current provider ( which I'm stuck at still for a year ). If I browse the net on my phone, it's on 3g

[Shadowtester]

Well I am not it a very large town either and the best DSL I can get is 1.5mbit down 512k up unless I want to be raped by Comcast cable for $60.00 or more per month for their cable internet which I understand averages around 2 to 3 mbit in my area. So no great download or upload speed around here maybe next decade I will see some fiber but I am not holding my breath.

[Marvin_The_Martian]

I'm on 16mbit/1mbit for 29e a month. My mate has another provider and a n95 and he often connects his pc to the net through his phone and get's about 2mbit iirc download which isn't maxing it out but still pretty good. He got a flat fee subscription, if I where tight on cash and have the same provider I would ditch my isp, get another phone and have that act as a router for my entire home network. Not enough for torrenting with any speed, but I think it would be good enough for browsing and folding ( maybe.. not to big a wu's then.. )

[Shadowtester]

Marvin and you don't call that fast only about 10 times faster down speed and twice up speed over my DSL. So what do you consider fast if that is slow all I can say is wow I would be so happy with that kind of speed!!!!

[Marvin_The_Martian]

It's the fastest I can get, but it's been buggy as hell. I got phone service through the same provider, but sometimes I can't be reached due to how the isp has used his own voip protocol which doesn't sense my other network activity. If I have to many udp ports open, phone drops out, if I have a higher upload then 50K/s my phone is either out or of about 1960's quality ( I guess, wasn't born then ).

I would take the 10/10mbit cable over this adsl2+ stuff, but the 10/10 line is 80 bucks ( to much!! ).

[direowls]

So back to topic... I have put my very first guide up. Hope it helps!

[Marvin_The_Martian]

Well let's wait for some people to give it a try, a guide is only as good as it's feedback

Going over it, the writeup looks very clear and simple thanks for putting the effort in you get a cookie!!!



Edit:

To add something, you say you don't have a multi card setup so you can't test it, but you were on track with the -forcegpu flag. If anyone with a multi gpu setup wants to try, with nvidia use forcegpu g_80 and with ati forcegpu r600 iirc, along with the gpu 0 and gpu 1 flags.

[Shadowtester]

Well I received my case motherboard power supply and 8800gts's yesterday still waiting on the cooling components and other small misc items which should be here by Friday looking more and more like a busy weekend where I should be able to test that install guide

[coo-coo-clocker]

I'm interested! I would love to put a linux-based file server on my network and have it crunch. I'm just always scared away from Linux because of the stories of how time-intensive and picky it is to get up and running. Do you know if Linux can expose a DLNA-compatible file system to the network?

[Shadowtester]

Not sure on my network I use NFS its much easier on the CPU usage over samba. On my network I get around 20mb/sec transfer rate average. With samba best I ever got was bout 12mb/sec