A yardstick that I use to determine if I have a good setting in the app_config file is how much time does it take to complete a GPU task? If you increase the number of GPU task running but it takes longer to run each task, then have you really gained anything? And, of course, if it starts causing errors, then you know you've gone to far. Been there, done that.