9

There is a C# function A(arg1, arg2) which needs to be called lots of times. To do this fastest, I am using parallel programming.

Take the example of the following code:

long totalCalls = 2000000;
int threads = Environment.ProcessorCount;

ParallelOptions options = new ParallelOptions(); 
options.MaxDegreeOfParallelism = threads;

Parallel.ForEach(Enumerable.Range(1, threads), options, range =>
{
    for (int i = 0; i < total / threads; i++)
    {
        // init arg1 and arg2
        var value = A(arg1, agr2);
        // do something with value
    }
});

Now the issue is that this is not scaling up with an increase in number of cores; e.g. on 8 cores it is using 80% of CPU and on 16 cores it is using 40-50% of CPU. I want to use the CPU to maximum extent.

You may assume A(arg1, arg2) internally contains a complex calculation, but it doesn't have any IO or network-bound operations, and also there is no thread locking. What are other possibilities to find out which part of the code is making it not perform in a 100% parallel manner?

I also tried increasing the degree of parallelism, e.g.

int threads = Environment.ProcessorCount * 2;
// AND
int threads = Environment.ProcessorCount * 4;
// etc.

But it was of no help.

Update 1 - if I run the same code by replacing A() with a simple function which is calculating prime number then it is utilizing 100 CPU and scaling up well. So this proves that other piece of code is correct. Now issue could be within the original function A(). I need a way to detect that issue which is causing some sort of sequencing.

10
  • 3
    wouldn't you be better off using Tasks not Parallel.ForEach? you can then control the tasks and their number much better.
    – Liam
    Jul 7, 2016 at 10:48
  • 2
    which os? are you running a release build without vshost.exe? is the process the only one running when you measure CPU usage? process priority? Jul 7, 2016 at 10:49
  • @dlatikay - Windows Server 2012. Yes, I am running release build and apart from default OS features this is the only program which is running. I haven't set the priority. Let me try that too. Jul 7, 2016 at 10:53
  • @Liam The Tasks API (Task or Parallel.For(Each)) implements thread pooling. As such shouldn't it be the case that using MaxDegreeOfParallelism should be just as effective as using multiple tasks? Jul 7, 2016 at 10:53
  • @Liam - will try this out and update you with result. Jul 7, 2016 at 10:54

1 Answer 1

7

You have determined that the code in A is the problem.

There is one very common problem: Garbage collection. Configure your application in app.config to use the concurrent server GC. The Workstation GC tends to serialize execution. The effect is severe.

If this is not the problem pause the debugger a few times and look at the Debug -> Parallel Stacks window. There, you can see what your threads are doing. Look for common resources and contention. For example if you find many thread waiting for a lock that's your problem.

Another nice debugging technique is commenting out code. Once the scalability limit disappears you know what code caused it.

5
  • I tried setting concurrent server GC but no success yet. No locking in A() Jul 7, 2016 at 12:44
  • Did you try the debugger technique?
    – usr
    Jul 7, 2016 at 12:49
  • Trying that, but no success so far and for some reason I cannot share what A() contains. Jul 7, 2016 at 16:50
  • So what happened when you tried it? What did you see? What were the threads doing?
    – usr
    Jul 7, 2016 at 17:08
  • 2
    It worked finally. Earlier I tried <gcConcurrent enabled="true"/> and it has no effect. Then I tried setting '<gcServer enabled="true"/>' and it worked perfect fine. Thanks a lot @usr! Jul 8, 2016 at 4:28

Your Answer

Reminder: Answers generated by Artificial Intelligence tools are not allowed on Stack Overflow. Learn more

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.