98

I'm trying to run multiple functions that connect to a remote site (by network) and return a generic list. But I want to run them simultaneously.

For example:

public static List<SearchResult> Search(string title)
{
    //Initialize a new temp list to hold all search results
    List<SearchResult> results = new List<SearchResult>();

    //Loop all providers simultaneously
    Parallel.ForEach(Providers, currentProvider =>
    {
        List<SearchResult> tmpResults = currentProvider.SearchTitle((title));

        //Add results from current provider
        results.AddRange(tmpResults);
    });

    //Return all combined results
    return results;
}

As I see it, multiple insertions to 'results' may happend at the same time... Which may crash my application.

How can I avoid this?

2
  • Which .NET version are you using?
    – sll
    Nov 3, 2011 at 20:57
  • 4
    It would have to be at least .Net 4; Parallel was introduced there.
    – Matt Mills
    Nov 3, 2011 at 20:58

5 Answers 5

169

You can use a concurrent collection.

The System.Collections.Concurrent namespace provides several thread-safe collection classes that should be used in place of the corresponding types in the System.Collections and System.Collections.Generic namespaces whenever multiple threads are accessing the collection concurrently.

You could for example use ConcurrentBag since you have no guarantee which order the items will be added.

Represents a thread-safe, unordered collection of objects.

2
  • Yes, this is the actual answer. You'll get better performance (generally) with concurrent collections.
    – lkg
    May 24, 2017 at 16:54
  • 1
    A ConcurrentQueue<T> might be preferable to a ConcurrentBag<T>, because the former preserves the insertion order. The ConcurrentBag<T> is an extremely specialized collection intended for mixed producer consumer scenarios, and adding items in parallel (without taking items from the collection) is not such a scenario. Mar 28, 2022 at 20:40
70
//In the class scope:
Object lockMe = new Object();    

//In the function
lock (lockMe)
{    
     results.AddRange(tmpResults);
}

Basically a lock means that only one thread can have access to that critical section at the same time.

7
  • 1
    But what will happend if WHILE those results are being added the results from another provider try to add to? will they FAIL or WAIT until possible?
    – shaharmor
    Nov 3, 2011 at 20:58
  • 4
    When there's a lock, the thread will wait until it can get the lock.
    – Haedrian
    Nov 3, 2011 at 20:59
  • 8
    A minor point: this is not the safest choice for the lock object. Better to use a special private object: lock(resultsLock) .
    – H H
    Nov 3, 2011 at 21:28
  • 2
    locks can slow down the overall execution time though.. concurrent collections seem better to avoid that
    – Piotr Kula
    Mar 29, 2017 at 14:17
  • 1
    Why do we need a lock at class level if the object modified is declared locally ? If we lock(results) and then add to it what is wrong ? Lock at class level means, if multiple requests are calling Search then you have degraded the performance
    – Frank Q.
    May 17, 2018 at 20:44
43

For those who prefer code:

public static ConcurrentBag<SearchResult> Search(string title)
{
    var results = new ConcurrentBag<SearchResult>();
    Parallel.ForEach(Providers, currentProvider =>
    {
        results.Add(currentProvider.SearchTitle((title)));
    });

    return results;
}
1
  • 1
    Have to use a loop: foreach (var item in currentProvider.SearchTitle((title))) results.Add(item); Jul 10, 2020 at 19:56
26

The Concurrent Collections are new for .Net 4; they are designed to work with the new parallel functionality.

See Concurrent Collections in the .NET Framework 4:

Before .NET 4, you had to provide your own synchronization mechanisms if multiple threads might be accessing a single shared collection. You had to lock the collection ...

... the [new] classes and interfaces in System.Collections.Concurrent [added in .NET 4] provide a consistent implementation for [...] multi-threaded programming problems involving shared data across threads.

16

This could be expressed concisely using PLINQ's AsParallel and SelectMany:

public static List<SearchResult> Search(string title)
{
    return Providers.AsParallel()
                    .SelectMany(p => p.SearchTitle(title))
                    .ToList();
}
2
  • linq selectMany is great, sadly linq is slower than normal foreach. :( Jun 7, 2018 at 18:32
  • 9
    Don't micro-optimize. The OP implied that SearchTitle connects to a remote site. Its latency will be several orders of magnitude slower than the difference between LINQ and foreach.
    – Douglas
    Jun 8, 2018 at 19:21

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.