The explanation to your first question, why your LINQ query re-runs every time it's iterated over
is because of Linq
's deferred execution.
This line just declares the linq exrpession and does not execute it:
var linqLIST = aArray.Where(x => x == "a");
and this is where it gets executed:
foreach (var arrItem in aArray)
and
Console.WriteLine(linqList.Count());
An explict call ToList()
would run the Linq
expression immediately. Use it like this:
var linqList = aArray.Where(x => x == "a").ToList();
Regarding the edited question:
Of course, the Linq
expression is evaluated in every foreach iteration. The issue is not the Count()
, instead every call to the LINQ expression re-evaluates it. As mentioned above, enumerate it to a List
and iterate over the list.
Late edit:
Concerning @Eric Lippert's critique, I will also refer and go into detail for the rest of the OP's questions.
//Why does this only print out 2 a's and 2 b's, rather than 4 b's?
In the first loop iteration i = 3
, so after aArray[3] = "b";
your array will look like this:
{ "a", "a", "a", "b" }
In the second loop iteration i
(--) has now the value 2 and after executing aArray[i] = "b";
your array will be:
{ "a", "a", "b", "b" }
At this point, there are still a
's in your array but the LINQ
query returns IEnumerator.MoveNext() == false
and as such the loop reaches its exit condition because the IEnumerator
internally used, now reaches the third position in the index of the array and as the LINQ
is re-evaluated it doesn't match the where x == "a"
condition any more.
Why am I able to change what I'm looping over as I'm looping over it?
You are able to do so because the build in code analyser in Visual Studio
is not detecting that you modify the collection within the loop. At runtime the array is modified, changing the outcome of the LINQ
query but there is no handling in the implementation of the array iterator so no exception is thrown.
This missing handling seems by design, as arrays are of fixed size oposed to lists where such an exception is thrown at runtime.
Consider following example code which should be equivalent with your initial code example (before edit):
using System;
using System.Linq;
namespace MyTest {
class Program {
static void Main () {
var aArray = new string[] {
"a", "a", "a", "a"
};
var iterationList = aArray.Where(x => x == "a").ToList();
foreach (var item in iterationList)
{
var index = iterationList.IndexOf(item);
iterationList.Remove(item);
iterationList.Insert(index, "b");
}
foreach (var arrItem in aArray)
{
Console.WriteLine(arrItem);
}
Console.ReadKey();
}
}
}
This code will compile and iterate the loop once before throwing an System.InvalidOperationException
with the message:
Collection was modified; enumeration operation may not execute.
Now the reason why the List
implementation throws this error while enumerating it, is because it follows a basic concept: For
and Foreach
are iterative control flow statements that need to be deterministic at runtime. Furthermore the Foreach
statement is a C#
specific implementation of the iterator pattern, which defines an algorithm that implies sequential traversal and as such it would not change within the execution. Thus the List
implementation throws an exception when you modify the collection while enumerating it.
You found one of the ways to modify a loop while iterating it and re-eveluating it in each iteration. This is a bad design choice because you might run into an infinite loop if the LINQ
expression keeps changing the results and never meets an exit condition for the loop. This will make it hard to debug and will not be obvious when reading the code.
In contrast there is the while
control flow statement which is a conditional construct and is ment to be non-deterministic at runtime, having a specific exit condition that is expected to change while execution.
Consider this rewrite base on your example:
using System;
using System.Linq;
namespace MyTest {
class Program {
static void Main () {
var aArray = new string[] {
"a", "a", "a", "a"
};
bool arrayHasACondition(string x) => x == "a";
while (aArray.Any(arrayHasACondition))
{
var index = Array.FindIndex(aArray, arrayHasACondition);
aArray[index] = "b";
}
foreach (var arrItem in aArray)
{
Console.WriteLine(arrItem); //Why does this only print out 2 a's and 2 b's, rather than 4 b's?
}
Console.ReadKey();
}
}
}
I hope this should outline the technical background and explain your false expectations.
linqLIST
is a deferred executed filtering of theaArray
array. Contrary to the name, it is not a list, so if you've read that changing a list while iterating over it is not allowed, will throw an exception, this does not necessarily apply here. Since the array has no way of informing the lazily evaluated enumerator about changes inside, the enumerator will not stop working, instead, as it gets to each item it will filter it depending on the predicate. If the elements change underneath it, this will impact filtering items not yet filtered..Count()
will in fact force an evaluation, every time, which is why it keeps changing..Count()
in this case keeps changing? 3) Does a LINQ query re-run every time you iterate over it? (short answer: yes, which probably should answer all the other questions combined) 4) How does foreach really work?