Most people seem to prefer declaration-site variance, because it makes it easier for users of the library (while making it a bit harder for the library developer, although I would argue that the library developer has to think about variance regardless of where the variance is actually written.)
But keep in mind, that neither Java nor C# are examples of good language design.
While Java got variance right and working independently of the JVM because of compatible VM improvements in Java 5 and type-erasure, the use-site variance makes usage a bit cumbersome and the particular implementation of type-erasure has drawn well-deserved criticism.
C#'s model of declaration-site variance takes the burden away from the user of the library, but during their introduction of reified generics they basically built the variance rules into the their VM.
Even today they can't fully support co-/contravariance because of this mistake (and the non backward-compatible introduction of the reified collection classes has split the programmers into two camps).
This poses a difficult restriction on all languages targeting the CLR and is one reason why alternative programming languages are much more lively on the JVM although it seems that the CLR has "much nicer features".
Let's look at Scala: Scala is an fully object-oriented, functional hybrid running on the JVM.
They use type erasure like Java, but both the implementation of Generics and the (declaration-site) variance are easier to understand, more straightforward and powerful than Java's (or C#'s), because the VM doesn't impose rules on how variance has to work. The Scala compiler checks the variance notations and can reject unsound source code at compile time instead of throwing exceptions at runtime, while the resulting .class files can seamlessly be used from Java.
One disadvantage of declaration site variance is that it seems to make type inference harder in some cases.
At the same time Scala can use primitive types without boxing them in collections like in C# by using the @specialized
annotation which tells the Scala compiler to generate one or multiple additional implementations of a class or method specialized to the requested primitive type.
Scala can also "almost" reify generics by using Manifests which allows them to retrieve the generic types at runtime like in C#.