I'm developing a computational fluid dynamics (CFD) code using CUDA. As I am doing some speedup tests on a single Tesla K40 GPU (comparing to Intel Xeon E5 v2 CPU) for different problem sizes, the GPU shows higher speedup by increasing the problem size. For instance, I get a speedup by a factor of ~1.5x for ~1 million elements while it improves to ~11x for 10 million elements.
I don't have any idea that theoretically what causes the higher performance for larger problems? Actually, this is also the case which I have seen in many scientific (especially fluid mechanics) applications running on GPU. (I was wondering if something such as kernel overhead, latency, etc. are affected?)
Thanks for any answer or comment!
PS: By speedup, I mean the ratio of the execution time of GPU code to the execution time of CPU version. Actually, I increase the problem size in both versions (and of course apply same problem size for both in each comparison test) and recalculate the speedup for the corresponding problem size.