can anyone explain what is load buffer and how it's different from invalidation queues. and also difference between store buffers and write combining buffers? The paper by Paul E Mckenny http://www.rdrop.com/users/paulmck/scalability/paper/whymb.2010.07.23a.pdf explains very nicely about the store buffers and invalidation queues but unfortunately doesn't talk about write combining buffers
-
1See also Size of store buffers on Intel hardware? What exactly is a store buffer?– Peter CordesMay 10, 2019 at 3:48
-
1Also this more successful (IMO) attempt at describing what a store buffer is and what it does, I think more beginner-friendly.– Peter CordesOct 12, 2020 at 11:45
1 Answer
An invalidate queue is more like a store buffer, but it's part of the memory system, not the CPU. Basically it is a queue that keeps track of invalidations and ensures that they complete properly so that a cache can take ownership of a cache line so it can then write that line. A load queue is a speculative structure that keeps track of in-flight loads in the out of order processor. For example, the following can occur
- CPU speculatively issue a load from X
- That load was in program order after a store to Y, but the address of Y is not resolved yet, so the store does not proceed.
- Y is resolved and it turns out to be equal to X. At the time that the store to Y is resolved, that store searches the load queue for speculative loads that have issued, but are present after the store to Y in program order. It will notice the load to X (which is equal to Y) and have to squash those instructions starting with load X and following.
A store buffer is a speculative structure that exists in the CPU, just like the load queue and is for allowing the CPU to speculate on stores. A write combining buffer is part of the memory system and essentially takes a bunch of small writes (think 8 byte writes) and packs them into a single larger transaction (a 64-byte cache line) before sending them to the memory system. These writes are not speculative and are part of the coherence protocol. The goal is to save bus bandwidth. Typically, a write combining buffer is used for uncached writes to I/O devices (often for graphics cards). It's typical in I/O devices to do a bunch of programming of device registers by doing 8 byte writes and the write combining buffer allows those writes to be combined into larger transactions when shipping them out past the cache.
-
35I just noticed the question, and was going to answer it - heck, I invented Intel's write combining and load buffers, or at least my name is on many of the patents - but the answer above is perfectly fine. Jun 22, 2012 at 18:41
-
10Store buffers = not always speculative, not always inside CPU. There may be store buffers outside the CPU, e.g. between write through L1 and L2. Jun 22, 2012 at 19:03
-
13Load buffers (1) hold loads after load-addresses have been calculated, but until the load is really ready to execute; or, after you tried to execute a load, but determined that there was a problem, like a cache miss or an earlier store to the same address that is not yet data ready. (2) can be used to verify that the out-of-order loads are correctly speculated, as Martin describes. Jun 22, 2012 at 19:06
-
9I prefer the term "snoop queue" or "probe queue" to McKinney's "invalidation queue", because the last refers to only one particular type, albeit the most common. E.g. it doesn't apply to update protocols. Anyway, Nathan is right, in that invalidations or snoops or probes most importantly reflect stores done by other processors in the system, that your processor needs to see. Jun 22, 2012 at 19:11
-
10Write combining buifferrs are used to combine multiple small writes into bigger writes. Intel's WC buffers are very similar to fill buffers, are cache line sized, etc. They are buffers because they may be filled out of order, at least for the WC memory type. (They may be filled strictly in order for other memory types.) Jun 22, 2012 at 19:13