50

can anyone explain what is load buffer and how it's different from invalidation queues. and also difference between store buffers and write combining buffers? The paper by Paul E Mckenny http://www.rdrop.com/users/paulmck/scalability/paper/whymb.2010.07.23a.pdf explains very nicely about the store buffers and invalidation queues but unfortunately doesn't talk about write combining buffers

2

1 Answer 1

52

An invalidate queue is more like a store buffer, but it's part of the memory system, not the CPU. Basically it is a queue that keeps track of invalidations and ensures that they complete properly so that a cache can take ownership of a cache line so it can then write that line. A load queue is a speculative structure that keeps track of in-flight loads in the out of order processor. For example, the following can occur

  1. CPU speculatively issue a load from X
  2. That load was in program order after a store to Y, but the address of Y is not resolved yet, so the store does not proceed.
  3. Y is resolved and it turns out to be equal to X. At the time that the store to Y is resolved, that store searches the load queue for speculative loads that have issued, but are present after the store to Y in program order. It will notice the load to X (which is equal to Y) and have to squash those instructions starting with load X and following.

A store buffer is a speculative structure that exists in the CPU, just like the load queue and is for allowing the CPU to speculate on stores. A write combining buffer is part of the memory system and essentially takes a bunch of small writes (think 8 byte writes) and packs them into a single larger transaction (a 64-byte cache line) before sending them to the memory system. These writes are not speculative and are part of the coherence protocol. The goal is to save bus bandwidth. Typically, a write combining buffer is used for uncached writes to I/O devices (often for graphics cards). It's typical in I/O devices to do a bunch of programming of device registers by doing 8 byte writes and the write combining buffer allows those writes to be combined into larger transactions when shipping them out past the cache.

16
  • 35
    I just noticed the question, and was going to answer it - heck, I invented Intel's write combining and load buffers, or at least my name is on many of the patents - but the answer above is perfectly fine.
    – Krazy Glew
    Jun 22, 2012 at 18:41
  • 10
    Store buffers = not always speculative, not always inside CPU. There may be store buffers outside the CPU, e.g. between write through L1 and L2.
    – Krazy Glew
    Jun 22, 2012 at 19:03
  • 13
    Load buffers (1) hold loads after load-addresses have been calculated, but until the load is really ready to execute; or, after you tried to execute a load, but determined that there was a problem, like a cache miss or an earlier store to the same address that is not yet data ready. (2) can be used to verify that the out-of-order loads are correctly speculated, as Martin describes.
    – Krazy Glew
    Jun 22, 2012 at 19:06
  • 9
    I prefer the term "snoop queue" or "probe queue" to McKinney's "invalidation queue", because the last refers to only one particular type, albeit the most common. E.g. it doesn't apply to update protocols. Anyway, Nathan is right, in that invalidations or snoops or probes most importantly reflect stores done by other processors in the system, that your processor needs to see.
    – Krazy Glew
    Jun 22, 2012 at 19:11
  • 10
    Write combining buifferrs are used to combine multiple small writes into bigger writes. Intel's WC buffers are very similar to fill buffers, are cache line sized, etc. They are buffers because they may be filled out of order, at least for the WC memory type. (They may be filled strictly in order for other memory types.)
    – Krazy Glew
    Jun 22, 2012 at 19:13

Your Answer

Reminder: Answers generated by Artificial Intelligence tools are not allowed on Stack Overflow. Learn more

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.