These are the main related topics:
- Networking
- Disk I/O
- Concurrency
- Scaling
- High availability and fault tolerance
For networking: Stevens' Unix network programming bible is a very good starting point (if you mix it with his TCP Illustrated book you will also get a deep understanding of the topic), but after that you have to dig the net for recent articles.
I personally found that the best sources for fast applications (>1k concurrent clients, heavy disk i/o, caching, concurrency, MVCC, locking and synchronizing, lock free algorithms and data structures, scalable systems) are on the net, mainly blogs and collected articles. Digging into the source code of some cool open source projects is also invaluable.
As I said that's my experience but I would like to here about any really good books covering one or more of these topics.