I have 3 QEMU-KVM VM running on Ubuntu host. Each VM has one virt-io nic and connected by a br0 bridge in host OS. Every NIC's MTU is configured to 1500. This platform runs a message queue based application: one VM as producer, one VM as message queue server and last VM as consumer.
My problem is: When guest VMs become busy, the message queue server VM may ocasually send packet in size 2k, 4k or 5k. It exceed the NIC's MTU value, 1500!!! As I know the Linux IP stack should cut the IP framgments smaller than size of MTU before sending out. Why this VM sends large packet when busy?
Below is the platform's architecture:
[w2: celery caller (message queue producer) ]
| (messages in TCP)
V
[w3: rabbitmq server]
| (messages in TCP)
V
[w4: celeryd (message queue consumer)]
Below is screen captured at w3, MTU is 1500 and sends packet with size > 2000
Below is screen captured at w4, MTU is 1500 and receives packet with size > 2000