Page MenuHomeFreeBSD

replace cosqos field in pkthdr with a numa domain tag
ClosedPublic

Authored by gallatin on Apr 9 2019, 3:43 PM.
Tags
None
Referenced Files
Unknown Object (File)
Dec 11 2024, 9:22 PM
Unknown Object (File)
Dec 4 2024, 9:44 PM
Unknown Object (File)
Dec 4 2024, 5:08 PM
Unknown Object (File)
Dec 4 2024, 5:08 PM
Unknown Object (File)
Dec 4 2024, 5:08 PM
Unknown Object (File)
Dec 4 2024, 4:48 PM
Unknown Object (File)
Nov 24 2024, 10:48 AM
Unknown Object (File)
Nov 22 2024, 2:06 PM
Subscribers

Details

Summary

Andre added a cosqos field to the pkthdr almost 6 years ago in r254804. This field is still unused by any in-tree consumers. I want to grab this field now for upcoming Numa work in the network stack.

I have a patchset that I'm working on which aligns many resources by numa domain, including inps, inpcb lb group, tcp pacing, lagg output link selection, etc. This work relies on being able to store the numa domain in the mbuf, so I want to grab this field for this use now before somebody else notices that it is unused and uses it for something else.

Note that the patchset which needs this cuts QPI traffic cross-domain traffic by roughly 50% (40% -> 20%). It also increase throughput by 35% on dual-socket Intel Cascade Lake based Xeons, and 75% on single-socket AMD Epyc. This is for a Netflix web workload, with all traffic being sent via sendfile().

Diff Detail

Repository
rS FreeBSD src repository - subversion
Lint
Lint Not Applicable
Unit
Tests Not Applicable