Page MenuHomeFreeBSD

NUMA policy enhancements
ClosedPublic

Authored by jeff on Mar 25 2018, 1:26 AM.
Tags
None
Referenced Files
Unknown Object (File)
Sun, Nov 23, 4:40 PM
Unknown Object (File)
Fri, Nov 21, 12:40 AM
Unknown Object (File)
Fri, Nov 21, 12:39 AM
Unknown Object (File)
Fri, Nov 21, 12:35 AM
Unknown Object (File)
Wed, Nov 12, 11:57 PM
Unknown Object (File)
Thu, Nov 6, 3:18 AM
Unknown Object (File)
Oct 24 2025, 8:58 PM
Unknown Object (File)
Oct 10 2025, 10:12 AM
Subscribers

Details

Summary

This adds three features to cpuset & domainsets:

  1. a dedicated set for the kernel (#2) so that we can dictate kernel and user policy separately. This also fixed the ugly interrupt root code.
  2. DOMAINSET_POLICY_INTERLEAVE which does something like raid stripes or round-robin with a stride width. This gives much better performance than strict round-robin on the workloads i've tested on. I expect that we can tweak the stride as we learn how this works. Since rr is used as a fallback method when other things don't work I have kept it as a distinct policy.
  3. A sysctl api for experimenting with domainsets on kernel objects and making the domainset_create() api kernel public with error checking. This allows you to put in a domainset 'key' and get back a validated policy that you can actually reference and use.

This also includes some header clean-up and a bug fix to the FIRSTTOUCH policy which allows us to switch it on as the default.

Diff Detail

Repository
rS FreeBSD src repository - subversion
Lint
Lint Skipped
Unit
Tests Skipped

Event Timeline

sys/vm/vm_domainset.c
93

This should be divided by sizeof not mod. Fixed.

Am I right that striding does not account for the initial stride offset of the first allocation ? I.e. if the first allocation comes not from the start of reservation, then stride might spread over two vm_reservs ?

sys/kern/kern_cpuset.c
1156

Use bool for once ?

1343

return ();

sys/vm/vm_domainset.c
85

Add color to pindex for superpages so the stride aligns.

This revision is now accepted and ready to land.Mar 28 2018, 7:19 PM
This revision was automatically updated to reflect the committed changes.