Page MenuHomeFreeBSD

cxgbe(4): Allow a T6 adapter to switch between TOE and KTLS mode.

Authored by np on Mar 16 2021, 7:18 PM.
Referenced Files
Unknown Object (File)
Dec 4 2022, 8:58 AM
Unknown Object (File)
Dec 2 2022, 12:58 PM



The hw.cxgbe.kern_tls tunable was used for this in the past and if it
was set then all T6 adapters would be configured for KTLS operation and
could not be reconfigured for TOE without a reload. With this change
ifconfig can be used to manipulate toe and txtls caps like any other
caps and will configure the hardware appropriately. hw.cxgbe.kern_tls
continues to work as usual but its effects are not permanent any more.

  • Enable nic_ktls_ofld in the default configuration file and use the firmware instead of direct register manipulation to apply/rollback KTLS configuration. This allows the driver to switch the hardware between TOE and KTLS mode in a safe manner. Note that the configuration is adapter-wide and not per-port.
  • Remove the kern_tls config file as it works with 100G T6 cards only and leads to firmware crashes with 25G cards. The configurations included with the driver (with the exception of the FPGA configs) are supposed to work with all adapters.

Reported by: Veeresh U.K. at Chelsio
MFC after: 2 weeks
Sponsored by: Chelsio Communications

Diff Detail

rG FreeBSD src repository
Lint Not Applicable
Tests Not Applicable

Event Timeline

np requested review of this revision.Mar 16 2021, 7:18 PM

Generally looks good to me. Nice to have this runtime togglelable now. I assume the minimum FW version we require now supports the new feature?


Maybe call it "NIC TLS" rather than KTLS since TOE TLS is also KTLS?

np marked an inline comment as done.

"NIC TLS" instead of "KTLS" in the message as suggested by jhb@.

I would use "NIC TLS" in a few more messages to be consistent.

This revision is now accepted and ready to land.Mar 25 2021, 4:52 PM

I should really add a TLS section to cxgbe(4) as well the talks about TOE TLS vs NIC TLS. It's on my todo list, just haven't done it yet :(

np marked 3 inline comments as done.Mar 25 2021, 7:42 PM