libmagic: Unbreak for older FreeBSD releases.

byteswap.h is introduced in FreeBSD 13.2 but was not available in
earlier versions. In order to support upgrading from an earlier
FreeBSD release we would need to tell the build system that fact.

PR: bin/273736
Reported by: philip
MFC after: 3 days