newfs_msdos: Improve error messages

• Report overly long OEM string as too long, not just "bad".

• Use warn instead of warnx for open or ftruncate failure to report the

error string.

Reviewed by: se
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D53649