Add user facing errors for exceeding process memory limits

Previously the process terminating with SIGABRT at startup was the
only notification.

PR: 200617
Reviewed by: kib
Sponsored by: The FreeBSD Foundation
Differential Revision: https://reviews.freebsd.org/D2731