Error out when the endian is not known.

[imp]

Summary

We should never hit this case, but error out if the endian isn't
1234 or 4321. When that happens, we enable neither endian mode
in the sources.

Test Plan

this is more of an assert than anything else.

[imp]

Dropping this. With other changes to the series, this isn't needed.