We should never hit this case, but error out if the endian isn't
1234 or 4321. When that happens, we enable neither endian mode
in the sources.

this is more of an assert than anything else.