Host controller is byte oriented. Fix wrong assumption on big-endian systems.
Pointed out by: hselasky