HomeFreeBSD

libc: fix undefined behavior from signed overflow in strstr and memmem

Description

libc: fix undefined behavior from signed overflow in strstr and memmem

unsigned char promotes to int, which can overflow when shifted left by
24 bits or more. this has been reported multiple times but then
forgotten. it's expected to be benign UB, but can trap when built with
explicit overflow catching (ubsan or similar). fix it now.

note that promotion to uint32_t is safe and portable even outside of
the assumptions usually made in musl, since either uint32_t has rank
at least unsigned int, so that no further default promotions happen,
or int is wide enough that the shift can't overflow. this is a
desirable property to have in case someone wants to reuse the code
elsewhere.

musl commit: 593caa456309714402ca4cb77c3770f4c24da9da

Obtained from: musl

(cherry picked from commit 33482dae89c26158a22ccb3b7f2ca6e6652f29b4)

Details

Provenance
emasteAuthored on Nov 19 2020, 12:03 AM
Parents
rG13bc5a7358e5: libc: optimize memmem two-way bad character shift
Branches
Unknown
Tags
Unknown