Revert libm functions.

These require -lm but by caching a 'yes' value some ports fail to add -lm
properly, such as x11-toolkits/vte3.