libm: Correct some typos in source code comments

• s/modfied/modified/
• s/minimun/minimum/

While here, fix some mandoc warnings:

• whitespace at end of input line
• unusual Xr punctuation
• missing comma before name

Obtained from: NetBSD
MFC after: 5 days