science/massxpert: Fix two logical errors (found by gcc5)

There were two boolean logic issues found by gcc5 when compiling
massxpert. One was comparing boolean output to a negative integer
(is always false) and the other applied the "not" operator in the wrong
place. Fix provided per request by maintainer.

PR: 197823