Don't run tests by default in my ports

Yuzu tests frequently time out and didn't find r513863. More
comprehensive tests tend to have extra dependencies and are behind
non-default TEST option, anyway.