Add another check for a flavor passed attached to the port directory.
Without this fix, the default flavor was built in specific situations.

Approved by: antoine (implicit)