Don't add X libraries to the nox11 ports [1]

While here fix USE_GNOME in the SVG case to add to the USE_GNOME macro
and not overwrite it.

PR: 211721 [1]
Reported by: Gary (freebsd-bugzilla@in-addr.com)
Pointy hat to: kwm@