Use CFLAGS instead of CXXFLAGS for -fvisibility=default

This code doesn't have C++ sources; only C sources. Use CFLAGS instead.