FreeBSD test suite
ClosedPublic
Actions

Authored by ngie on Mar 11 2019, 11:54 PM.

Details

Reviewers

asomers
emaste
jtl

Commits

rS345203: Initial googlemock/googletest integration into the build/FreeBSD test suite

Summary

This initial integration takes googlemock/googletest release 1.8.1, integrates
the library, tests, and sample unit tests into the build.

googlemock/googletest’s inclusion is optionally available via MK_GOOGLETEST. MK_GOOGLETEST is dependent on
MK_TESTS and is enabled by default when built with a C++11 capable toolchain.

Google tests can be specified via the GTESTS variable, which, in comparison
with the other test drivers, is more simplified/streamlined, as Googletest only supports C++ tests; not raw C or shell tests (C tests can be written in C++ using the standard embedding methods).

No dependent libraries are assumed for the tests. One must specify gmock,
gmock_main, gtest, or gtest_main, via LIBADD for the program.

More information about googlemock and googletest can be found on the
Googletest project page and the
GoogleMock
and
GoogleTest
docs.

These tests are originally integrated into the build as plain driver tests, but
will be natively integrated into Kyua in a later version.

Known issues/Errata:

WhenDynamicCastToTest.AmbiguousCast fails on FreeBSD

Test Plan

I have run all of the integration tests successfully, minus
WhenDynamicCastToTest.AmbiguousCast. I have marked the testcase as an
expected failure, so it does not affect the overall test suite result.

Diff Detail

Repository

rS FreeBSD src repository - subversion

Lint

Lint Passed

Unit

No Test Coverage

Build Status

Buildable 23024
Build 22096: arc lint + arc unit

Event Timeline

ngie created this revision.Mar 11 2019, 11:54 PM

Herald added subscribers: imp, bdrewery. · View Herald TranscriptMar 11 2019, 11:54 PM

Harbormaster completed remote builds in B23021: Diff 54950.Mar 11 2019, 11:54 PM

ngie mentioned this in D19552: Integrate cddl/usr.sbin/zfds/tests into the FreeBSD test suite.Mar 12 2019, 12:10 AM

asomers added inline comments.Mar 12 2019, 12:43 AM

share/mk/Makefile
76	Should these files be conditionalized on MK_GOOGLETEST?
share/mk/googletest.test.inc.mk
10	Why do you have to specify `-std=c++11`? What happens if you don't? Clang defaults to the gnu++14. With this in there, I have to manually add `-std=c++14` to my own makefile.
tools/build/options/WITHOUT_GOOGLETEST
1–2	s/not/neither/g

ngie mentioned this in rS345045: Adjust code based on comments from @asomers in D19551.Mar 12 2019, 1:12 AM

ngie marked 2 inline comments as done.Mar 12 2019, 1:16 AM

ngie added a subscriber: dim.

ngie added inline comments.

share/mk/Makefile
76	If I do, it would introduce unnecessary complexity and dependencies on src.opts.mk, and make it impossible for others to use bsd.test.mk in ports, etc :/...
share/mk/googletest.test.inc.mk
10	googletest compiles with `-std=c++11` right now. I will made this optional via `CXXSTD`, like I suggested to @dim a while (2 years or so) ago, and will work on shuffling the value/flag setting over to bsd.sys.mk, etc.

Update based on comments from @asomers

Harbormaster completed remote builds in B23024: Diff 54954.Mar 12 2019, 1:16 AM

asomers added inline comments.Mar 12 2019, 2:53 PM

share/mk/Makefile
76	Makes sense.
share/mk/googletest.test.inc.mk
10	Are you saying that googletest itself requires `-std=c++11`? or that any googletest client needs c++11 at a minimum?

ngie added inline comments.Mar 12 2019, 3:01 PM

share/mk/googletest.test.inc.mk
10	Mostly the latter, however, newer versions of the spec might break functionality developed and tested with c++11 (very unlikely, but possible).

asomers added inline comments.Mar 12 2019, 3:08 PM

share/mk/googletest.test.inc.mk
10	Ok, but why put it in this file instead of bsd.sys.mk ?

ngie edited the summary of this revision. (Show Details)Mar 12 2019, 3:10 PM

ngie marked an inline comment as done.Mar 12 2019, 3:13 PM

ngie added inline comments.

share/mk/googletest.test.inc.mk
10	I hadn’t gotten around to figuring out the appropriate format for putting it in there. I’ll work on it in parallel with this though.

ngie marked an inline comment as done.Mar 12 2019, 3:26 PM

ngie added inline comments.

share/mk/googletest.test.inc.mk
10	The reason why this matters is that PowerPC and mips are both still built with gcc 4.2.1, which will require a lower language spec version than clang and not all versions of clang support the C++11 spec.