test/libalias: Tests instantiation

[donner]

Summary

In order to modify libalias for performance, the existing functionality must not change.

This review is only a starter of the larger set of functional tests which needs to be upheld during the upcoming development. More test cases will come in further reviews.

I'll keep the review small enough to be readable by an external person and hence the commits small enough to not disturb the developer community.

Test Plan

$ make test
1_instance:1_singleinit  ->  passed  [0.003s]
1_instance:2_destroynull  ->  expected_failure: Code expects valid pointer.  [0.013s]
1_instance:3_multiinit  ->  passed  [0.005s]
1_instance:4_multiinstance  ->  passed  [0.038s]
4/4 passed (0 failed)

[donner]

Start as simple as possible and fail ...

[/usr/tests/sys/netinet/libalias]$ kyua list
aliasdb_test:__test_cases_list__

But calling directly works:

$ /usr/tests/sys/netinet/libalias/aliasdb_test -l
Content-Type: application/X-atf-tp; version="1"

ident: init
has.cleanup: true
desc: Create an instance

and

$ /usr/tests/sys/netinet/libalias/aliasdb_test init
aliasdb_test: WARNING: Running test cases outside of kyua(1) is unsupported
aliasdb_test: WARNING: No isolation nor timeout control is being applied; you may get unexpected failures; see atf-test-case(4)
(null)
(null)
(null)
(null)
(null)
(null)
passed

Ah, btw: Is there a possibilty to run it as a user without installing it?

[donner]

• Simplify the test

[donner]

• Remove unnecessary static

[donner]

Ah, kyua report shows:

aliasdb_test:__test_cases_list__  ->  broken: Unknown test case metadata property 'desc'  [0.001s]

[donner]

• Fix meta data. => Now it works.

[donner]

• Add test to recreate an instance multiple time.

[donner]

• Test to create many instances and remove them in random order.

[donner]

• Add a test for a known API violation.

[donner]

• Make the tests work directly on the intermediate builds.

[kp]

I think you're also missing a makefile hookup somewhere. These tests may want to live in /usr/src/tests/sys/netinet/libalias instead, but I don't hold strong views on that.

sys/netinet/libalias/tests/Makefile

14 ↗

(On Diff #89343)

That probably wants ${.OBJDIR}

sys/netinet/libalias/tests/aliasdb_test.c

8 ↗

(On Diff #89343)

I wonder if it's worth printing the random seed somewhere, or even using a fixed seed. If this triggers a bug it may end up being nondeterministic (and thus difficult to debug).

[donner]

• Use OBJDIR
• Make random reproducable.
• Inspect kyua reports

[donner]

• Replace preprocessor constants by compiler generated values.

[donner]

• Renumber the test cases and rename the file according to scope

[donner]

In D30307#680794, @kp wrote:

I think you're also missing a makefile hookup somewhere. These tests may want to live in /usr/src/tests/sys/netinet/libalias instead, but I don't hold strong views on that.

libalias is primary sourced in sys/netinet/libalias. The userspace variant is symlinked into lib/libalias.
That's why I'd keep the tests at the real source.

Any objections?

[kp]

In D30307#680887, @donner wrote:

Any objections?

No, my views on the subject are very weak. I would like to see this test hooked into the build system though, so it gets built and installed as part of build/install world.

[donner]

• Move location of test dir and update build procedure

[donner]

• Add to global build.

[donner]

• Fix build process

[donner]

• Fix spelling