Page MenuHomeFreeBSD

On arm64 disable three tests that hang or panic
ClosedPublic

Authored by emaste on Aug 13 2015, 9:30 PM.

Details

Reviewers
ngie
Group Reviewers
Restricted Project
Commits
rS286863: On arm64 disable three tests that hang or panic
Summary

PR: 202304, 202305, 202307

Diff Detail

Repository
rS FreeBSD src repository - subversion
Lint
Automatic diff as part of commit; lint not applicable.
Unit
Automatic diff as part of commit; unit tests not applicable.

Event Timeline

emaste retitled this revision from to On arm64 disable three tests that hang or panic.
emaste updated this object.
emaste edited the test plan for this revision. (Show Details)
emaste added a reviewer: Restricted Project.
emaste added a subscriber: arm64.

I expect the issues to be fixed in short order, but would like to commit the workarounds in the interim.

With this change kyua test in /usr/tests on arm64 looks like:

Results file id is usr_tests.20150813-210833-593107
Results saved to /root/.kyua/store/results.usr_tests.20150813-210833-593107.db

4278/4346 passed (68 failed)
ngie edited edge metadata.
This revision is now accepted and ready to land.Aug 17 2015, 10:26 PM
ngie added a subscriber: markj.
In D3378#68886, @emaste wrote:

With this change kyua test in /usr/tests on arm64 looks like:

Results file id is usr_tests.20150813-210833-593107
Results saved to /root/.kyua/store/results.usr_tests.20150813-210833-593107.db

4278/4346 passed (68 failed)

Do you have a list of the tests that fail posted somewhere? I've only been able to test on amd64/i386 because of lack of hardware/emulators.

In D3378#69532, @ngie wrote:

Do you have a list of the tests that fail posted somewhere? I've only been able to test on amd64/i386 because of lack of hardware/emulators.

QEMU supports arm64 and we have snapshot builds available in the usual place, but there are a few WIP changes not yet committed to head still so it's a bit tricky to reproduce at the moment.

Here are the failures reported by kyua report:

===> Failed tests
bin/pkill/pkill-j_test:main  ->  failed: 1 tests of 3 failed  [11.337s]
lib/libc/ssp/ssp_test:vsnprintf  ->  failed: atf-check failed; see the output of the test for details  [1.019s]
lib/libc/ssp/ssp_test:vsprintf  ->  failed: atf-check failed; see the output of the test for details  [1.024s]
lib/libc/sys/getlogin_test:setlogin_err  ->  failed: expected EINVAL, but the call succeeded  [0.172s]
lib/libc/sys/stat_test:stat_socket  ->  failed: /tank/emaste/src/freebsd-arm64/contrib/netbsd-tests/lib/libc/sys/t_stat.c:358: Expected errno 36, got 61, in connect(fd, (struct sockaddr *)&addr, sizeof(struct sockaddr_in)) == -1  [0.168s]
lib/libc/tls/tls_dlopen_test:t_tls_dlopen  ->  failed: 27 checks failed; see output for more details  [0.203s]
lib/libc/tls/tls_dynamic_test:t_tls_dynamic  ->  failed: 25 checks failed; see output for more details  [0.207s]
local/atf/atf-c++/atf_c++_test:include  ->  failed: Header check failed; atf-c++.hpp is not self-contained  [0.279s]
local/atf/atf-c++/check_test:build_c_o  ->  failed: Line 198: atf::utils::grep_file("test.c", "stderr") not met  [0.612s]
local/atf/atf-c++/check_test:build_cpp  ->  failed: atf-c/utils.c:309: (fd = open(file, O_RDONLY)) != -1 not met  [0.334s]
local/atf/atf-c++/check_test:build_cxx_o  ->  failed: Line 239: atf::utils::grep_file("test.cpp", "stderr") not met  [0.642s]
local/atf/atf-c++/macros_test:use  ->  failed: Build of macros_hpp_test.cpp failed; some macros in atf-c++/macros.hpp are broken  [0.268s]
local/atf/atf-c/atf_c_test:include  ->  failed: Header check failed; atf-c.h is not self-contained  [0.214s]
local/atf/atf-c/check_test:build_c_o  ->  failed: 2 checks failed; see output for more details  [0.517s]
local/atf/atf-c/check_test:build_cpp  ->  failed: atf-c/utils.c:309: (fd = open(file, O_RDONLY)) != -1 not met  [0.263s]
local/atf/atf-c/check_test:build_cxx_o  ->  failed: 2 checks failed; see output for more details  [0.563s]
local/atf/atf-c/macros_test:use  ->  failed: Build of macros_h_test.c failed; some macros in atf-c/macros.h are broken  [0.209s]
local/atf/atf-c/pkg_config_test:build  ->  failed: atf-check failed; see the output of the test for details  [1.909s]
local/kyua/integration/cmd_db_migrate_test:already_up_to_date  ->  failed: atf-check failed; see the output of the test for details  [2.135s]
local/kyua/integration/cmd_db_migrate_test:need_upgrade  ->  failed: atf-check failed; see the output of the test for details  [2.055s]
local/kyua/integration/cmd_db_migrate_test:upgrade__from_v1  ->  failed: atf-check failed; see the output of the test for details  [1.949s]
local/kyua/integration/cmd_db_migrate_test:upgrade__from_v2  ->  failed: atf-check failed; see the output of the test for details  [1.956s]
local/kyua/testers/fs_test:cleanup__mount_point__busy  ->  failed: testers/fs_test.c:204: EXIT_SUCCESS != WEXITSTATUS(status)  [0.266s]
local/kyua/testers/fs_test:cleanup__mount_point__links  ->  failed: testers/fs_test.c:204: EXIT_SUCCESS != WEXITSTATUS(status)  [0.255s]
local/kyua/testers/fs_test:cleanup__mount_point__nested  ->  failed: testers/fs_test.c:204: EXIT_SUCCESS != WEXITSTATUS(status)  [0.266s]
local/kyua/testers/fs_test:cleanup__mount_point__overlayed  ->  failed: testers/fs_test.c:204: EXIT_SUCCESS != WEXITSTATUS(status)  [0.264s]
local/kyua/testers/fs_test:cleanup__mount_point__simple  ->  failed: testers/fs_test.c:204: EXIT_SUCCESS != WEXITSTATUS(status)  [0.253s]
local/kyua/testers/fs_test:unmount__ok  ->  failed: testers/fs_test.c:204: EXIT_SUCCESS != WEXITSTATUS(status)  [0.244s]
local/kyua/utils/sqlite/statement_test:column_double  ->  failed: Line 247: 0.5 != stmt.column_double(1) (0.5 != 3.43597e+09)  [0.305s]
local/kyua/utils/sqlite/statement_test:safe_column_double__ok  ->  failed: Line 369: 0.5 != stmt.safe_column_double("b") (0.5 != 3.43597e+09)  [0.298s]
usr.bin/lastcomm/legacy_test:main  ->  failed: 4 tests of 6 failed  [1.538s]
usr.bin/mkimg/mkimg:apm_1x1_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.937s]
usr.bin/mkimg/mkimg:apm_1x1_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.802s]
usr.bin/mkimg/mkimg:apm_63x255_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.812s]
usr.bin/mkimg/mkimg:apm_63x255_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.831s]
usr.bin/mkimg/mkimg:bsd_1x1_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.867s]
usr.bin/mkimg/mkimg:bsd_1x1_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.918s]
usr.bin/mkimg/mkimg:bsd_63x255_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.886s]
usr.bin/mkimg/mkimg:bsd_63x255_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.908s]
usr.bin/mkimg/mkimg:ebr_1x1_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.246s]
usr.bin/mkimg/mkimg:ebr_1x1_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.297s]
usr.bin/mkimg/mkimg:ebr_63x255_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.313s]
usr.bin/mkimg/mkimg:ebr_63x255_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.283s]
usr.bin/mkimg/mkimg:gpt_1x1_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.894s]
usr.bin/mkimg/mkimg:gpt_1x1_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.846s]
usr.bin/mkimg/mkimg:gpt_63x255_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.018s]
usr.bin/mkimg/mkimg:gpt_63x255_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.009s]
usr.bin/mkimg/mkimg:mbr_1x1_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.309s]
usr.bin/mkimg/mkimg:mbr_1x1_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.341s]
usr.bin/mkimg/mkimg:mbr_63x255_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.332s]
usr.bin/mkimg/mkimg:mbr_63x255_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.333s]
usr.bin/mkimg/mkimg:pc98_1x1_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.332s]
usr.bin/mkimg/mkimg:pc98_1x1_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.307s]
usr.bin/mkimg/mkimg:pc98_63x255_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.367s]
usr.bin/mkimg/mkimg:pc98_63x255_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.360s]
usr.bin/mkimg/mkimg:vtoc8_1x1_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.797s]
usr.bin/mkimg/mkimg:vtoc8_1x1_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.753s]
usr.bin/mkimg/mkimg:vtoc8_63x255_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.960s]
usr.bin/mkimg/mkimg:vtoc8_63x255_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.032s]
usr.sbin/sa/legacy_test:main  ->  failed: 12 tests of 13 failed  [3.195s]
This revision was automatically updated to reflect the committed changes.