On arm64 disable three tests that hang or panic
ClosedPublic
Actions

Authored by emaste on Aug 13 2015, 9:30 PM.

Details

Reviewers

ngie

Group Reviewers

Restricted Project

Commits

rS286863: On arm64 disable three tests that hang or panic

Summary

PR: 202304, 202305, 202307

Diff Detail

Repository

rS FreeBSD src repository - subversion

Lint

Lint Not Applicable

Unit

Tests Not Applicable

Event Timeline

I expect the issues to be fixed in short order, but would like to commit the workarounds in the interim.

With this change kyua test in /usr/tests on arm64 looks like:

Results file id is usr_tests.20150813-210833-593107
Results saved to /root/.kyua/store/results.usr_tests.20150813-210833-593107.db

4278/4346 passed (68 failed)

emaste added a reviewer: ngie.Aug 14 2015, 10:17 PM

ngie accepted this revision.Aug 17 2015, 10:26 PM

ngie edited edge metadata.

This revision is now accepted and ready to land.Aug 17 2015, 10:26 PM

In D3378#68886, @emaste wrote:
With this change kyua test in /usr/tests on arm64 looks like:
Results file id is usr_tests.20150813-210833-593107
Results saved to /root/.kyua/store/results.usr_tests.20150813-210833-593107.db

4278/4346 passed (68 failed)

Do you have a list of the tests that fail posted somewhere? I've only been able to test on amd64/i386 because of lack of hardware/emulators.

In D3378#69532, @ngie wrote:

Do you have a list of the tests that fail posted somewhere? I've only been able to test on amd64/i386 because of lack of hardware/emulators.

QEMU supports arm64 and we have snapshot builds available in the usual place, but there are a few WIP changes not yet committed to head still so it's a bit tricky to reproduce at the moment.

Here are the failures reported by kyua report:

===> Failed tests
bin/pkill/pkill-j_test:main  ->  failed: 1 tests of 3 failed  [11.337s]
lib/libc/ssp/ssp_test:vsnprintf  ->  failed: atf-check failed; see the output of the test for details  [1.019s]
lib/libc/ssp/ssp_test:vsprintf  ->  failed: atf-check failed; see the output of the test for details  [1.024s]
lib/libc/sys/getlogin_test:setlogin_err  ->  failed: expected EINVAL, but the call succeeded  [0.172s]
lib/libc/sys/stat_test:stat_socket  ->  failed: /tank/emaste/src/freebsd-arm64/contrib/netbsd-tests/lib/libc/sys/t_stat.c:358: Expected errno 36, got 61, in connect(fd, (struct sockaddr *)&addr, sizeof(struct sockaddr_in)) == -1  [0.168s]
lib/libc/tls/tls_dlopen_test:t_tls_dlopen  ->  failed: 27 checks failed; see output for more details  [0.203s]
lib/libc/tls/tls_dynamic_test:t_tls_dynamic  ->  failed: 25 checks failed; see output for more details  [0.207s]
local/atf/atf-c++/atf_c++_test:include  ->  failed: Header check failed; atf-c++.hpp is not self-contained  [0.279s]
local/atf/atf-c++/check_test:build_c_o  ->  failed: Line 198: atf::utils::grep_file("test.c", "stderr") not met  [0.612s]
local/atf/atf-c++/check_test:build_cpp  ->  failed: atf-c/utils.c:309: (fd = open(file, O_RDONLY)) != -1 not met  [0.334s]
local/atf/atf-c++/check_test:build_cxx_o  ->  failed: Line 239: atf::utils::grep_file("test.cpp", "stderr") not met  [0.642s]
local/atf/atf-c++/macros_test:use  ->  failed: Build of macros_hpp_test.cpp failed; some macros in atf-c++/macros.hpp are broken  [0.268s]
local/atf/atf-c/atf_c_test:include  ->  failed: Header check failed; atf-c.h is not self-contained  [0.214s]
local/atf/atf-c/check_test:build_c_o  ->  failed: 2 checks failed; see output for more details  [0.517s]
local/atf/atf-c/check_test:build_cpp  ->  failed: atf-c/utils.c:309: (fd = open(file, O_RDONLY)) != -1 not met  [0.263s]
local/atf/atf-c/check_test:build_cxx_o  ->  failed: 2 checks failed; see output for more details  [0.563s]
local/atf/atf-c/macros_test:use  ->  failed: Build of macros_h_test.c failed; some macros in atf-c/macros.h are broken  [0.209s]
local/atf/atf-c/pkg_config_test:build  ->  failed: atf-check failed; see the output of the test for details  [1.909s]
local/kyua/integration/cmd_db_migrate_test:already_up_to_date  ->  failed: atf-check failed; see the output of the test for details  [2.135s]
local/kyua/integration/cmd_db_migrate_test:need_upgrade  ->  failed: atf-check failed; see the output of the test for details  [2.055s]
local/kyua/integration/cmd_db_migrate_test:upgrade__from_v1  ->  failed: atf-check failed; see the output of the test for details  [1.949s]
local/kyua/integration/cmd_db_migrate_test:upgrade__from_v2  ->  failed: atf-check failed; see the output of the test for details  [1.956s]
local/kyua/testers/fs_test:cleanup__mount_point__busy  ->  failed: testers/fs_test.c:204: EXIT_SUCCESS != WEXITSTATUS(status)  [0.266s]
local/kyua/testers/fs_test:cleanup__mount_point__links  ->  failed: testers/fs_test.c:204: EXIT_SUCCESS != WEXITSTATUS(status)  [0.255s]
local/kyua/testers/fs_test:cleanup__mount_point__nested  ->  failed: testers/fs_test.c:204: EXIT_SUCCESS != WEXITSTATUS(status)  [0.266s]
local/kyua/testers/fs_test:cleanup__mount_point__overlayed  ->  failed: testers/fs_test.c:204: EXIT_SUCCESS != WEXITSTATUS(status)  [0.264s]
local/kyua/testers/fs_test:cleanup__mount_point__simple  ->  failed: testers/fs_test.c:204: EXIT_SUCCESS != WEXITSTATUS(status)  [0.253s]
local/kyua/testers/fs_test:unmount__ok  ->  failed: testers/fs_test.c:204: EXIT_SUCCESS != WEXITSTATUS(status)  [0.244s]
local/kyua/utils/sqlite/statement_test:column_double  ->  failed: Line 247: 0.5 != stmt.column_double(1) (0.5 != 3.43597e+09)  [0.305s]
local/kyua/utils/sqlite/statement_test:safe_column_double__ok  ->  failed: Line 369: 0.5 != stmt.safe_column_double("b") (0.5 != 3.43597e+09)  [0.298s]
usr.bin/lastcomm/legacy_test:main  ->  failed: 4 tests of 6 failed  [1.538s]
usr.bin/mkimg/mkimg:apm_1x1_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.937s]
usr.bin/mkimg/mkimg:apm_1x1_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.802s]
usr.bin/mkimg/mkimg:apm_63x255_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.812s]
usr.bin/mkimg/mkimg:apm_63x255_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.831s]
usr.bin/mkimg/mkimg:bsd_1x1_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.867s]
usr.bin/mkimg/mkimg:bsd_1x1_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.918s]
usr.bin/mkimg/mkimg:bsd_63x255_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.886s]
usr.bin/mkimg/mkimg:bsd_63x255_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.908s]
usr.bin/mkimg/mkimg:ebr_1x1_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.246s]
usr.bin/mkimg/mkimg:ebr_1x1_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.297s]
usr.bin/mkimg/mkimg:ebr_63x255_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.313s]
usr.bin/mkimg/mkimg:ebr_63x255_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.283s]
usr.bin/mkimg/mkimg:gpt_1x1_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.894s]
usr.bin/mkimg/mkimg:gpt_1x1_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.846s]
usr.bin/mkimg/mkimg:gpt_63x255_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.018s]
usr.bin/mkimg/mkimg:gpt_63x255_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.009s]
usr.bin/mkimg/mkimg:mbr_1x1_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.309s]
usr.bin/mkimg/mkimg:mbr_1x1_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.341s]
usr.bin/mkimg/mkimg:mbr_63x255_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.332s]
usr.bin/mkimg/mkimg:mbr_63x255_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.333s]
usr.bin/mkimg/mkimg:pc98_1x1_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.332s]
usr.bin/mkimg/mkimg:pc98_1x1_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.307s]
usr.bin/mkimg/mkimg:pc98_63x255_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.367s]
usr.bin/mkimg/mkimg:pc98_63x255_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.360s]
usr.bin/mkimg/mkimg:vtoc8_1x1_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.797s]
usr.bin/mkimg/mkimg:vtoc8_1x1_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.753s]
usr.bin/mkimg/mkimg:vtoc8_63x255_4096_vhd  ->  failed: atf-check failed; see the output of the test for details  [7.960s]
usr.bin/mkimg/mkimg:vtoc8_63x255_512_vhd  ->  failed: atf-check failed; see the output of the test for details  [8.032s]
usr.sbin/sa/legacy_test:main  ->  failed: 12 tests of 13 failed  [3.195s]

Closed by commit rS286863: On arm64 disable three tests that hang or panic (authored by emaste). · Explain WhyAug 17 2015, 11:19 PM

This revision was automatically updated to reflect the committed changes.