Commit Graph
188 Commits
Author SHA1 Message Date
Darren Tucker 70d4304974 Update LibreSSL and OpenSSL versions tested.
Update LibreSSL versions to current releases (3.8.4 & 3.9.1).
Add newly-released OpenSSL 3.3.0, and add tests against the 3.1 and
3.3 branches.
2024-04-25 13:16:58 +10:00
Darren Tucker 43e7c1c07c Port changes from selfhosted to upstream tests.
Should get them working again.
2024-03-31 22:26:45 +11:00
Darren Tucker 02c5ad2312 Rearrange selfhosted VM scheduling.
Instead of trying to infer the type of the self hosted tests in each of
the driver scripts (inconsistently...), set one of the following
variables to "true" in the workflow:

VM: tests run in a virtual machine.
EPHEMERAL: tests run on an ephemeral virtual machine.
PERSISTENT: tests run on a persistent virtual machine
REMOTE: tests run on a physical remote host.

EPHEMERAL VMs can have multiple instances of any given VM can exist
simultaneously and are run by a runner pool.  The other types have a
dedicated runner instance and can only run a single test at a time.

Other settings:
SSHFS: We need to sshfs mount over the repo so the workflow can collect
	build artifacts.  This also implies the tests must be run over ssh.
DEBUG_ACTIONS: enable "set -x" in scripts for debugging.
2024-03-30 16:40:07 +11:00
Darren Tucker edcff77f82 Fix name of OpenBSD upstream CI jobs. 2024-03-26 18:58:58 +11:00
Darren Tucker 2946ed522c Better short name for OpenBSD upstream CI jobs too. 2024-03-26 17:19:09 +11:00
Darren Tucker 5fc1085128 Be more specific about when to rerun workflows. 2024-03-26 16:50:46 +11:00
Darren Tucker 5516923e8a Add short names for test jobs on github CI. 2024-03-26 16:39:50 +11:00
Darren Tucker 0d5bdc87a6 Add Mac OS X 14 test targets. 2024-03-25 16:14:21 +11:00
Darren Tucker 8fc109cc61 Test against current OpenSSL and LibreSSL releases.
Add LibreSSL 3.9.0, bump older branches to their respective current
releases.
2024-03-11 12:59:26 +11:00
Darren Tucker 6886e1b1f5 Add nbsd10 test target. 2024-02-22 17:59:35 +11:00
Darren Tucker cbbdf868bc Interop test against PuTTY snapshot and releases. 2024-02-07 23:10:34 +11:00
Darren Tucker 947affad48 Add tests for OpenSSL 3.2.0 and 3.2 stable branch. 2023-11-27 09:37:28 +11:00
Darren Tucker f29934066b Add an Ubuntu 22.04 test VM.
This is the same version as Github's runners so most of the testing on
it is over there, but having a local VM makes debugging much easier.
2023-11-23 19:41:27 +11:00
Darren Tucker a93284a780 Add gcc-12 -Werror test on Ubuntu 22.04.
Explictly specify gcc-11 on Ubuntu 22.04 (it's the system compiler).
2023-11-23 19:36:22 +11:00
Darren Tucker de304c7631 Add fbsd14 VM to test pool. 2023-11-22 08:55:36 +11:00
Darren Tucker 64e0600f23 Test current releases of LibreSSL and OpenSSL.
Retire some of the older releases.
2023-11-13 20:03:31 +11:00
Darren Tucker e9fc2c4812 Put long-running test targets on hipri runners.
Some of the selfhosted test targets take a long time to run for various
reasons, so label them for "libvirt-hipri" runners so that they can
start immediately.  This should reduce the time to complete all tests.
2023-11-01 13:11:31 +11:00
Darren Tucker 3cf698c6d4 Add obsd74 test VM and retire obsd69 and obsd70. 2023-10-30 21:35:03 +11:00
Darren Tucker 637624dbba Don't use make -j2.
While we have 2 cores available on github runners, not using it means
that the most recent log message is the actual failure, rather than
having to search back through the log for it.
2023-10-12 22:01:23 +11:00
Darren Tucker 17fa6cd10a obsd-arm64 host is real hardware...
so put in the correct config location.
2023-08-21 19:47:58 +10:00
Darren Tucker 598ca75c85 Add OpenBSD ARM64 test host. 2023-08-21 19:17:27 +10:00
Darren Tucker 1acac79bfb Add test for zlib development branch. 2023-08-21 19:17:18 +10:00
Darren Tucker fa8da52934 Add obsd72 and obsd73 test targets. 2023-08-13 15:01:27 +10:00
Darren Tucker 36cdb5dbf5 Retire dfly58 test VM. Add dfly64. 2023-07-27 10:30:12 +10:00
Darren Tucker 8a6cd08850 Update runner OS version for hardenedmalloc test.
Hardenedmalloc dropped support for "legacy glibc" versions in their
64dad0a69 so use a newer Ubuntu version for the runner for that test.
2023-06-23 09:49:02 +10:00
Darren Tucker 86ad25d455 Add macos13 PAM test target. 2023-05-08 20:23:08 +10:00
Darren Tucker d9687f4968 Add macos-13 test target.
Also flatten OS list for clarity.
2023-05-01 18:04:35 +10:00
Darren Tucker 6452f89577 Test against LibreSSL 3.7.2. 2023-04-11 16:49:19 +10:00
Damien Miller 021ea5c286 Github testing support for BoringSSL 2023-03-24 15:39:48 +11:00
Damien Miller 7280401bdd remove support for old libcrypto
OpenSSH now requires LibreSSL 3.1.0 or greater or
OpenSSL 1.1.1 or greater

with/ok dtucker@
2023-03-24 13:56:25 +11:00
Darren Tucker abda22fb48 Test latest OpenSSL 1.1, 3.0 and LibreSSL 3.7. 2023-03-19 15:36:13 +11:00
Darren Tucker 131fcbcaff Adjust test jobs for new log directory. 2023-03-01 23:23:02 +11:00
Darren Tucker d3b8d4198b Add CentOS 7 test targets. 2023-02-10 14:26:44 +11:00
Darren Tucker ed8444572a Add tests for LibreSSL 3.7.0 and OpenSSL 1.1.1s. 2022-12-19 18:42:34 +11:00
Darren Tucker abb9a8aadd Use sudo when resetting perms on directories. 2022-12-18 21:36:25 +11:00
Darren Tucker 2f5664c590 Set group perms on regress dir.
This ensures that the tests don't fail due to StrictMode checks.
2022-12-18 21:19:33 +11:00
Darren Tucker 137196300f Fetch regress logs from obj dir. 2022-12-18 21:13:42 +11:00
Darren Tucker 5f93c48365 obsdsnap test VMs runs-on libvirt too. 2022-12-13 20:59:54 +11:00
Darren Tucker 8386886fb1 Run upstream obsdsnap tests on ephemeral runners. 2022-12-13 20:55:37 +11:00
Darren Tucker b6e01459b5 Move obsdsnap test VMs to ephemeral runners. 2022-12-13 20:48:56 +11:00
Darren Tucker 9f2747e0be Rework how selfhosted tests interact with runners.
Previously there was one runner per test target (mostly VMs).  This had
a few limitations:
 - multiple tests that ran on the same target (eg multiple build
   configs) were serialized on availability or that runner.
 - it needed manual balancing of VMs over host machines.

To address this, make VMs that use ephemeral disks (ie most of them)
all use a pool of runners with the "libvirt" label.  This requires that
we distinguish between "host" and "target" for those.  Native runners
and VMs with persistent disks (eg the constantly-updated snapshot ones)
specify the same host and target.

This should improve test throughput.
2022-11-28 22:39:08 +11:00
Darren Tucker d664ddaec8 Run vmstartup from temp dir.
This will allow us to create ephemeral disk images per-runner.
2022-11-27 12:19:37 +11:00
Darren Tucker 0fa16e952b Make "config" in matrix singular and pass in env.
This will allow the startup scripts to adapt their behaviour based on
the type and config.
2022-11-27 12:14:00 +11:00
Darren Tucker e8857043af Add "libvirt" label to dfly30. 2022-11-27 11:45:43 +11:00
Darren Tucker 9775473d84 Rename "os" in matrix to "target".
This is in preparation to distinguish this from the host that the runner
runs on in case where they are separate (eg VMs).
2022-11-27 11:20:35 +11:00
Darren Tucker 04fd00ceff Remove unused self-hosted test targets. 2022-11-27 09:23:04 +11:00
Darren Tucker c9d9fcad2a Remove explicit "default" test config argument.
Not specifying the test config implicitly selects default args.
2022-11-27 09:16:15 +11:00
Darren Tucker 8926956f22 Add dfly62 test target. 2022-11-11 11:25:37 +11:00
Darren Tucker 419aa8a312 Shutdown any VM before trying to check out repo.
In the case where the previous run did not clean up, the checkout will
fail as it'll leave a stale mount.
2022-11-08 12:42:52 +11:00
Darren Tucker a32c07cbb7 Run vm startup and shutdown from runner temp dir.
Should work even if the github workspace dir is on a stale sshfs mount.
2022-11-08 12:01:33 +11:00