Alex Auvolat
390a5d97fe
This removes our dependency on cargo2nix, which was causing us some issues. Whereas cargo2nix creates one Nix derivation per crate, Crane uses only two derivations: 1. Build dependencies only 2. Build the final binary This means that during the second step, no caching can be done. For instance, if we do a change in garage_model, we need to recompile all of the Garage crates including those that do not depend on garage_model. On the upside, this allows all of the Garage crates to be built at once using cargo build logic, which is optimized for high parallelism and better pipelining between all of the steps of the build. All in all, this makes most builds faster than cargo2nix. A few other changes have been made to the build scripts and CI: - Unit tests are now run within a Nix derivation. In fact, we have different derivations to run the tests using LMDB and Sqlite as metadata db engines. - For debug builds, most CI steps now run in parallel (with the notable exception of the smoke test that runs after the build, which is inevitable). - We no longer pass the GIT_VERSION argument when building debug builds and running the tests. This means that dev binaries and test binaries don't know the exact version of Garage they are from. That shouldn't be an issue in most cases. - The not-dynamic.sh scripts has been fixed to fail if the file does not exist.
68 lines
1.8 KiB
YAML
68 lines
1.8 KiB
YAML
when:
|
|
event:
|
|
- deployment
|
|
- cron
|
|
|
|
matrix:
|
|
include:
|
|
- ARCH: amd64
|
|
TARGET: x86_64-unknown-linux-musl
|
|
- ARCH: i386
|
|
TARGET: i686-unknown-linux-musl
|
|
- ARCH: arm64
|
|
TARGET: aarch64-unknown-linux-musl
|
|
- ARCH: arm
|
|
TARGET: armv6l-unknown-linux-musleabihf
|
|
|
|
steps:
|
|
- name: build
|
|
image: nixpkgs/nix:nixos-22.05
|
|
commands:
|
|
- nix-build --attr releasePackages.${ARCH} --argstr git_version ${CI_COMMIT_TAG:-$CI_COMMIT_SHA}
|
|
|
|
- name: check is static binary
|
|
image: nixpkgs/nix:nixos-22.05
|
|
commands:
|
|
- nix-shell --attr ci --run "./script/not-dynamic.sh result/bin/garage"
|
|
|
|
- name: integration tests
|
|
image: nixpkgs/nix:nixos-22.05
|
|
commands:
|
|
- nix-shell --attr ci --run ./script/test-smoke.sh || (cat /tmp/garage.log; false)
|
|
when:
|
|
- matrix:
|
|
ARCH: amd64
|
|
- matrix:
|
|
ARCH: i386
|
|
|
|
- name: upgrade tests
|
|
image: nixpkgs/nix:nixos-22.05
|
|
commands:
|
|
- nix-shell --attr ci --run "./script/test-upgrade.sh v0.8.4 x86_64-unknown-linux-musl" || (cat /tmp/garage.log; false)
|
|
when:
|
|
- matrix:
|
|
ARCH: amd64
|
|
|
|
- name: push static binary
|
|
image: nixpkgs/nix:nixos-22.05
|
|
environment:
|
|
TARGET: "${TARGET}"
|
|
AWS_ACCESS_KEY_ID:
|
|
from_secret: garagehq_aws_access_key_id
|
|
AWS_SECRET_ACCESS_KEY:
|
|
from_secret: garagehq_aws_secret_access_key
|
|
commands:
|
|
- nix-shell --attr ci --run "to_s3"
|
|
|
|
- name: docker build and publish
|
|
image: nixpkgs/nix:nixos-22.05
|
|
environment:
|
|
DOCKER_PLATFORM: "linux/${ARCH}"
|
|
CONTAINER_NAME: "dxflrs/${ARCH}_garage"
|
|
DOCKER_AUTH:
|
|
from_secret: docker_auth
|
|
commands:
|
|
- mkdir -p /root/.docker
|
|
- echo $DOCKER_AUTH > /root/.docker/config.json
|
|
- export CONTAINER_TAG=${CI_COMMIT_TAG:-$CI_COMMIT_SHA}
|
|
- nix-shell --attr ci --run "to_docker"
|