Continuous Deployment with Buildkite

[karllhughes]

Outline:

• Introduction
  • What is CD? Why it’s important? (Just briefly)
  • What is Buildkite? Why use it for CI/CD?
  • Why host on the edge? Why Fly? (Again, briefly but I think it’s important to give context)
• How to Deploy to Fly using Buildkite
  • Installing Buildkite - Will just reference their installation instructions as this varies depending on the user’s hosting provider: https://buildkite.com/docs/agent/v3/installation
  • A simple app to deploy to Fly: https://fly.io/docs/hands-on/create-app/
  • Introduction to Pipelines: https://buildkite.com/docs/pipelines
  • Setting up a Pipeline, steps, yaml file, etc: https://buildkite.com/docs/pipelines/defining-steps
  • Testing that it works: make a change, re-deploy it, see the change
• Conclusion

[michael]

I have a working Buildkite pipeline that builds an image with docker compose, pushes to the fly registry, then deploys that image with flyctl deploy. I remember auth and caching being funky because of how stages are ran on potentially different agents. I’m happy to share my setup with you if it helps.

[karllhughes]

Yeah, I feel like that would definitely help. Do you have a GH repo somewhere that we can reference? Thanks!

[michael]

Here’s my pipeline.yml file. The rest is straight from this tutorial https://buildkite.com/docs/tutorials/docker-containerized-builds.

steps:
  - command: sh scripts/test.sh
    plugins:
      - docker-compose#v3.3.0:
          run: test
          config:
            - docker-compose.yml
            - docker-compose.test.yml
  - label: ":docker: Build"
    branches: master
    plugins:
      - docker-compose#v3.3.0:
          build:
            - web
            - worker
            - sync
  - wait
  - label: "setup flyctl"
    branches: master
    commands:
      - curl -L https://fly.io/install.sh | FLYCTL_INSTALL=/usr/local sh
      - flyctl auth docker
  - wait
  - label: ":docker: Push"
    branches: master
    plugins:
      - docker-compose#v3.2.0:
          push:
            - worker:registry.fly.io/FLY-APP:commit-$BUILDKITE_COMMIT
  - wait
  - label: "Release fly"
    branches: master
    commands:
      - flyctl deploy -i "registry.fly.io/FLY-APP:commit-$BUILDKITE_COMMIT" -c fly.toml --detach