Almost certainly. The CLI has been around for years. The GitHub UI launch is fairly new. If fly launch worked almost effortlessly, the GitHub UI launch should have too.
Was a .github/workflows/fly-deploy.yml file created for you? If so, pushing that file to GitHub should get you to the point where all you need to do to deploy is git push. You might need to create a token and go into the Github settings and add this token. See Automatic GitHub push to deploy for more details.