Are you trying to add an already existing domain to a new organisation?
Then you need to try running flyctl domains add command instead of flyctl domains register.
I am also linking this previous community post that goes into a little bit more about the flyctl domain command you might find helpful.