Is it impossible to checkout a different branch in Jenkinsfile?

Question

I have two branches on BitBucket: master and develop. I've also got a BitBucket Team Folder job configured on my Jenkins server to build that repository. On the develop branch there's the following Jenkinsfile:

node {     stage('Checkout') {         checkout scm     }      stage('Try different branch') {         sh "git branch -r"         sh "git checkout master"     } } 

When Jenkins runs it, the build fails when it attempts to checkout master:

[Pipeline] stage [Pipeline] { (Try different branch) [Pipeline] sh [e_jenkinsfile-tests_develop-4R65E2H6B73J3LB52BLACQOZLBJGN2QG22IPONX3CV46B764LAXA] Running shell script + git branch -r   origin/develop [Pipeline] sh [e_jenkinsfile-tests_develop-4R65E2H6B73J3LB52BLACQOZLBJGN2QG22IPONX3CV46B764LAXA] Running shell script + git checkout master error: pathspec 'master' did not match any file(s) known to git. [Pipeline] } 

I had expected the git branch -r command to print out both origin/master and origin/develop, but for some reason it only prints the latter.

I've read around and tried to come up with any ways to do this: For example, I tried installing the SSH Agent Plugin for Jenkins and changed the Jenkinsfile to:

node {     stage('Checkout') {         checkout scm     }      stage('Try different branch') {         sshagent(['Bitbucket']) {             sh "git branch -r"             sh "git checkout master"         }     } } 

But it still doesn't appear to find origin/master. What's worse, the SSH agent seems to be killed before it attempts to checkout master:

[Pipeline] { (Try different branch) [Pipeline] sshagent [ssh-agent] Using credentials ThomasKasene (Used to communicate with Bitbucket) [ssh-agent] Looking for ssh-agent implementation... [ssh-agent]   Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-M6pIguCUpAV4/agent.11899 SSH_AGENT_PID=11902 $ ssh-add /var/jenkins_home/workspace/e_jenkinsfile-tests_develop-4R65E2H6B73J3LB52BLACQOZLBJGN2QG22IPONX3CV46B764LAXA@tmp/private_key_2394129657382526146.key Identity added: /var/jenkins_home/workspace/e_jenkinsfile-tests_develop-4R65E2H6B73J3LB52BLACQOZLBJGN2QG22IPONX3CV46B764LAXA@tmp/private_key_2394129657382526146.key (/var/jenkins_home/workspace/e_jenkinsfile-tests_develop-4R65E2H6B73J3LB52BLACQOZLBJGN2QG22IPONX3CV46B764LAXA@tmp/private_key_2394129657382526146.key) [ssh-agent] Started. [Pipeline] { [Pipeline] sh [e_jenkinsfile-tests_develop-4R65E2H6B73J3LB52BLACQOZLBJGN2QG22IPONX3CV46B764LAXA] Running shell script + git branch -r   origin/develop [Pipeline] sh $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 11902 killed; [ssh-agent] Stopped. [e_jenkinsfile-tests_develop-4R65E2H6B73J3LB52BLACQOZLBJGN2QG22IPONX3CV46B764LAXA] Running shell script + git checkout master error: pathspec 'master' did not match any file(s) known to git. [Pipeline] } 

My eventual plan is to commit something to develop and then merge it into master, but so far I have had very little luck. Has anybody got a possible solution or workaround?

PS: This only seems to be a problem in Jenkinsfile; I have a freestyle job that does something similar to what I want, and it works fine.

Answer 1

After some hours of trial and error, I came up with a possible solution. It builds partly on Matt's answer, but I had to alter it to make it work.

Matt was correct in the essentials: checkout scm simply wasn't flexible enough to allow me to do what I needed, so I had to use GitSCM to customize it. The major points of interest are:

• Added extension LocalBranch to make sure I check out to an actual branch, and not just a detached HEAD.
• Added extension WipeWorkspace to delete everything in the workspace and force a complete clone. I don't think this was a part of the solution to my question, but it was still handy to have.
• Specified the SSH credentials using the credentialsId property since the repository is private.

For whatever reason, when the checkout step is executed, it only checks out the branch, but does not set it to track the remote branch. Until I find a more elegant solution, I had to do this manually.

After all that was done, I could use regular sh "git checkout master" and even sh "git push", as long as I enclosed them in an sshagent step.

I added a working example of the resulting Jenkinsfile below, but please keep in mind that it shouldn't be used for anything close to production as it's still very much in its infancy; hardcoded version numbers and no checks for which branch you're in, for example.

node {     mvnHome = tool 'Maven'     mvn = "${mvnHome}/bin/mvn"      stage('Checkout') {         checkout([             $class: 'GitSCM',             branches: scm.branches,             extensions: scm.extensions + [[$class: 'LocalBranch'], [$class: 'WipeWorkspace']],             userRemoteConfigs: [[credentialsId: 'Bitbucket', url: '[email protected]:NAVFREG/jenkinsfile-tests.git']],             doGenerateSubmoduleConfigurations: false         ])     }      stage('Release') {         // Preparing Git         sh "git branch -u origin/develop develop"         sh "git config user.email \"[email protected]\""         sh "git config user.name \"Jenkins\""          // Making and committing new verison         sh "${mvn} versions:set -DnewVersion=2.0.0 -DgenerateBackupPoms=false"         sh "git commit -am \"Released version 2.0.0\""          // Merging new version into master         sh "git checkout master"         sh "git merge develop"         sh "git checkout develop"          // Making and committing new snapshot version         sh "${mvn} versions:set -DnewVersion=3.0.0-SNAPSHOT -DgenerateBackupPoms=false"         sh "git commit -am \"Made new snapshot version 3.0.0-SNAPSHOT\""          // Pushing everything to remote repository         sshagent(['Bitbucket']) {             sh "git push"             sh "git checkout master"             sh "git push"         }     } } 

Answer 2

I could not get the two answers above to work. I was triggering a Jenkins pipeline job by specifying a branch and was trying to checkout another branch (develop) in the job which was failing with:

error: pathspec 'develop' did not match any file(s) known to git. 

I could see this in the failing job, which indicated that only the triggering branch was being fetched:

git fetch --no-tags --progress https://<github URL> +refs/heads/branch-name:refs/remotes/origin/branch-name 

I got it to work by changing the remote fetch config and fetching all branches by doing the following after doing just the default checkout scm step in the triggered job's Jenkinsfile:

sh """     git config remote.origin.fetch '+refs/heads/*:refs/remotes/origin/*'     git fetch --all """ 

This is thanks to this answer https://stackoverflow.com/a/39986737/1988883

This also avoids having to configure Jenkins for GitSCM script approvals which I had to do for trying out the two solutions above