How to add existing sub repository as a submodule in git?
I have a private codespace
supermodule with submodules scattered randomly:
codespace (git repo, private)
├── Archived_projects (git repos)
└── Projects
├── project-foo (git repo)
└── project-bar (git repo)
Sometimes submodules have commits not ready to be pushed. But I want them to be saved while pushing supermodule codespace
.codespace
is a repo cloned to c9.io workspace or other places.
linus@machine /cygdrive/f/__Storage__/Workspace
$ git clone https://github.com/octocat/Spoon-Knife.git
Cloning into 'Spoon-Knife'...
$ cd Spoon-Knife/
$ git clone https://github.com/octocat/Spoon-Knife.git ./foo/bar
Cloning into './foo/bar'...
$ git add .
From cmd.exe
> git submodule add https://github.com/octocat/Spoon-Knife.git ./foo/bar
'foo/bar' already exists in the index
> cat .gitmodules
cat: .gitmodules: No such file or directory
From cygwin.exe (bash)
$ git submodule add https://github.com/octocat/Spoon-Knife.git ./foo/bar
': not a valid identifier/Git/mingw64/bin/gettext.sh: line 89: export: `sm_path
'' already exists in the index
$ cat .gitmodules
cat: .gitmodules: No such file or directory
git submodule [--quiet] add [-b <branch>] [-f|--force] [--name <name>]
[--reference <repository>] [--depth <depth>] [--] <repository> [<path>]
<repository> is the URL of the new submodule’s origin repository.
<path> is the relative location for the cloned submodule to exist in the superproject. If <path> does not exist, then the
submodule is created by cloning from the named URL. If <path> does exist and is already a valid Git repository, then this is
added to the changeset without cloning. This second form is provided to ease creating a new submodule from scratch, and
presumes the user will later push the submodule to the given URL.
In either case, the given URL is recorded into .gitmodules for use by subsequent users cloning the superproject. If the URL
is given relative to the superproject’s repository, the presumption is the superproject and submodule repositories will be
kept together in the same relative location, and only the superproject’s URL needs to be provided: git-submodule will
correctly locate the submodule using the relative URL in .gitmodules.
If <path>
does exist and is already a valid Git repository, then this is added to the changeset without cloning.
Why this doesn't work in my case?
Git submodules allow you to keep a git repository as a subdirectory of another git repository. Git submodules are simply a reference to another repository at a particular snapshot in time. Git submodules enable a Git repository to incorporate and track version history of external code.
The submodule is just a separate repository. If you want to make changes to it, you should make the changes in its repository and push them like in a regular Git repository (just execute the git commands in the submodule's directory).
Where you went wrong is doing the
$ git add .
That adds everything, so also foo/bar
, to the index of the current repository (ready to be committed thus).
If you just don't do that and continue with
$ git submodule add https://github.com/CarloWood/XYZ.git foo/bar
then that should work; this would detect that foo/bar is an already cloned repository and add it to the current repository as a submodule.
Note that it is not needed to clone first. You explicitly say you already have done that, but for clarity for other readers I'd like to point out that if you omit the clone right before the git add .
too (so there isn't a foo/bar at all now) then the above git submodule add ...
would see there isn't anything yet and then simply clone it for you.
Note that there is a minor difference between methods. If you start with cloning then foo/.git
will be a directory, while if you use git submodule add
to do the cloning then this .git
repository is put in .git/modules/foo
of the parent project and foo/.git
is a file containing the path to that. There is no real difference however as using a file for the .git
to point anywhere else is generic and could be used anywhere; you can not conclude anything from .git
being a file or directory.
git submodule add
detects if the path given for a submosule exists and contains an initialized git repo, so no neeed to worry about that. I ran into a similar problem so I wrote a (hacky) script to deal with this issue.
#!/bin/bash
# save super directory
currentDir=`pwd`
# get all the git repos inside (except .) and format them
# the way git does
gitDirs=`find -type d -name ".git" | sed -e 's|.git$||' -e 's|./||' -e 's|/$||' | grep -v "^$"`
for i in ${gitDirs[@]}
do
echo "dealing with $i now"
cd $i
# get the remote url for each submodule
fetchUrl=`git remote -v | awk '/fetch/ {print $2}'`
# for my purposes repos without remotes are useless
# but you may have a different use case
if [[ -z $fetchUrl ]]
then
echo "fetch url not found for this directory"
continue
else
echo "got a fetch url of $fetchUrl for git repo $i"
fi
cd $currentDir
# make sure it isn't tracked as a submodule already
existing=`grep -A5 $i ./.gitmodules | grep $fetchUrl`
if [[ -z $existing ]]
then
echo "does not exist in .gitmodules yet, will create now"
# if it doesn't exist yet then create it
git submodule add $fetchUrl $i
else
echo "$i is already present as a submodule with fetch url: $fetchUrl"
echo "The command we would have used is: git submodule add $fetchUrl $i"
fi
done
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With