GoGitBackup

This is a utility to download and backup all your GitHub/GitLab accounts to disk. It uses the APIs of each provider to find all the repositories you have access to and clones or pulls them into the same root directory.

This tool is intended for local backups of all your work. The tool uses the git-provider API to list all repositories you have access to and clones them. It is intended to backup work from internal Github/GitLab repositories in case you lose access to them, e.g., in case you leave university.

Usage

The tool is based on a *.yml config file where you can define one or more accounts to back up.

NAME:
   GoGitBackup - Utility to backup your git(Hub|lab) accounts.

USAGE:
   GoGitBackup [global options] command [command options] [arguments...]

COMMANDS:
   backup, b  performs a backup of all git(hub/lab) accounts that can be accessed.
   check, c   check what we can backup using this utility and also validates your config ;)
   update, u  updates all repos with new remotes based on the config
   help, h    Shows a list of commands or help for one command

GLOBAL OPTIONS:
   --config FILE, -c FILE  Load configuration from FILE (default: "./config.yml")
   --verbose, -v           Enables verbose logging (default: false)
   --help, -h              show help (default: false)

Process

The tool will iterate all configured GitHub and GitLab accounts and clone all repositories that are accessible to you. It will create a directory for each project using the following pattern: <config.repository>/<accountname>/<project>. If the repository already exists, it will pull the latest changes. For pulling we use the provided access token as part of the remote URL. This means you should not give other people access to the backup directory, as they can extract your key and access all your repositories.

In case you invalidated a key, you can use the update command to update all remotes to the new key. The old remote will remain after the update as old-remote.

Config

To run the utility, you need to specify at least one account and a local repository. An exemplary config file can look like this:

repository: /tmp/test
accounts:
  - name: Personal GitHub
    token: < oauht token >
    provider: 0
    args:
      - tawalaya

The following accounts are supported:

GitHub

For GitHub, you need to specify the following fields in the config file:

  - name: <A Name of this account for logging>
    token: <a github access token>
    provider: 0
    args:
      - <the github usename of the token>

In order to obtain a GitHub token, follow this guide guid.

GitLab

For GitLab, you need to specify the following fields in the config file:

     - name: <A Name of this account for logging>
       token: <Gitlab API Token>
       provider: 1
       args:
         - <base-url of your GitLab installation, optional will use gitlab.com by default>

In order to obtain a GitLab token, follow this guid.

Filters

Sometimes you want or need to avoid some repositories. For that GoGitBackup can add filters. Each filter is added to the filters property of each provider config. For the filter implementation we use Tengo Script. Each filter is executed in sequence. Each filter can use the following variables.

name	description
owner	bool - true if the reposetory is owned by the git user.
member	bool - true if the git user is a member of reposetory.
visibility	int - Public = 0, Private = 1, Internal = 2
size	int - size of the reposetory
name	string - name of the reposetory

Each script needs to set a variable r; for example, r := owner checks if the repository is owned by the token owner.

     - name: <A Name of this account for logging>
       token: <Gitlab API Token>
       provider: 1
       args:
         - <base-url of your GitLab installation, optional will use gitlab.com by default>
       filters: 
         - "r:=owner"

Development

The tool is based on go-lang 1.13 and should be easily extendable to other git-as-a-service providers, PR's welcome.