CentOS6.5 安装gitlab以及gitolite迁移gitlab

时间：2023-03-10 03:31:43
CentOS6.5 安装gitlab以及gitolite迁移gitlab

CentOS6.5 安装gitlab以及gitolite迁移gitlab

gitlab 的安装使用以及数据结构

安装

环境：

  • CentOS6.5
  • 基于 nignx + unicorn 搭建的应用环境， 如果想要换成passenger，可以参考网上的文档
  • ruby环境是基于rbenv搭建的

1: install vim

yum install -y vim

2: install git > 1.7.10

  • install git
$ rpm -i 'http://pkgs.repoforge.org/rpmforge-release/rpmforge-release-0.5.3-1.el6.rf.x86_64.rpm'

$ rpm --import http://apt.sw.be/RPM-GPG-KEY.dag.txt

$ vim /etc/yum.repos.d/rpmforge.repo

# 将[rpmforge-extras] 下的enabled = 0 => enabled = 1

$ yum install -y git

$ git --version

git version 1.7.12.4

$ yum clean all

reference: http://tecadmin.net/how-to-upgrade-git-version-1-7-10-on-centos-6/#

  • git config
git config --global user.name 'jerry'

git config --global user.email 'jerrery520@gmail.com'

git config --global color.branch 'auto'

git config --global color.diff 'auto'

git config --global color.interactive 'auto'

git config --global color.interactive 'auto'

git config --global core.editor '/usr/bin/vim'

3: install dependent rpm

  • first: replace yum repo
rpm -Uvh http://mirrors.sohu.com/fedora-epel/6/i386/epel-release-6-8.noarch.rpm
  • second: install
yum install -y gcc-c++ patch readline readline-devel zlib zlib-devel libyaml libyaml-devel libffi libffi-devel openssl-devel make bzip2 autoconf automake libtool bison iconv-devel git-core libxml libxml-devel libxslt libxslt-devel wget pcre-devel openssl openssl-devel tcl tcl-devel libaio-devel ntpdate libicu-devel

4: install rbenv && Ruby

  • add users: git
adduser --comment 'GitLab' --create-home --home-dir /home/git git
  • use rbenv-installer install rbenv
cd /home/git/

sudo -u git sh -c "curl https://raw.github.com/fesplugas/rbenv-installer/master/bin/rbenv-installer > rbenv-installer"

su - git -c '/bin/bash rbenv-installer'

sudo -u git -H echo '

export RBENV_ROOT="${HOME}/.rbenv"

if [ -d "${RBENV_ROOT}" ]; then

  export PATH="${RBENV_ROOT}/bin:${PATH}"

  eval "$(rbenv init -)"

fi

' >> /home/git/.bashrc
  • install Ruby
su - git -c 'rbenv install 2.0.0-p353'

su - git -c 'rbenv global 2.0.0-p353'
  • install bundler
su - git -c 'gem install bundler --no-ri --no-rdoc'

5: install gitlab

  • install gitlab shell
sudo -u git -H git clone https://gitlab.com/gitlab-org/gitlab-shell.git

cd gitlab-shell

sudo -u git -H cp config.yml.example config.yml

# 注：将下面的 your_git_domain替换成你的域名

sudo -u git -H sed -i 's/localhost/your_git_domain/g' config.yml

su - git -c '/home/git/gitlab-shell/bin/install'
  • install mysql, redis, nginx

refer: http://blog.58share.com/?p=291

  • install gitlab
cd /home/git

sudo -u git -H git clone https://gitlab.com/gitlab-org/gitlab-ce.git -b 6-6-stable gitlab

cd /home/git/gitlab

sudo -u git -H cp config/gitlab.yml.example config/gitlab.yml

# Make sure to change "localhost" to the fully-qualified domain name of your

# If you installed Git from source, change the git bin_path to /usr/local/bin/git

# 这里修改host(域名), email_from: (邮件)， support_email（邮件）

sudo -u git -H vim config/gitlab.yml

chown -R git log/

chown -R git tmp/

chmod -R u+rwX  log/

chmod -R u+rwX  tmp/

sudo -u git -H mkdir /home/git/gitlab-satellites

sudo -u git -H mkdir tmp/pids/

sudo -u git -H mkdir tmp/sockets/

chmod -R u+rwX  tmp/pids/

chmod -R u+rwX  tmp/sockets/

sudo -u git -H mkdir public/uploads

chmod -R u+rwX  public/uploads

sudo -u git -H cp config/unicorn.rb.example config/unicorn.rb

# Ex. change amount of workers to 3 for 2GB RAM server

sudo -u git -H vim config/unicorn.rb

sudo -u git -H cp config/initializers/rack_attack.rb.example config/initializers/rack_attack.rb

sudo -u git -H git config --global user.name "GitLab"

sudo -u git -H git config --global user.email "jerrery520@gmail.com"

sudo -u git -H git config --global core.autocrlf input

# mysql

sudo -u git cp config/database.yml.mysql config/database.yml

# 修改配置文件 config/database.yml
  • install gem
su - git

cd /home/git/gitlab

# NOTES: RAM must be > 512M if your mysql on

bundle install --deployment --without development test postgres aws

# 确认数据库配置正确

# 创建数据库

bundle exec rake db:create RAILS_ENV=production

# 初始化gitlab数据 NOTES: need redis

bundle exec rake gitlab:setup RAILS_ENV=production

# 这里会执行清空数据库的操作，第一次请输入 yes

# install script

cp lib/support/init.d/gitlab /etc/init.d/gitlab
  • start server
/etc/init.d/gitlab start
  • check env
# 检测gitlab执行的环境

bundle exec rake gitlab:env:info RAILS_ENV=production

# 检测gitlab所依赖的东西

bundle exec rake gitlab:check RAILS_ENV=production
  • 编译静态文件配置nginx配置
# 编译静态文件

bundle exec rake assets:precompile RAILS_ENV=production

#　配置nginx

# 注意： nginx的配置的用户为 git 

cp lib/support/nginx/gitlab /usr/local/nginx/conf/conf.d/gitlab.conf
  • 绑定host
vim /etc/hosts

127.0.0.1 your_domain
  • 部署成功
按照上面的部署：最终部署成功后： 访问域名

# that's all

# username: admin@local.host

# password: 5iveL!fe

# 第一次进入后，需要重设密码，设置成功后部署成功
  • 安装文档refer:

http://www.digitalsanctuary.com/tech-blog/general/installing-gitlab-on-redhat-enterprise-5-rhel-5.html

https://gitlab.com/gitlab-org/gitlab-ce/blob/6-6-stable/doc/install/installation.md

将gitolite迁移到gitlab步骤

1. 初始化mysql 配置

bundle exec rake gitlab:setup RAILS_ENV=production

初始化后：即可以登陆超级管理员账户：

username: admin@local.host

password: 5iveL!fe

2. 将现有的项目导入到gitlab中

bundle exec rake gitlab:import:repos RAILS_ENV=production

3. 获取root的api密钥token 并写如客户端配置并执行api相关操作

  • 创建用户并塞入对应的 ssh-key， 新创建的用户无创建分组的权限。
  • 获取已经创建的 分组， 并根据分组，将用户写入不同的分组中
  • 将admin 管理员加入所有的分组中, 手动将对应的用户设置为管理员，并允许创建分组
  • 有邮箱的用户操作，涉及到线上数据库的更新，线上测试机器的拉取，手动创建虚拟用户并添加对应的权限 
    线下机器是没有push权限的，设置为Reporter
  • 合并人员需要设置为master 针对该项目
  • 管理员账户，并修改他们对应的权限控制以及创建的项目数

4. 写脚本将所有通过api创建的用户的确认状态修改为已确认状态，并在项目下执行操作

$ vim lib/task/gitlab/user.rake

namespace :gitlab do

  desc "Update all users'confirmed is true"

  task :update_confirmed => :environment do.

     User.find_each do |user|

       user.confirmation_token = nil

       user.confirmed_at = Time.now

       user.save

     end

  end

end

执行操作

bundle exec rake gitlab:updateconfirmed RAILSENV=production

其他的相关配置

  • 配置smtp 邮件服务

cd /home/git/gitlab

$ vim config/environments/production.rb

  config.action_mailer.delivery_method       = :smtp

  config.action_mailer.perform_deliveries    = true

  config.action_mailer.raise_delivery_errors = true

  config.action_mailer.smtp_settings = {

    :address              => 'smtp.exmail.qq.com',

    :port                 => 465,

    :domain               => 'qq.com',

    :user_name            => 'email_address',

    :password             => 'password',

    :authentication       =>  :plain,

    :enable_starttls_auto => true

  }
  • 配置ldap

cd /home/git/gitlab

$ vim config/gitlab.yml

  ldap:

    enabled: true

    host: your_ldap_host

    base: 'ou=Accounts,dc=domain,dc=com'

    port: your_port

    uid: 'uid'

    method: 'plain' # "tls" or "ssl" or "plain"

    bind_dn: 'cn=binder,dc=domain,dc=com'

    password: 'your_password'

    allow_username_or_email_login: true  # 是否允许使用username或者email登陆，设置为false,登陆入口只会显示ldap入口

NOTES: 迁移项目遇到的坑

1. 通过接口获取用户数据，默认只能获取20条， 可以分页，每页最多100条数据

2. 通过接口获取项目，默认只能获取20条

3. 如果是迁移项目，若以前的git项目是有多层级接口，需要修正为一层，比如 java/abc/aaa.git => java/abc_aaa.git, 因为gitlab是不支持多层级结构的

4. 项目创建中有些带有关键字的项目是不能创建成功的，比如 java/admin.git , ruby/services.git

5. gitlab clone项目无论是ssh, http 都会调用http请求，通过http请求判断用户的权限等操作。而我们的http请求是做了ldap访问权限设置的，因此需要对将本机（gitlab服务器）的IP加入ldap的白名单中

相关命令参考

  • 将现有的项目导入到gitlab中去
bundle exec rake gitlab:import:repos RAILS_ENV=production

* 添加所有的用户到所有的分组中（admin的角色是owner）

bundle exec rake gitlab:import:all_users_to_all_groups RAILS_ENV=production

* 添加所有的用户到所有的项目中（admin的角色是master）

bundle exec rake gitlab:import:all_users_to_all_projects RAILS_ENV=production

* 添加一个特殊的用户到所有的分组中（角色为developer）

bundle exec rake gitlab:import:user_to_groups[email] RAILS_ENV=production

* 添加一个特殊的用户到所有的项目中（角色为developer）

bundle exec rake gitlab:import:user_to_projects[email] RAILS_ENV=production

## gitlab 其他相关参考 #### API相关 如果gitlab中有你的公钥，你就可以通过authentication_token来调用api

curl --header "PRIVATE-TOKEN: ArTMXVSWjFEYn9DQrL7f" "http://git.tuan800-inc.com/api/v3/user/keys"

gitlab api gem

refere: https://github.com/NARKOZ/gitlab

问题： 这个gem包的接口是v2的，但是gitlab 现在稳定版的是 V3了，但是部分功能能用，有些接口中描述的功能是需要自己去写的

other helps

refer：http://mrk1869.com/blog/gitlab_installation/

git升级解决方案

How to Upgrade Git version >= 1.7.10 on CentOS 6

refer：http://tecadmin.net/how-to-upgrade-git-version-1-7-10-on-centos-6/#

git clone项目时报无环境变量

refer：http://thoughtpointers.net/2013/04/18/using-rbenv-with-gitlab-shell-on-os-x/

git push error

test [master] % ggpush

Counting objects: 3, done.

Writing objects: 100% (3/3), 229 bytes | 0 bytes/s, done.

Total 3 (delta 0), reused 0 (delta 0)

remote: GitLab: An unexpected error occurred (redis-cli returned 127).

remote: error: hook declined to update refs/heads/master

To git@git.58share.com:huhongda/test.git

 ! [remote rejected] master -> master (hook declined)

error: failed to push some refs to 'git@git.58share.com:huhongda/test.git'

解决： 修改 gitlab-shell/config/gitlab.yml 中的redis-cli 的路径为正确的路径

#### 检测gitlab运行环境是否正确

bundle exec rake gitlab:check RAILS_ENV=production

#### errors

All migrations up? ... rake aborted!

Cannot allocate memory - git log --pretty=format:'%h' -n 1

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/core_ext/kernel/agnostics.rb:7:in ``'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/core_ext/kernel/agnostics.rb:7:in ``'

/home/git/gitlab/config/initializers/2_app.rb:3:in `'

/home/git/gitlab/config/initializers/2_app.rb:1:in `'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/dependencies.rb:223:in `load'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/dependencies.rb:223:in `block in load'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/dependencies.rb:214:in `load_dependency'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/dependencies.rb:223:in `load'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/engine.rb:609:in `block (2 levels) in '

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/engine.rb:608:in `each'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/engine.rb:608:in `block in '

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/initializable.rb:30:in `instance_exec'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/initializable.rb:30:in `run'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/initializable.rb:55:in `block in run_initializers'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/initializable.rb:44:in `each'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/initializable.rb:44:in `tsort_each_child'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/initializable.rb:54:in `run_initializers'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/application.rb:215:in `initialize!'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/railtie/configurable.rb:30:in `method_missing'

/home/git/gitlab/config/environment.rb:5:in `'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/dependencies.rb:229:in `require'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/dependencies.rb:229:in `block in require'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/dependencies.rb:214:in `load_dependency'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/activesupport-4.0.3/lib/active_support/dependencies.rb:229:in `require'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/application.rb:189:in `require_environment!'

/home/git/gitlab/vendor/bundle/ruby/2.0.0/gems/railties-4.0.3/lib/rails/application.rb:250:in `block in run_tasks_blocks'

Tasks: TOP => db:migrate:status => environment

(See full trace by running task with --trace)

解决： 是由于缺少内存导致的，如果用的是vps的话，用free -m 看看是否是内存太少，或者是没有使用swap内存，如果没有swap，需要加swap，一般是内存的1倍或者1.5倍

# 加swap

mkdir -p /data/swapdir

cd /data/swapdir

dd if=/dev/zero of=swapfile bs=1024  count=1024000

mkswap /data/swapdir/swapfile

swapon swapfile  # 开启swap

swapoff swapfile # 关闭swap

# 可以使用free -m 查看内存情况

# 加入开启重启

echo '/data/swapdir/swapfile  swap  swap defaults 0 0' >> /etc/fstab

Reference

http://mrk1869.com/blog/gitlab_installation/ http://www.digitalsanctuary.com/tech-blog/general/installing-gitlab-on-redhat-enterprise-5-rhel-5.html https://gitlab.com/gitlab-org/gitlab-ce/blob/6-6-stable/doc/install/installation.md http://git.58share.com/help/api/README

this is a project for gitlab api

https://github.com/NARKOZ/gitlab

https://github.com/gitlabhq/gitlabhq/blob/master/doc/api/groups.md

This entry was posted in git, linux

Leave a Reply

相关文章