Gitorious on Ubuntu 12.04 mini-HOWTO

Gitorious provides open source infrastructure for hosting open source projects that use Git. This mini-HOWTO will guide you though the installation procedure on Ubuntu 12.04.

Before start I will assume you have a clean Ubuntu Server 12.04 installed with minimal packages requirement. It is strongly recommend to install on a new host, as it will modify a lot of default settings ;-)

Install the base system

First of all you should install Ubuntu 12.04 with minimal packages, almost nothing else is required at the beginning.

After initial installation run the following command to upgrade your system as latest stable + some optional useful packages:

aptitude update && \
aptitude -y full-upgrade && \
tasksel install openssh-server && \
tasksel install server && \
tasksel install mail-server && \
aptitude -y install colordiff locate ntp pwgen rsync vim

Install packages

Let's clone the similar setup as DebianSqueezeInstallation:

aptitude -y install activemq apache2 apache2-threaded-dev apg aspell aspell-en build-essential geoip-bin git-core git-cvs git-doc git-svn imagemagick libapache2-mod-passenger libapache2-mod-xsendfile libaspell-dev libcurl4-openssl-dev libdbd-mysql-ruby libexpat1-dev libgeoip-dev libgeoip1 libmagick++-dev libmagick++4 libmysql-ruby libmysqlclient-dev libonig-dev libpcre3 libpcre3-dev libreadline-dev libreadline5 libruby libsqlite3-dev libxslt1-dev libyaml-dev memcached mysql-client mysql-server openjdk-6-jre postfix ruby ruby-dev rubygems sphinxsearch sqlite3 unzip zip zlib1g zlib1g-dev

Fetch Gitorious

git clone git://gitorious.org/gitorious/mainline.git /var/www/gitorious
cd /var/www/gitorious
git submodule init
git submodule update
ln -s /var/www/gitorious/script/gitorious /usr/local/bin/gitorious

Install RubyGem

REALLY_GEM_UPDATE_SYSTEM=1 gem update --system
gem install -b --no-ri --no-rdoc bundler
cd /var/www/gitorious/
bundle pack --all
bundle install --path vendor/cache

Initialize services

Refer to latest changes since 2012-11-01, we no longer use ultrasphinx and replace with thinking_sphinx, therefore create our own /var/www/gitorious/doc/templates/ubuntu/git-thinking_sphinx as below:

#! /bin/sh
### BEGIN INIT INFO
# Provides:          git-thinking_sphinx
# Required-Start:    mysql
# Required-Stop:     
# Default-Start:     2 3 4 5
# Default-Stop:      0 1 6
# Short-Description: Thinking Sphinx daemon
# Description:       Starts the Thinking Sphinx daemons needed by Gitorious
### END INIT INFO

# Author: Fabio Akita <fabioakita@gmail.com>

GITORIOUS_HOME="/var/www/gitorious"
RETVAL=0
START_CMD="cd $GITORIOUS_HOME && rake thinking_sphinx:start RAILS_ENV=production"
STOP_CMD="cd $GITORIOUS_HOME && rake thinking_sphinx:stop RAILS_ENV=production"
RESTART_CMD="cd $GITORIOUS_HOME && rake thinking_sphinx:restart RAILS_ENV=production"
LOCK_FILE=/var/lock/git-thinking_sphinx
PID_FILE=$GITORIOUS_HOME/db/sphinx/log/searchd.pid

case "$1" in
  start)
    echo -n "Starting git-thinking_sphinx"
    /bin/su - git -c "$START_CMD" 1>/dev/null 2>/dev/null && echo "." || echo ": FAILURE (already running?)"
    ;;
  stop)
    echo -n "Stopping git-thinking_sphinx"
    /bin/su - git -c "$STOP_CMD" 1>/dev/null 2>/dev/null && echo "." || echo ": FAILURE (maybe not runni
ng?)"
    ;;
  restart)
    echo -n "Restarting git-thinking_sphinx"
    /bin/su - git -c "$RESTART_CMD" 1>/dev/null && echo "."  || echo ": FAILURE"
    ;;
  *)
    echo $"Usage: $0 {start|stop|restart}"
    RETVAL=1
esac
exit $RETVAL

Now initialize Gitorious as below:

cd /var/www/gitorious/doc/templates/ubuntu
chmod 755 git-thinking_sphinx git-poller
ln -s /var/www/gitorious/doc/templates/ubuntu/git-thinking_sphinx /etc/init.d/git-thinking_sphinx
ln -s /var/www/gitorious/doc/templates/ubuntu/git-poller /etc/init.d/git-poller
ln -s /var/www/gitorious/doc/templates/ubuntu/gitorious-logrotate /etc/logrotate.d/gitorious
update-rc.d git-thinking_sphinx defaults 99 00
update-rc.d git-poller defaults 99 00
ln -s /usr /opt/ruby-enterprise

Configure Apache2

Enable required modules:

a2enmod passenger rewrite ssl xsendfile
/etc/init.d/apache2 restart

Create /etc/apache2/sites-available/gitorious as below:

<VirtualHost *:80>
  ServerAdmin webmaster@localhost

  DocumentRoot /var/www/gitorious/public

  ErrorLog /var/log/apache2/gitorious-error.log
  # Possible values include: debug, info, notice, warn, error, crit,
  # alert, emerg.
  LogLevel warn

  CustomLog /var/log/apache2/gitorious-access.log combined

  <IfModule mod_xsendfile.c>
    XSendFile on
    XSendFilePath /var/www/gitorious/tarballs
  </IfModule>

</VirtualHost>

Create /etc/apache2/sites-available/gitorious-ssl as below:

<IfModule mod_ssl.c>
  <VirtualHost _default_:443>
    ServerAdmin webmaster@localhost

    DocumentRoot /var/www/gitorious/public

    ErrorLog /var/log/apache2/gitorious-error.log

    # Possible values include: debug, info, notice, warn, error, crit,
    # alert, emerg.
    LogLevel warn

    CustomLog /var/log/apache2/gitorious-ssl_access.log combined

    SSLEngine on

    SSLCertificateFile  /etc/ssl/certs/ssl-cert-snakeoil.pem
    SSLCertificateKeyFile /etc/ssl/private/ssl-cert-snakeoil.key

    BrowserMatch ".*MSIE.*" \
      nokeepalive ssl-unclean-shutdown \
      downgrade-1.0 force-response-1.0

    <IfModule mod_xsendfile.c>
      XSendFile on
      XSendFilePath /var/www/gitorious/tarballs
    </IfModule>

  </VirtualHost>
</IfModule>

So let's restart Apache2 with new site setup:

a2dissite default
a2dissite default-ssl
a2ensite gitorious
a2ensite gitorious-ssl
/etc/init.d/apache2 restart

Setup MySQL

Start the mysql command line client by running:

mysql -uroot -p <<-EOF
DROP DATABASE IF EXISTS gitorious_production;
CREATE DATABASE IF NOT EXISTS gitorious_production DEFAULT CHARACTER SET utf8 COLLATE utf8_unicode_ci;
EOF

Configure ActiveMQ

Create new ActiveMQ instance:

cp -rfp /etc/activemq/instances-available/main /etc/activemq/instances-available/gitorious

Edit /etc/activemq/instances-available/gitorious/activemq.xml. Remove the predefined transportConnector and add a new one using the stomp protocol:

sed -i 's/<transportConnector name=.*/<transportConnector name="stomp" uri="stomp:\/\/127.0.0.1:61613"\/>/g' /etc/activemq/instances-available/gitorious/activemq.xml

Enable ActiveMQ instance:

cd /etc/activemq/instances-enabled
ln -s ../instances-available/gitorious .

Restart ActiveMQ:

/etc/init.d/activemq restart

Configure Gitorious

Run the following:

cd /var/www/gitorious
adduser --system --home /var/www/gitorious --no-create-home --group --shell /bin/bash git
chown -R git:git /var/www/gitorious
git submodule init
git submodule update
mkdir .ssh
touch .ssh/authorized_keys
chmod -R go-rwx .ssh
mkdir tmp/pids repositories tarballs tarballs-work
cp config/database.sample.yml config/database.yml
cp config/gitorious.sample.yml config/gitorious.yml
cp config/broker.yml.example config/broker.yml
chown -R git:git /var/www/gitorious

Edit config/gitorious.yml: Remove every section but production

• gitorious_client_port should be 80
• gitorious_client_host should be your localhost for Apache2
• gitorious_host needs to be the exact hostname (e.g. gitorious.example.com) that clients will use (cookies get messed up otherwise)
• repository_base_path should be something like /var/www/gitorious/repositories
• archive_cache_dir should be something like /var/www/gitorious/tarballs
• archive_work_dir should be something like /var/www/gitorious/tarballs-work
• cookie_secret should generated by "apg -m 64"
• exception_notification_emails should be something like admin@example.com
• disable_record_throttling should be true (optional, but RECOMMENED!)
• public_mode should be false (optional)
• enable_private_repositories should be true (optional)
• repos_and_projects_private_by_default should be true (optional, if most of your GIT are private)
• only_site_admins_can_create_projects should be true (optional, better for local team management)
• hide_http_clone_urls should be true (they require extra unknown setup to work)
• is_gitorious_dot_org should be false
• sender_email_address should be something "Gitorious <no-reply@example.com>"
• gitorious_support_email should be something like support@example.com

Update your database connection for production in config/database.yml as below:

production:
  adapter: mysql
  database: gitorious_production
  username: root
  password: "your_secret_password"
  host: localhost
  encoding: utf8

Run the following:

cd /var/www/gitorious
export RAILS_ENV=production
bundle exec rake db:create
bundle exec rake db:migrate
bundle exec rake thinking_sphinx:configure
bundle exec rake thinking_sphinx:index

Update contab by "crontab -e" as below:

sudo su -
crontab -e
* * * * * cd /var/www/gitorious && /usr/bin/bundle exec /usr/bin/rake thinking_sphinx:index RAILS_ENV=production >/dev/null 2>&1

Create a Admin User as User ‘git’:

env RAILS_ENV=production script/create_admin

Double check file permission for /var/www/gitorious:

chown -Rf git:git /var/www/gitorious

Finish

First of all reboot your system.

Now access your setup with browser, e.g. https://gitorious.example.com. Login and enjoy it ;-)

Upgrading

Assume you are using latest gitorious 2.2.x version, you can simply upgrade your installation as below:

export RAILS_ENV=production
cd /var/www/gitorious
git pull
git submodule init
git submodule update
bundle pack --all
bundle install --path vendor/cache
rake assets:clear
rake db:migrate
chown -R git:git /var/www/gitorious

To keep it simple and stupid, just reboot your system and everything should now work fine; or you can execute the following command in order to restart all related services without reboot:

/etc/init.d/activemq restart
/etc/init.d/apache2 restart
/etc/init.d/git-poller restart
/etc/init.d/git-thinking_sphinx restart
/etc/init.d/memcached restart
/etc/init.d/mysql restart