Building WSO2 Carbon from Source

1. Introduction
2. Required(and recommended) tools
3. Setting up
4. Getting the source
5. Building
6. Tips/Issues/Fixes

1.Introduction


Carbon is the core platform of complete enterprise middleware stack by WSO2 which is completely open source.
Read more here: http://wso2.org/



2.Required Tools

Linux
Sun Java Development Kit 1.6
Apache Maven 2.2
Apache Ant 1.8
Subversion 1.6

3.Setting up

You have to be online.

a.Install java:

Goto terminal

sudo add-apt-repository "deb http://archive.canonical.com/ lucid partner"
sudo apt-get update
sudo apt-get install sun-java6-jdk

Allow the download and accept the terms when done.
Environment variables will be automatically created for you by the installer.
Verify if it's correctly installed by

java -version
javac -version

b.Install Maven

sudo apt-get install maven2

Ant also should be installed automatically by maven.
Verify if it's correctly installed by

mvn -version
ant -version

c.Install Subversion

sudo apt-get install subversion

Verify if it's correctly installed by

svn help

d.Setting Maven option for permanent generation space

PermSize defines the size for the Permanent Generation which holds meta-data describing user classes. The Permanent Generation (PermGen) Space is set to a small value by default, by the JDK (64 MB maximum for JDK 1.5). Large applications such as Carbon with a large code base need this set to a higher value.
You need to set it in the environment variable MAVEN_OPTS
You can also increase the java heap size

MAVEN_OPTS=" -Xms512m -Xmx1024m -XX:MaxPermSize=1024m"
export MAVEN_OPTS

Better approach is to set these in .bashrc file in your home so the changes will not be lost when you begin another session (or terminal)

sudo gedit /home/amila/.bashrc 

Add the above too lines to the end of the file and save.

4.Getting the source
create the folder where you want to get sources.
for example, if you want it in "carbonSource"

mkdir carbonSource
cd carbonSource

then get the source from wso2 subversion repository by,

svn checkout http://svn.wso2.org/repos/wso2/trunk/carbon/

Wait until all the sources are downloaded. this includes all the dependencies
of carbon including several apache projects as well as all the carbon based
products. Therefore it's going to take a while.

5. Building
if you go inside the carbon directory, you can see





You can build all things by just using:

mvn install

That will compile the sources, build all dependencies, perform tests and build jar files.
But probably it will not work straightaway, specially in the first try. Also, testing
take a long time. We don't need to test everything when building for the first time.
Therefore we can skips the tests by setting the variable maven.test.skip to true.
You should build in the following order:

• dependencies
• orbit
• service-stubs
• core
• components
• features
• products

For example, to build dependencies:

cd dependencies/
mvn install -Dmaven.test.skip=true

When building, maven will automatically download files for plugins etc. needed
they are downloaded to local maven repository located at your home's /.m2/repository/

After you have successfully built dependencies, orbit, core, components and features, you can move on to building carbon

cd products/carbon/
mvn install -npu -Dmaven.test.skip=true 
 

You can also build other products if you like.


6.Tips/Issues/Fixes

Make sure you have plenty of time and bandwidth before starting to build
After building carbon for the first time, my m2 repository had 2GiB of downloaded content.
Skip tests when you build for the first time
If your build fails halfway, when you build again, use no plugin update flag (npu).
When it's used, maven won't check for updates on already downloaded packages,
only download missing packages, so it will speed up the process.

mvn install -npu -Dmaven.test.skip=true

Possible Issues & Fixes
==================


Sometimes build may fail complaining about missing artifact. Make sure your connection is working properly. Try again in a bit. If the missing artifact's has the "SNAPSHOT" part, it's a local file. Try to find the it's package using find command and build it from inside the particular package.
Compilation errors might occur rarely since carbon is under active development. If so, try updating the sources

svn up

You may also get the error:

[ERROR] FATAL ERROR
[INFO] ------------------------------------------------------------------------
Exception in thread "main" java.lang.OutOfMemoryError: PermGen space

This happens due to insufficient permanent generation space as described previously.
Verify you have correctly set maven options to increase permgen space by,

echo $MAVEN_OPTS

If it isn't correctly set, see the section "Setting Up" to set the variable.

Another possible error:

[ERROR] BUILD ERROR
[INFO] ------------------------------------------------------------------------
[INFO] Failed to create assembly: Failed to retrieve OS environment variables. Reason: Cannot run program "env": java.io.IOException: error=24, Too many open files

Increase the maximum number of open files to fix this

sudo gedit /etc/security/limits.conf 

Add these two lines to end of the file

* soft nofile 65536
* hard nofile 65536

You can save the terminal output for later reference with tee command
For example:

mvn install -npu -Dmaven.test.skip=true | tee /home/amila/BuildTry1.txt

Good Luck!