Configuring Alluxio with GlusterFS

This guide describes how to configure Alluxio with GlusterFS as the under storage system.

Initial Setup

First, the Alluxio binaries must be on your machine. You can either compile Alluxio, or download the binaries locally.

Then, if you haven’t already done so, create your configuration file with bootstrapConf command. For example, if you are running Alluxio on your local machine, ALLUXIO_MASTER_HOSTNAME should be set to localhost

$ ./bin/alluxio bootstrapConf <ALLUXIO_MASTER_HOSTNAME>

Alternatively, you can also create the configuration file from the template and set the contents manually.

$ cp conf/alluxio-env.sh.template conf/alluxio-env.sh

Configuring Alluxio

Assuming the GlusterFS bricks are co-located with Alluxio nodes, the GlusterFS volume is mounted at /mnt/gluster, the following environment variable assignment needs to be added to conf/alluxio-site.properties:

alluxio.underfs.address=/mnt/gluster

Running Alluxio Locally with GlusterFS

After everything is configured, you can start up Alluxio locally to see that everything works.

$ ./bin/alluxio format
$ ./bin/alluxio-start.sh local

This should start an Alluxio master and an Alluxio worker. You can see the master UI at http://localhost:19999.

Next, you can run a simple example program:

$ ./bin/alluxio runTests

After this succeeds, you can visit your GlusterFS volume to verify the files and directories created by Alluxio exist. For this test, you should see files named like:

/mnt/gluster/default_tests_files/Basic_CACHE_THROUGH

To stop Alluxio, you can run:

$ ./bin/alluxio-stop.sh local
Need help? Ask a Question