Alluxio 1.0.0 Release

Alluxio Key-Value (Alpha)

Alluxio 1.0 provides applications a new way to interact with Alluxio via key-value API (e.g., put/get key-value pairs). As a result, instead of requiring applications to read/write data as files in Alluxio, applications can now create an immutable key-value store to save billions of (key, value) pairs and query them in memory speed.

Native Swift Integration

Alluxio 1.0 provides the integration with OpenStack Swift object store by a native driver. This improves performance and reduces extra dependency, code complexity and overhead.

Aliyun Object Storage Service Integration

Alluxio 1.0 adds integration with Object Storage Service in Alibaba Cloud (i.e., Aliyun OSS), so users can use this object store by Aliyun as one of the under storage choices of Alluxio.

Alluxio to FUSE Connector

Alluxio 1.0 comes with a FUSE connector that can mount a Alluxio cluster as a standard file system on a local Linux server. Once mounted, users can access Alluxio much more easily. For example, one can manage Alluxio filesystem from the local server using standard Linux utilities (e.g., ‘ls’, ‘cp’ and etc), or writing applications in different languages (e.g., C, C++, Python, Ruby, etc) as long as the lanuage support the standard POSIX libraries (e.g., open, write, read, close).

Users/Groups in File System

Alluxio 1.0 now understands and associates the owner and group to files and directories. When creating a file in Alluxio, the username and groupname can be inferred from local operating system. User can also see the information from the web UI or from the commandline.

ACL Permission Control

Based on the user and group information, Alluxio 1.0 can also perform permission check on operations to read/write files as well as file system operations. This will greatly improve the file system security and usability.

Read / Write Location Preference Policy

Alluxio 1.0 supports policies to specify the location preference to read and write data in Alluxio. Using policies, users can for example upload a local file to Alluxio while telling Alluxio to spread the file data evenly across different nodes.

Improved YARN and Mesos Integration

Alluxio 1.0 further improves the integration with YARN and Mesos, including more configurations, running multiple Alluxio workers per node, specifying a node to run Alluxio master and etc.

Improved File System Client API

Alluxio 1.0 improves the native file system API with better usability and performance. The updated file system client APIs are more intuitive, concise, and more flexible to use with different combinations of parameters, but having significantly reduced communication and synchronization overhead.

Acknowledgements

We would like to thank the following members of the community for their contributions to Alluxio 1.0. The release would not have been possible without your efforts!

Adrian Bridgett, Alan Si, Andrea Reale, Andrew Audibert, Bill Zhao, Bin Fan, Calvin Jia, Carlos de Carvalho, Carson Wang, Changshu Liu, Chaomin Yu, Chen Tian, Cheng Chang, Dapeng Sun, Dong Chen, Dongmin Yu, Elon Azoulay, Gene Pang, Gil Vernik, Haidar Hadi, Hang Zhang, Haoyuan Li, Jan Hentschel, Jesus Alvarez, Jie Zhou, Jijun Tang, Jiri Simsa, Kelvin Chu, Lei Tian, Lei Xu, Leo Wang, Li Luo, Manu Goyal, Mingfei Shi, Peng Shu, Pengfei Xuan, Qian Wang, Ram Iyer, Renteria Carlosr, Rong Gu, Sam Stoelinga, Saverio Veltri, Sayat Satybaldiyev, Shaoshan Liu, Shuai Zhang, Sisir Koppaka, Siyangy Yu, Susan Wang, Tianyin Xu, Ujval Misra, Xianyang Liu, Xiaolu Li, Xiaoqi Wu, Yizheng Jiao, Yu Zhang, Yufa Zhou, Yupeng Fu, Zhi Huang, Zhongyi Xie