Mlpack


mlpack is a free, open-source and header-only software library for machine learning and artificial intelligence written in C++, built on top of the Armadillo library and the numerical optimization library. mlpack has an emphasis on scalability, speed, and ease-of-use. Its aim is to make machine learning possible for novice users by means of a simple, consistent API, while simultaneously exploiting C++ language features to provide maximum performance and maximum flexibility for expert users. mlpack has also a light deployment infrastructure with minimum dependencies, making it perfect for embedded systems and low resource devices. Its intended target users are scientists and engineers.
It is open-source software distributed under the BSD license, making it useful for developing both open source and proprietary software. Releases 1.0.11 and before were released under the LGPL license. The project is supported by the Georgia Institute of Technology and contributions from around the world.
WWW Official Site

Features

Classical machine learning algorithms

mlpack contains a wide range of algorithms that are used to solved real problems from classification and regression in the Supervised learning paradigm to clustering and dimension reduction algorithms. In the following, a non exhaustive list of algorithms and models that mlpack supports:
Class templates for GRU, LSTM structures are available, thus the library also supports Recurrent Neural Networks.

Bindings

There are bindings to R, Go, Julia, Python, and also to Command Line Interface using terminal. Its binding system is extensible to other languages.

Reinforcement learning

mlpack contains several Reinforcement Learning algorithms implemented in C++ with a set of examples as well, these algorithms can be tuned per examples and combined with external simulators. Currently mlpack supports the following:

Design features

mlpack includes a range of design features that make it particularly well-suited for specialized applications, especially in the Edge AI and IoT domains. Its C++ codebase allows for seamless integration with sensors, facilitating direct data extraction and on-device preprocessing at the Edge. Below, we outline a specific set of design features that highlight mlpack's capabilities in these environments:

Low number of dependencies

mlpack is low dependencies library which makes it perfect for easy deployment of software. mlpack binaries can be linked statically and deployed to any system with minimal effort. The usage of Docker container is not necessary and even discouraged. This makes it suitable for low resource devices, as it requires only the ensmallen and Armadillo or Bandicoot depending on the type of hardware we are planning to deploy to. mlpack uses library for serialization of the models. Other dependencies are also header-only and part of the library itself.

Low binary footprint

In terms of binary size, mlpack methods have a significantly smaller footprint compared to other popular libraries. Below, we present a comparison of deployable binary sizes between mlpack, PyTorch, and scikit-learn. To ensure consistency, the same application, along with all its dependencies, was packaged within a single Docker container for this comparison.
MNIST digit recognizer
Language detection
Forest covertype classifier
scikit learnN/A327 MB348 MB
Pytorch1.04 GB1.03 GBN/A
mlpack1.23 MB1.03 MB1.62 MB

Other libraries exist such as Tensorflow Lite, However, these libraries are usually specific for one method such as neural network inference or training.

Example

The following shows a simple example how to train a decision tree model using mlpack, and to use it for the classification. Of course you can ingest your own dataset using the Load function, but for now we are showing the API:

import ;
import
import std;
using arma::Mat;
using arma::Row;
using arma::fill;
using mlpack::DecisionTree;
// Train a decision tree on random numeric data and predict labels on test data:
// All data and labels are uniform random; 10 dimensional data, 5 classes.
// Replace with a data::Load call or similar for a real application.
Mat dataset; // 1000 points.
Row labels = arma::randi>;
Mat testDataset; // 500 test points.
DecisionTree tree; // Step 1: create model.
tree.Train; // Step 2: train model.
Row predictions;
tree.Classify; // Step 3: classify points.
// Print some information about the test predictions.
std::println;

The above example demonstrate the simplicity behind the API design, which makes it similar to popular Python based machine learning kit. Our objective is to simplify for the user the API and the main machine learning functions such as Classify and Predict. More complex examples are located in the, including for the methods

Backend

Armadillo">Armadillo (C++ library)">Armadillo

Armadillo is the default linear algebra library that is used by mlpack, it provide matrix manipulation and operation necessary for machine learning algorithms. Armadillo is known for its efficiency and simplicity. it can also be used in header-only mode, and the only library we need to link against are either OpenBLAS, IntelMKL or LAPACK.

Bandicoot

Bandicoot is a C++ Linear Algebra library designed for scientific computing, it has the an identical API to Armadillo with objective to execute the computation on Graphics Processing Unit (GPU), the purpose of this library is to facilitate the transition between CPU and GPU by making a minor changes to the source code,. mlpack currently supports partially Bandicoot with objective to provide neural network training on the GPU. The following examples shows two code blocks executing an identical operation. The first one is Armadillo code and it is running on the CPU, while the second one can runs on OpenCL supported GPU or NVIDIA GPU

import ;
using arma::Mat;
Mat X;
Mat Y;
X.randu;
Y.randu;
Mat Z = 2 * arma::norm * ;


import ;
using coot::Mat;

Mat X;
Mat Y;
X.randu;
Y.randu;
Mat Z = 2 * coot::norm * ;

ensmallen

ensmallen is a high quality C++ library for non linear numerical optimizer, it uses Armadillo or bandicoot for linear algebra and it is used by mlpack to provide optimizer for training machine learning algorithms. Similar to mlpack, ensmallen is a header-only library and supports custom behavior using callbacks functions allowing the users to extend the functionalities for any optimizer. In addition ensmallen is published under the BSD license.
ensmallen contains a diverse range of optimizer classified based on the function type. In the following we list a small set of optimizer that available in ensmallen. For the full list please check this documentation .

Support

mlpack is fiscally sponsored and supported by, Consider making a tax-deductible donation to help the developers of the project. In addition mlpack team participates each year Google Summer of Code program and mentors several students.