Iterative Stencil Loops
Iterative Stencil Loops or Stencil computations are a class of numerical data processing solution
which update array elements according to some fixed pattern, called a stencil.
They are most commonly found in computer simulations, e.g. for computational fluid dynamics in the context of scientific and engineering applications.
Other notable examples include solving partial differential equations, the Jacobi kernel, the Gauss–Seidel method, image processing and cellular automata.
The regular structure of the arrays sets stencil techniques apart from other modeling methods such as the Finite element method. Most finite difference codes which operate on regular grids can be formulated as ISLs.
Definition
ISLs perform a sequence of sweeps through a given array. Generally this is a 2- or 3-dimensional regular grid. The elements of the arrays are often referred to as cells. In each timestep, all array elements are updated. Using neighboring array elements in a fixed pattern, each cell's new value is computed. In most cases boundary values are left unchanged, but in some cases those need to be adjusted during the computation as well. Since the stencil is the same for each element, the pattern of data accesses is repeated.More formally, we may define ISLs as a 5-tuple with the following meaning:
- is the index set. It defines the topology of the array.
- is the set of states, one of which each cell may take on any given timestep.
- defines the initial state of the system at time 0.
- is the stencil itself and describes the actual shape of the neighborhood. There are elements in the stencil.
- is the transition function which is used to determine a cell's new state, depending on its neighbors.
Their states are given by mapping the tuple to the corresponding tuple of states, where is defined as follows:
This is all we need to define the system's state for the following time steps with :
Note that is defined on and not just on since the boundary conditions need to be set, too. Sometimes the elements of may be defined by a vector addition modulo the simulation space's dimension to realize toroidal topologies:
This may be useful for implementing periodic boundary conditions, which simplifies certain physical models.
Example: 2D Jacobi iteration
To illustrate the formal definition, we'll have a look at how a two dimensional Jacobi iteration can be defined. The update function computes the arithmetic mean of a cell's four neighbors. In this case we set off with an initial solution of 0. The left and right boundary are fixed at 1, while the upper and lower boundaries are set to 0. After a sufficient number of iterations, the system converges against a saddle-shape.Stencils
The shape of the neighborhood used during the updates depends on the application itself. The most common stencils are the 2D or 3D versions of the von Neumann neighborhood and Moore neighborhood. The example above uses a 2D von Neumann stencil while LBM codes generally use its 3D variant. Conway's Game of Life uses the 2D Moore neighborhood. That said, other stencils such as a 25-point stencil for seismic wave propagation can be found, too.Implementation issues
Many simulation codes may be formulated naturally as ISLs. Since computing time and memory consumption grow linearly with the number of array elements, parallel implementations of ISLs are of paramount importance to research.This is challenging since the computations are tightly coupled and most ISLs are memory bound.
Virtually all current parallel architectures have been explored for executing ISLs efficiently;
at the moment GPGPUs have proven to be most efficient.
Libraries
Due to both the importance of ISLs to computer simulations and their high computational requirements, there are a number of efforts which aim at creating reusable libraries to support scientists in performing stencil-based computations. The libraries are mostly concerned with the parallelization, but may also tackle other challenges, such as IO, steering and checkpointing. They may be classified by their APIs.Patch-based libraries
This is a traditional design. The library manages a set of n-dimensional scalar arrays, which the user program may access to perform updates. The library handles the synchronization of the boundaries. The advantage of this interface is that the user program may loop over the arrays, which makes it easy to integrate legacy code. The disadvantage is that the library can not handle cache blocking
or wrapping of the API-calls for accelerators. Implementations include , a physics problem solving environment, and .