Logarithmically concave function
In convex analysis, a non-negative function is logarithmically concave if its domain is a convex set, and if it satisfies the inequality
for all and. If is strictly positive, this is equivalent to saying that the logarithm of the function,, is concave; that is,
for all and.
Examples of log-concave functions are the 0-1 indicator functions of convex sets, and the Gaussian function.
Similarly, a function is log-convex if it satisfies the reverse inequality
for all and.
For non-negative discrete functions, it is log-concave if
Properties
- A log-concave function is also quasi-concave. This follows from the fact that the logarithm is monotone implying that the superlevel sets of this function are convex.
- Every concave function that is nonnegative on its domain is log-concave. However, the reverse does not necessarily hold. An example is the Gaussian function = which is log-concave since = is a concave function of. But is not concave since the second derivative is positive for || > 1:
- From above two points, concavity log-concavity quasiconcavity.
- A twice differentiable, nonnegative function with a convex domain is log-concave if and only if for all satisfying,
Operations preserving log-concavity
- Products: The product of log-concave functions is also log-concave. Indeed, if and are log-concave functions, then and are concave by definition. Therefore
- Marginals: if : is log-concave, then
- This implies that convolution preserves log-concavity, since = is log-concave if and are log-concave, and therefore
Log-concave distributions
Log-concave distributions are necessary for a number of algorithms, e.g. adaptive rejection sampling. Every distribution with log-concave density is a maximum entropy probability distribution with specified mean μ and Deviation risk measure D.As it happens, many common probability distributions are log-concave. Some examples:
- the normal distribution and multivariate normal distributions,
- the exponential distribution,
- the uniform distribution over any convex set,
- the binomial distribution,
- the logistic distribution,
- the extreme value distribution,
- the Laplace distribution,
- the chi distribution,
- the hyperbolic secant distribution,
- the Wishart distribution, if n ≥ p + 1,
- the Dirichlet distribution, if all parameters are ≥ 1,
- the gamma distribution if the shape parameter is ≥ 1,
- the chi-square distribution if the number of degrees of freedom is ≥ 2,
- the beta distribution if both shape parameters are ≥ 1, and
- the Weibull distribution if the shape parameter is ≥ 1.
The following distributions are non-log-concave for all parameters:
- the Student's t-distribution,
- the Cauchy distribution,
- the Pareto distribution,
- the log-normal distribution, and
- the F-distribution.
- the log-normal distribution,
- the Pareto distribution,
- the Weibull distribution when the shape parameter < 1, and
- the gamma distribution when the shape parameter < 1.
- If a density is log-concave, so is its cumulative distribution function.
- If a multivariate density is log-concave, so is the marginal density over any subset of variables.
- The sum of two independent log-concave random variables is log-concave. This follows from the fact that the convolution of two log-concave functions is log-concave.
- The product of two log-concave functions is log-concave. This means that joint densities formed by multiplying two probability densities will be log-concave. This property is heavily used in general-purpose Gibbs sampling programs such as BUGS and JAGS, which are thereby able to use adaptive rejection sampling over a wide variety of conditional distributions derived from the product of other distributions.
- If a density is log-concave, so is its survival function.
- If a density is log-concave, it has a monotone hazard rate, and is a regular distribution since the derivative of the logarithm of the survival function is the negative hazard rate, and by concavity is monotone i.e.