Mathematical Programming Glossary - O
Mathematical Programming Glossary - O

Objective function. The (real-valued) function to be optimized. In a mathematical program in standard form, this is denoted f. Also see multiple objectives.

100% Rule. This pertains to sensitivity analysis in linear programming. In its original form, it uses the convexity of the set of admissible changes in the rim data to test whether a particular change is admissible: any combination of changes can occur as long as the total percentage deviation from the coordinate extremes does not exceed 100%. (Note: this applies to right-hand sides (b) and costs (c) separately.)

More generally, suppose the optimal value remains constant over the following changes for c: {c+d1,c+d2,...,c+dk}. (We could have k=n and let dj be the j-th coordinate extreme for cj, but that is not necessary.) Then, the optimal objective value is the same for c+µ1d12d2+...+µkdk for any µ >= 0 such that sumj µj <= 1.

The same applies to taking a convex combination of changes in b (maybe with the origin, which is no change). If the objective value remains optimal at {b+f1,...,b+fq}, it is also optimal at b+sumi ßi for ß >= 0 such that sumi ßi <= 1.

Online problem. A decision problem that is ongoing, so its data values are frequently changing with uncertainty. Here are some examples:

  1. Allocation of bandwidth during video conferencing on a telecommunications network;
  2. Investment decisions in a portfolio, selling and buying as the market changes;
  3. Scheduling jobs as they arrive;
  4. Load forcasting and dispatching for electric power.
In general, an online decision problem could be the allocation of resources that is done in real time with changes in the amount of resources, their costs and the demands for what they produce. A problem that is not online is sometimes called an offline problem.

Optimal. For a mathematical program in standard form, x* in X (the domain) is an optimal solution if it is a maximum (or a minimum):

  1. x* is feasible;
  2. f(x*) >= f(x) for all feasible x (maximum value).

Some authors refer to an optimal solution when they mean a local optimum; others mean a member of the optimality region (which are global optima). In either case, the optimal value is the objective value, evaluated at an optimal solution. A solution is nearly optimal if it is feasible, but the optimality condition (2) is replaced by

    f(x*) >= f(x) - t   for all feasible x,

where t > 0.   (t=0 corresponds to being optimal). Typically, t is specified as a small fraction, such as a cut-off tolerance for an algorithm to terminate finitely.

Optimal partition. Consider a primal-dual pair of linear programs:

Min{cx: x >= 0, Ax >= b} and Max{yb: y >= 0, yA <= c}.

Define primal surplus variables, s = Ax - b, and dual slack variables, d = c - yA. For any non-negative vector, v, define its support set as those indexes for which the coordinate value is positive: I(v)={j: v_j > 0}. In an optimal solution, complementary slackness must hold, so that j in I(x) implies j is not in I(d), and i in I(s) implies i is not in I(y). Thus, the intersections, I(x)/\I(d) and I(s)/\I(y), are empty. If the solution is strictly complementary, these support sets yield partitions because then I(x)\/I(d) = {1,...,n} and I(s)\/I(y) = {1,...,m}. A strictly complementary solution is an interior solution (and conversely), so each interior solution yields a partition of these index sets.

A key fact is that every LP with an optimal solution must have an optimal interior solution. Further, every optimal interior solution yields the same partition, so it is called the optimal partition.

Optimal response function. The optimal value of the objective as a function of parameters, typically the right-hand side:

f*(b, c) = Sup{f(x): x in X, g(x) <= b, h(x) = c}.

Optimality region. Set of optimal points.

Optimum (pl. optima). Minimum or maximum.

Order of convergence. See convergence.

Orthogonal complement of a subspace, S. {y: yx = 0 for all x in S}. In particular, if S = {x: x = Av for some v in R^n}, where A is an m by n matrix, its orthogonal complement is {y: yA = 0}.

Orthogonal matrix. A matrix, A, such that AA'=I.

Orthogonal vectors. Two vectors in R^n whose inner product is zero.

OSL. Optimization Software Library - A library of optimization routines, callable from Fortran or C, produced by IBM.

Outer approximation. This solves a sequence of approximations to a mathematical program where the approximating problem contains the original feasible region. Examples are cutting plane algorithms and relaxation.

Out-of-kilter algorithm. Applies to network flows, where the balance equations hold every iteration, but bounds and duality (optimality) conditions could be violated. The dual prices, often called potentials in this context, are modified along with flows so as to move closer to both primal and dual feasibility.

Over-optimize. A term that means the model is too optimistic in expecting an optimal solution to produce the benefits in its objective. For example, a time-staged model generally presumes perfect information over the planning horizon, and can be "over-optimizing" in its allocation of resources.

 


Notation

Send questions and comments to icsMPGlossary@mail.informs.org.
View the INFORMS Computing Society's Editorial Board
Copyright© 1996 – 2008, Mathematical Programming Glossary, by the INFORMS Computing Society