Path. As a (differentiable) curve, see
path following. As a finite sequence, see
graph or network.
Path following. In this context a path is a piecewise
differentiable curve in space. The idea is to follow such a
path (if one exists) from some initial point to a solution. One
example of a path following algorithm is the
barrier penalty function, with the path created by the parameter u
in the solution, x*(u) in argmax{f(x) + uP(x): x in X^0}, where X^0 is
the strict interior of the
feasible region. (This is called the
central path, or the path
of the analytic center.)
Pattern search. This is a
heuristic (in the sense of not guaranteeing convergence) for
unconstrained optimization. It consists of two basic steps,
where x is a current point and w is a vector of widths
(both having been initialized).
- Exploration move. Set y=x and do for j=1,...,n:
- If f(y + w_j e_j) > f(y), replace y with y + w_j e_j.
- If f(y - w_j e_j) > f(y), replace y with y - w_j e_j.
If x=y at the end of this, go perform a pattern move.
Otherwise, set v = y-x (the change) and x = y (move to better point).
- Pattern move. If f(x + v) > f(x), replace x with
x+v. Otherwise, reduce widths and return to exploration move.
The idea is to perform exploration moves as long as they are
successful. Then, saving the last direction (v) when it was successful,
this is used to advance x if it is an improvement, giving a
new base point (x) for the next series of exploration moves.
Termination occurs when the widths become too small.
Penalty function. The traditional concept is to augment the
objective with a function and one positive constant, so that the
original mathematical program is replaced by solving a parametric family
of the form Max{f(x) - uP(x): x in X^0}. The function, P, is called a
penalty function if it satisfies P(x) > 0 for x not feasible
and P(x)=0 if x is feasible. The set X^0 depends on the type of
penalty function, and there are two classical types, each requiring P
to be continuous: interior (or
barrier) and
exterior. A penalty function is exact if there exists
a finite parameter value such that its maximum is a solution to the
original mathematical program.
More generally, a penalty function could involve many parameters, such
as the Lagrangian, or it could be stated
in parameter free form. A general model is the
generalized penalty-function/surrogate
dual, and the notion of exact penalty function is that of a
strong dual.
Perturbation. An imprecise term that means changing some
parameter
value (or function) and seeing what effect this has on the
solution. This embodies continuity and differentiability properties of
the optimal responses: objective value, policy set, and perhaps dual
values too. This is what is sometimes called marginal analysis
of solutions, and changes are limited to some
neighborhood of the initial values. Some use
perturbation function to mean the optimal
objective value, even for large changes in the parameters, as in
parametric programming.
Phase I & Phase II. Phase I of a mathematical program
is finding a feasible solution, and
Phase II is entered with a feasible solution to find an
optimal solution. The standard Phase I is:
Max Sum_i{u_i} + Sum_i{v_i + w_i}: u, v, w >= 0,
g(x) - u <= 0, h(x) - v + w = 0.
Then, for any x, one could set u = g(x)^+, v = h(x)^+ and w =
-h(x)^- to have a feasible solution to the Phase I mathematical program.
The optimal objective value is 0 if, and only if, u=0 and v=w=0,
in which case x is feasible in the original mathematical program (to
commence Phase II). The Phase I problem is sometimes called an
elastic program (thinking of the