Processing math: 100%

MathJax

Tuesday, October 27, 2015

Karush-Kuhn-Tucker conditions for non-convex problems

Consider a problem (ICP) with equality and inequality constraints:
minimizef(x)subject tohi(x)=0,i=1,,mgj(x)0,j=1,,r where f,hi,gj are continuously differentiable functions from Rn to R.

With Lagrange function
L(x,λ,μ)=f(x)+mi=1λihi(x)+rj=1μjgj(x)
Define the set of active inequality constraints:
A(x)={j|gj(x)=0} A feasible vector x is regular if the equality constraint gradients hi(x),i=1,,m, and the active inequality constraint gradients gj(x),jA(x) are linearly independent.

KKT optimality conditions

KKT necessary conditions for regular x

Let x be a local minimum of the problem
minimizef(x)subject tohi(x)=0,i=1,,mgj(x)0,j=1,,r where f,hi,gj are continuously differentiable functions from Rn to R and x is regular. There exist unique Lagrange multiplier vectors λ=(λ1,,λm), μ=(μ1,,μr) such that
xL(x,λ,μ)=0,μj0,j=1,,r,μj=0,jA(x)  Note: The condition can be written as
μjgj(x)=0,j=1,,r and aptly referred to as complementary slackness condition.

If in addition f, h, and g are twice continuously differentiable, there holds
yT2xxL(x,λ,μ)y0 for all yRn such that
hi(x)Ty=0,i=1,,mgj(x)Ty=0,jA(x)


Wednesday, October 14, 2015

Braess' paradox

An interesting anomaly in non-cooperative behavior.  (An example where Nash equilibrium is not optimal) See link