Optimization with Dependent Constraints

$\begingroup$

In the general theory of constrained optimization, is it possible to pose a minimization problem subject to some constraints that are dependent?

For example, suppose we aim to minimize an objective function $\mathscr F(x,y,z)$, for the design parameters $x$, $y$, and $z$, such that $z=x^2+y^2$. Is it correct to have such constraint, theoretically?

EDIT
$z=x^2+y^2$

$\endgroup$ 4

1 Answer

$\begingroup$

As Cade Reinberger said in a comment, you can do this by expressing your constraint as $z=z(x,y)$ (might work with any of the variables, if at all) and then minimising the resulting function $F(x,y)=\mathscr F(x,y,z(x,y))$ by solving $\nabla F(x,y)=\mathbf 0$.

Alternatively, you can express your constraint as $g(x,y,z)=0$ and solve the system $$ \left\{ \begin{align} \nabla\mathscr F(x,y,z)&=\lambda\nabla g(x,y,z) \\ g(x,y,z)&=0 \end{align} \right. .$$ If you'd like some explanation of this method, it's called the method of Lagrange multipliers, and it comes from the way the contours of the functions behave at critical points.

$\endgroup$ 8

Your Answer

Sign up or log in

Sign up using Google Sign up using Facebook Sign up using Email and Password

Post as a guest

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

You Might Also Like