Difference between revisions of "Mixed-integer cuts"

From optimization
Jump to: navigation, search
Line 6: Line 6:
=Types of Cuts=
Many different cutting plane methods have been developed. Some examples and their performances are listed below.
[[File:Tahir1.PNG|thumb|center|upright=3| Comparison of Cutting Plane Methods]]
(source http://www2.isye.gatech.edu/~sdey30/IntroCuttingPlanes.pdf)
=Gomory's Cuts=
=Gomory's Cuts=

Revision as of 22:08, 5 June 2015

Author: Tahir Kapoor (ChE 345 Spring 2015)

Stewards: Dajun Yue and Fengqi You


Mixed-integer cuts or Cutting-plane methods is an iterative approach used to simplify the solution of a mixed integer linear programming (MILP) problem. Cutting-plane methods work by first relaxing the MILP to a complementary linear programming problem and cutting the feasible region to narrow down the solution search space to only include feasible solutions. Unlike the branch and bound method, which subdivides the feasible region into multiple sub-regions, mixed-integer cuts result in one feasible region which can be solved using standard linear programming methods. Proper application of mixed-integer cuts will result in a convex hull reformulation of a MILP where every extreme point of the feasible region is an integer point. In practice, branch and bound methods are typically more efficient than cutting-plane methods, but cutting-plane methods was the first method proven that a MILP solution could be found in a finite number of steps.


Types of Cuts

Many different cutting plane methods have been developed. Some examples and their performances are listed below.

Comparison of Cutting Plane Methods

(source http://www2.isye.gatech.edu/~sdey30/IntroCuttingPlanes.pdf)

Gomory's Cuts

Cutting-plane methods were first developed by Ralph Gomory in the 1950s and Gomory Cuts remain among the basis of cutting-plane methods.

The basic definition of a Gomory Cut is as follows. Given the system

\sum_{j} \bar a_jx_j \le b_i , x_j = \{0, 1 \}

the Gomory Cut is defined as

\sum_{j} \lfloor \bar a_{j} \rfloor x_j \le \lfloor \bar b_i \rfloor .

Example Applying a Gomory Cut to the Simplex Method

The Gomory Cut method of the above MILP problem is a multi-step process using the following steps:

  1. Relax the MILP problem to it's complementary LP problem by dropping the requirement that xi must be integers.
  2. Solve the linear programming problem to obtain a basic feasible solution.
  3. If this vertex is not an integer point then apply a cut to find a hyperplane with the vertex on one side and all feasible integer points on the other and add it to the constraints
  4. Repeat until a feasible integer solution is found

Using the simplex method to solve a linear program produces a set of equations of the form:

x_i+\sum \bar a_{i,j}x_j=\bar b_i

where xi is a basic variable and the xj's are the nonbasic variables. Rewrite this equation so that the integer parts are on the left side and the fractional parts are on the right side:

x_i+\sum \lfloor \bar a_{i,j} \rfloor x_j - \lfloor \bar b_i \rfloor  = \bar b_i - \lfloor \bar b_i \rfloor - \sum ( \bar a_{i,j} -\lfloor \bar a_{i,j} \rfloor) x_j.

For any integer point in the feasible region the right side of this equation is less than 1 and the left side is an integer, therefore the common value must be less than or equal to 0. So the inequality

\bar b_i - \lfloor \bar b_i \rfloor - \sum ( \bar a_{i,j} -\lfloor \bar a_{i,j} \rfloor) x_j \le 0

must hold for any integer point in the feasible region. Furthermore, nonbasic variables are equal to 0s in any basic solution and if xi is not an integer for the basic solution x,

\bar b_i - \lfloor \bar b_i \rfloor - \sum ( \bar a_{i,j} -\lfloor \bar a_{i,j} \rfloor) x_j = \bar b_i - \lfloor \bar b_i \rfloor > 0.

So the inequality above excludes the basic feasible solution and thus is a cut with the desired properties. Introducing a new slack variable xk for this inequality, a new constraint is added to the linear program, namely

x_k + \sum (\lfloor \bar a_{i,j} \rfloor - \bar a_{i,j}) x_j = \lfloor \bar b_i \rfloor - \bar b_i,\, x_k \ge 0,\, x_k \mbox{ an integer}.

Cover Cuts

A Cover cut is one of the simplest cutting plane methods, but can still be effectively used to reach a convex hull reformation of a MILP. Starting with \sum_{j \in J} \bar a_jx_j \le b_i , x_j = \{0, 1 \}

A subset of J can be defined as C such that \sum_{j \in C} \bar a_j > b_i

Then if all x_j that exist in C have a value of 1, the original constraint will not be met. Therefore, a cut can be made in the form of a cover inequality. A valid cover inequality would have the form of

\sum_{j \in C} \bar x_j \le |C| - 1 , x_j = \{0, 1 \}

Multiple cover inequalities can be formulated for different subsets C of the overall set J. Solving for these different cover inequalities and separating them will result in the convex hull reformation of the MILP.

Example of Cover Cut

5x_1+5x_2+4x_3 <= 8  x_j = \{0, 1 \}

One example of a valid cover inequality that can be generated from the original problem is

\sum_{j \in C} \bar a_j > b_i Where C is a subset of J that contains x_1, x_2. This can be validated by checking the following constraint: 5 + 5 > 8 Therefore a cover inequality can be made using C = {x_1,x_2}. The resulting inequality would be x_1 +x_2 \le 1.

This method can be repeated for different subsets C in the overall set J. Other possible cuts are x_2 +x_3 \le 1 and x_1 +x_2 +x_3\le 1.

Adding all three cover inequalities result in the convex hull reformulation of the original MILP problem.

  1. x_1 +x_2 \le 1
  2. x_2 +x_3 \le 1
  3. x_1 +x_2 +x_3 \le 1

Mixed Integer Rounding


Cuts can be extremely useful techniques to simplify MILPs. Cutting away unfeasible non-integer solutions will ultimately lead to a convex-hull formation of the MILP. Once at a convex hull, all the extreme points of the feasible region will be valid integer solutions and the MILP can be solved by the LP relaxation of the original problem. Using cutting plane techniques is an extremely helpful way to solve complex MILP problems.