ABSTRACT

In this paper, we first reformulate the max-min dispersion problem as a saddle-point problem. Specifically, we introduce an auxiliary problem whose optimum value gives an upper bound on that of the original problem. Then we propose the saddle-point problem to be solved by an adaptive custom proximal point algorithm. Numerical results show that the proposed algorithm is efficient.

Keywords:

Maximum Weighted Dispersion Problem, Adaptive Custom Proximal Point Algorithm, NP-Hard

1. Introduction

Consider the following weighted max-min dispersion problem:

$\underset{x\in \chi }{\max }\left\{f\left(x\right):=\underset{i=1,\cdots ,m}{\min }{\omega }_i{\Vert x-x^i\Vert }^2\right\},$ (1)

where $\chi =\left\{y\in {ℝ}^n|{\left(y_1^2\mathrm{,}\cdots \mathrm{,}{y}_n^2\mathrm{,1}\right)}^{\text{T}}\in \mathcal{K}\right\}$ , $\mathcal{K}$ is a convex cone, $x^1\mathrm{,}\cdots \mathrm{,}{x}^m\in {ℝ}^n$

are m given point, ${\omega }_i>0$ for $i=1,\cdots ,m$ and $\Vert \cdot \Vert$ denotes the Euclidean norm. Let $\nu \left(P_{\chi }\right)$ denote the optimal value of the problem (1). The problem aims to find a point x in a closed set χ that is furthest from a given set of points $x^1\mathrm{,}\cdots \mathrm{,}{x}^m$ in ${ℝ}^n$ in a weighted max-min sense. It has wide applications in spatial management, facility location, and pattern recognition (see [1] [2] [3] [4] and references therein). In the equal weight case, i.e., ${\omega }_1=\cdots ={\omega }_m$ , (1) has the geometric interpretation of finding the largest Euclidean sphere with center in $P_{box}$ and enclosing no given point.

Without loss of generality, we assume that $\nu \left(P_{\chi }\right)>0$ . The weighted max-min dispersion problem is known to be NP-hard in general, even in the case of equal weights and $\chi ={\left[-1,1\right]}^n$ [5] or $\chi =\left\{x|\Vert x\Vert \le 1\right\}$ [6] . We denote the two special cases by $P_{box}$ and $P_{ball}$ , which correspond to setting $\mathcal{K}=\left\{y\in {ℝ}^{n+1}|y_j\le y_{n+1},j=1,\cdots ,n\right\}$ and $\mathcal{K}=\left\{y\in {ℝ}^{n+1}|y_1+\cdots +y_n\le y_{n+1}\right\}$ respectively.

In the low-dimensional cases of $n\le 3$ and χ being a polyhedral set, this problem is solvable in polynomial time [4] [7] . For $n>4$ , heuristic approaches have been proposed [1] [4] .

In paper [5] , they use an optimal solution of convex relaxations from semidefinite programming (SDP) and second order cone programming (SOCP) to construct an approximate solution of (1), and prove an approximation bound

of $\frac{1-O\left(\sqrt{ln\left(m\right){\gamma }^{\mathrm{<mo>\; *\; </mo>}}}\right)}{2}$ , where ${\gamma }^{\mathrm{<mo>\; *\; </mo>}}$ depends on χ. When $\chi ={\left\{-\mathrm{1,1}\right\}}^n$ or $\chi ={\left[-\mathrm{1,1}\right]}^n$ , ${\gamma }^{*}=O\left(\frac{1}{n}\right)$ . This is the first nontrivial approximation bound for a convex relaxation of (1). Wang and Xia [6] then focus on the study of $P_{ball}$ and show the approximation bound of their algorithm is $\frac{1-O\left(\sqrt{\ln \left(m\right)/n}\right)}{2}$ based on a linear programming relaxation.

In this paper, we focus on the equal weight max-min dispersion problem, which is called by “max-min dispersion problem” for simplicity. Firstly, we model the max-min dispersion problem as a saddle point problem, and then we adopt an adaptive custom proximal point algorithm to obtain a ε-approximation scheme¹.

The remainder of the paper is organized as follows. In Section 2, we reformulate max-min dispersion problem as a saddle point problem. In Section 3, we propose a new adaptive custom proximal point algorithm to approximately solve the saddle point problem and establish the convergence analysis. Section 4 presents some numerical comparisons between our proximal point algorithm and SDP-based algorithm. Conclusions are made in Section 5.

2. Saddle Point Model

Without loss of generality, we drop the weight parameters ω_i from the objective function, since all the ω_is are equal. In the following of this paper, we consider the problem:

$\underset{x\in \chi }{\max }\left\{f\left(x\right)\mathrm{<mo>\; :\; </mo>}=\underset{i=1,\cdots ,m}{\min }{\Vert x-x^i\Vert }^2\right\}\mathrm{.}$ (2)

Note that, it has been proved that this problem is NP-hard in general [5] [6] . Denote ${\Delta }_m$ by the unit simplex in ${ℝ}^m$ , that is, ${\Delta }_m=\left\{x\in {ℝ}^m|x\ge 0,e^{\text{T}}x=1\right\}$ with e being the all one vector, then (2) is equivalent to the following saddle point problem:

$\underset{x\in \chi }{\max }\underset{y\in {\Delta }_m}{min}{\displaystyle \sum _{i=1}^m}{y}_i{\Vert x-x^i\Vert }^2\mathrm{.}$ (3)

$\begin{array}{c}\varphi \left(x,y\right)={\displaystyle \sum _{i=1}^m}{y}_i{\Vert x-x^i\Vert }^2={\displaystyle \sum _{i=1}^m}\left(y_i{\Vert x\Vert }^2-2y_i{\left(x^i\right)}^{\text{T}}x+y_i{\Vert x^i\Vert }^2\right)\\ =-2{\left(Ay\right)}^{\text{T}}x-2y^{\text{T}}b+{\displaystyle \sum _{i=1}^m}{y}_i{\Vert x\Vert }^2\\ =-2{\left(Ay\right)}^{\text{T}}x-2y^{\text{T}}b+\gamma {\Vert x\Vert }^2,\end{array}$

where $A=\left[A_1,\cdots ,A_m\right]\in {ℝ}^{n\times m},A_i=x^i$ and $b={\left(-\frac{1}{2}{\Vert x^1\Vert }^2\mathrm{,}\cdots \mathrm{,}-\frac{1}{2}{\Vert x^m\Vert }^2\right)}^{\text{T}}$ , $\gamma ={\displaystyle \sum _{i=1}^m}{y}_i=1$ . $\varphi \left(x\mathrm{,}y\right)$ is convex for x and concave for y separately, although the saddle point model is neither convex nor concave.

Define $g\left(x\right)=\underset{y\in {\Delta }_m}{\min }\varphi \left(x,y\right)$ , and let $x^{\mathrm{<mo>\; *\; </mo>}}\mathrm{,}{y}^{\mathrm{<mo>\; *\; </mo>}}$ be the optimal saddle point of objective (3). Note that $x^{\mathrm{<mo>\; *\; </mo>}}$ is also necessarily a minimizer of $g\left(x\right)$ and

$g\left(x^{*}\right)=\underset{x\in \chi }{\max }\underset{y\in {\Delta }_m}{\min }{\displaystyle \sum _{i=1}^m}{y}_i{\Vert x-x^i\Vert }^2$ . Now it suffices for us to find a point x such that $g\left(x\right)\ge g\left(x^{\mathrm{<mo>\; *\; </mo>}}\right)-\epsilon$ , because such an x is necessarily a ε-approximate solution to (3).

However, $\varphi \left(x,y\right)$ is not strongly concave with respect to y. Furthermore, define the regularized saddle point problem

$\underset{x\in \chi }{\max }\underset{y\in {\Delta }_m}{\min }\left\{{\varphi }_{\lambda }\left(x,y\right):=-2y^{\text{T}}{A}^{\text{T}}x-2y^{\text{T}}b+\gamma {\Vert x\Vert }^2-\lambda \Vert y\Vert \right\},$ (4)

So ${\varphi }_{\lambda }\left(x,y\right)$ is λ-strongly concave on y and γ-strongly convex on x.

Denote the optimal solution of (4) by $\left(x^{\circ }\mathrm{,}{y}^{\circ }\right)$ . The relation between the optimal value of (3) and that of (4) can be characterized in the following lemma.

Lemma 1. $g\left(x^{\mathrm{<mo>\; *\; </mo>}}\right)-g\left(x^{\circ }\right)\le \epsilon /2$ if $\lambda \le \frac{\epsilon }{2}$ .

Proof. Denoting $\tilde{y}=arg\underset{y\in {\Delta }_m}{min}\varphi \left(x^{\circ }\mathrm{,}y\right)$ , we have

$\begin{array}{c}g\left(x^{\circ }\right)=\varphi \left(x^{\circ }\mathrm{,}\tilde{y}\right)={\varphi }_{\lambda }\mathrm{<mo\; stretchy="false">\; (\; </mo>}{x}^{\circ }\mathrm{,}\tilde{y}\mathrm{<mo\; stretchy="false">\; )\; </mo>}-\lambda \Vert \tilde{y}\Vert \ge {\varphi }_{\lambda }\left(x^{\circ }\mathrm{,}{y}^{\circ }\right)-\lambda \Vert \tilde{y}\Vert \\ \ge {\varphi }_{\lambda }\left(x^{\mathrm{<mo>\; *\; </mo>}}\mathrm{,}{y}^{\circ }\right)-\lambda \Vert \tilde{y}\Vert =\varphi \left(x^{\mathrm{<mo>\; *\; </mo>}}\mathrm{,}{y}^{\circ }\right)+\lambda \Vert y^{\circ }\Vert -\lambda \Vert \tilde{y}\Vert \\ \ge \varphi \left(x^{\mathrm{<mo>\; *\; </mo>}}\mathrm{,}{y}^{\mathrm{<mo>\; *\; </mo>}}\right)+\lambda \Vert y^{\circ }\Vert -\lambda \Vert \tilde{y}\Vert =g\left(x^{\mathrm{<mo>\; *\; </mo>}}\right)+\lambda \Vert y^{\circ }\Vert -\lambda \Vert \tilde{y}\Vert \\ \ge g\left(x^{\mathrm{<mo>\; *\; </mo>}}\right)-\lambda \Vert y^{\circ }\Vert \mathrm{.}\end{array}$

Since when $y_1=1,y_2=\cdots =y_m=0$ , ${\Vert y\Vert }_{\max }=1$ , and we then have $g\left(x^{\mathrm{<mo>\; *\; </mo>}}\right)-g\left(x^{\circ }\right)\le \lambda \Vert y\Vert \le \frac{\epsilon }{2}$ .

3. Adaptive Custom Proximal Point Algorithm

In this section, we adopt an adaptive custom proximal point (ACPP) algorithm to solve (4), which is quadratic and then can be approximately solved in a short time. From the optimal conditions of the problem and the convexity of related functions, the (4) can be solved by the followed by the variational inequality: for $x^{\circ }\mathrm{,}{y}^{\circ }$

$\Vert y\Vert -\Vert y^{\circ }\Vert +{\left(\begin{array}{c}x-x^{\circ }\\ y-y^{\circ }\end{array}\right)}^{\text{T}}\left(\begin{array}{c}-2y^{\circ \text{T}}A+x^{\circ }\\ -2A^{\text{T}}{x}^{\circ }-2b\end{array}\right)\ge 0$

And we denote

$u=\left(\begin{array}{c}x\\ y\end{array}\right),u^{\circ }=\left(\begin{array}{c}{x}^{\circ }\\ y^{\circ }\end{array}\right),F\left(u^{\circ }\right)=\left(\begin{array}{c}-2y^{\circ \text{T}}A+x^{\circ }\\ -2A^{\text{T}}{x}^{\circ }-2b\end{array}\right),\Omega =R^n\times R^m,$

then the variational inequality can be reduction to: find the solution $u^{\circ }\in \Omega$ , satisfy:

$\Vert y\Vert -\Vert y^{\circ }\Vert +{\left(u-u^{\circ }\right)}^{\text{T}}F\left(u^{\circ }\right)\ge \mathrm{0,}$ (5)

It’s easy to verify that F is monotonous, so (5) is monotonous, and then the solution set is not empty.

We denote

$\begin{array}{c}M=\left(\begin{array}{cc}t{I}_n& A^{\text{T}}\\ \theta A& s{I}_m\end{array}\right)=\left(\begin{array}{cc}t{I}_n+\left(1-\theta \right)\frac{1}{s}{A}^{\text{T}}A& A^{\text{T}}\\ \theta A& s{I}_m\end{array}\right)\left(\begin{array}{cc}{I}_n& 0\\ \left(\theta -1\right)\frac{1}{s}A& I_m\end{array}\right)\\ =H\tilde{M},\theta \in \left[-1,1\right]\end{array}$ (6)

We give the details of the (ACPP) method as in Algorithm 1.

Algorithm 1. A1: ACPP algorithm for the unweighted max-min dispersion model.

In mathematics, the arguments of the minimum (abbreviated arg min or argmin) are the points of the domain of some function at which the function values are minimized.

Convergence Analysis

We present a convergence theorem for A1 in this section. In order to proof our theorem, we now give some lemmas. The following lemmas 2-4 are standard results in [8] [9] [10] .

Lemma 2. For H and M in (6), assume $s>0,t>0$ , then the follow inequation is establish:

$ts>\frac{1}{4}{\left(1+\theta \right)}^2{\lambda }_{\max }\left(A^{\text{T}}A\right).$ (13)

where H and $\frac{1}{2}\left(M+M^{\text{T}}\right)$ is positive definite matrix.

Lemma 3. ${\tilde{u}}^k$ is the solution of (7), and M is defined in (6), then for $\forall u^{\circ }$ , we have

${\left(u^k-u^{\circ }\right)}^{\text{T}}M\left(u^k-u^{\circ }\right)\ge {\left(u^k-{\tilde{u}}^k\right)}^{\text{T}}M\left(u^k-{\tilde{u}}^k\right)$

Lemma 4. For $\tilde{M}$ and H in (6), there exist a constant $c_0>0$ , can make $\left\{u^k\right\}$ in (8) satisfy:

${\Vert u^{k+1}-u^{\circ }\Vert }_H^2\le {\Vert u^k-u^{\circ }\Vert }_H^2-\gamma \left(2-\gamma \right){\alpha }_k^{\circ }{c}_0{\Vert u^k-{\tilde{u}}^k\Vert }^2$

Now we can give the theorem of the ACPP algorithm.

Theorem 1. The ACPP algorithm is a shrinkage algorithm of the saddle point problem (4), and the sequence $\left\{u^k=\left(x^k,y^k\right)\right\}$ generated by the algorithm convergence to a solution of (4).

Proof. For $M\in R^{n\times n}$ , there exist a constant $c_0$ , we have $d^{\text{T}}Md\ge c_0{\Vert d\Vert }^2,\forall d\in R^n$ , when the inequation is hold, the ${\alpha }_k^{\circ }$ has a lower bound:

${\alpha }_k^{\circ }=\frac{c_0{\Vert u^k-{\tilde{u}}^k\Vert }^2}{{\Vert \tilde{M}\left(u^k-{\tilde{u}}^k\right)\Vert }_H^2}\ge \frac{c_0}{{\tilde{M}}^{\text{T}}M}.$

On the basis of lemma 4, we have

${\Vert u^{k+1}-u^{\circ }\Vert }_H^2\le {\Vert u^k-u^{\circ }\Vert }_H^2-\gamma \left(2-\gamma \right)\frac{c_0^2}{\Vert {\tilde{M}}^{\text{T}}M\Vert }{\Vert u^k-{\tilde{u}}^k\Vert }^2$

when $\gamma =1$ , ACPP algorithm is a H-norm shrinkage algorithm of the saddle point problem (4).

4. Numerical Results

In this section, we do some simple numerical comparisons. All the Numerical texts are implemented in Matlab R2014a and run on a laptop with 2.30 GHz processor and 4 GB RAM. We are now ready to apply Algorithm 1 to our model (4), which is shown in detail in Algorithm 2.

We present the numerical comparison between our ACPP algorithm and SDP-based algorithm proposed in [6] for solving $P_{ball}$ ( $\chi =\left\{x|\Vert x\Vert \le 1\right\}$ ). We note that when the weighted ${\omega }_i=1$ in [6] , the two algorithm can comparable. We do numerical experiments on 24 random instances of dimension $n=5$ , where the number of input point m varies from 6 to 30. All the input points $x^i\left(i=1,\cdots ,m\right)$ with $m=6,\cdots ,30$ orderly form an $n\times 450$ matrix. We randomly generate this matrix using the following Matlab scripts:

Rand (‘state’, 0); X = 2 * rand (n, 450)-1;

where the rand() is a random function that produces a random number between 0 and 1. We set $\epsilon ={10}^{-3},\lambda =\epsilon /2$ , and report the numerical results in Table 1.

Algorithm 2. A2: ACPP algorithm for max-min dispersion problem.

The columns cvx_opt present optimal objection function values of the 20 instance of $P_{ball}$ [6] . The next two columns present the statistical results over the 10 runs of the algorithm proposed in [6] and our ACPP algorithm, respectively. The subcolumns $v_{\max },v_{\min }$ and $v_{\text{ave}}$ give the best, the worst and the average objective function values found among 10 tests, respectively. The results show that compared with the SDP-based algorithm our algorithm is competitive in most cases.

From the table, we can see that the solution of our algorithm is very close to the exact solution of the second column, which is better than the SDP algorithm.

5. Conclusion

In this paper, we reformulate the max-min dispersion problem as a saddle point problem and then adopt an adaptive custom proximal point algorithm to obtain an approximation scheme. It can be proved that the proposed algorithm produces a ε-approximation solution to the max-min dispersion problem with equal weight. Numerical results show that the proposed algorithm is efficient.

Cite this paper

Tao, S.Q. (2018) An Efficient Proximal Point Algorithm for Unweighted Max-Min Dispersion Problem. Advances in Pure Mathematics, 8, 400-407. https://doi.org/10.4236/apm.2018.84022

References

NOTES

¹We call $g\left(x\right)$ is the ε-approximation of $g\left(x^{\mathrm{<mo>\; *\; </mo>}}\right)$ if $g\left(x\right)\ge g\left(x^{\mathrm{<mo>\; *\; </mo>}}\right)-\epsilon$ .