Fast Area-Weighted Peeling of Convex Hulls for Outlier Detection

Abstract

We present a novel 2D convex hull peeling algorithm for outlier detection, which repeatedly removes the point on the hull that decreases the hull’s area the most. To find $k$ outliers among $n$ points, one simply peels $k$ points. The algorithm is an efficient heuristic for exact methods, which find the $k$ points whose removal together results in the smallest convex hull. Our algorithm runs in $\mathcal{O}\!\left(n\log{n}\right)$ time using $\mathcal{O}\!\left(n\right)$ space for any choice of $k$. This is a significant speedup compared to the fastest exact algorithms, which run in $\mathcal{O}\!\left(n^{2}\log{n}+(n-k)^{3}\right)$ time using $\mathcal{O}\!\left(n\log{n}+(n-k)^{3}\right)$ space by Eppstein et al. [12, 14], and $\mathcal{O}\!\left(n\log{n}+\binom{4k}{2k}(3k)^{k}n\right)$ time by Atanassov et al. [4]. Existing heuristic peeling approaches are not area-based. Instead, an approach by Harsh et al. [17] repeatedly removes the point furthest from the mean using various distance metrics and runs in $\mathcal{O}\!\left(n\log{n}+kn\right)$ time. Other approaches greedily peel one convex layer at a time [20, 2, 19, 30], which is efficient when using an $\mathcal{O}\!\left(n\log{n}\right)$ time algorithm by Chazelle [7] to compute the convex layers. However, in many cases this fails to recover outliers. For most values of $n$ and $k$, our approach is the fastest and first practical choice for finding outliers based on minimizing the area of the convex hull. Our algorithm also generalizes to other objectives such as perimeter.

1 Introduction

When performing data analysis, a critical first step is to identify outliers in the data. This has applications in data exploration, clustering, and statistical analysis [31, 9, 23]. Typical methods of outlier detection such as Grubbs’ test [15] are based in statistics and require strong assumptions about the distribution from which the sample is taken. These are known as parametric outlier detection tests. If the sample size is too small or the distribution assumptions are incorrect, parametric tests can produce misleading results. For these reasons, non-parametric complementary approaches based in computation geometry have emerged. Our work follows this line of research and is based on the fundamental notion of a convex hull. For a set of points $P$, the convex hull is the smallest convex set containing $P$ [10].

There are numerous definitions of outliers [22, 28, 3], but a general theme is that points without many close neighbors are likely to be outliers. As such, these outlying points tend to have a large effect on the shape of the convex hull. Prior work has applied this insight in different ways to identify possible outliers, such as removing points from the convex hull to minimize its diameter [1, 13], its perimeter [11], or its area [14, 12]. Motivated by the last category, we will consider likely outliers to be points whose removal causes the area of the convex hull to shrink the most. We propose a greedy algorithm that repeatedly removes the point $p\in P$ such that the area of $P$’s convex hull decreases the most. We call the amount the area would decrease if point $p$ is removed its sensitivity $\sigma\!\left(p\right)$. The removed point is guaranteed to be on the convex hull, and such an algorithm is known as a convex hull peeling algorithm [19, 30]. To find $k$ outliers, we peel $k$ points. Our algorithm is conceptually simple, though it relies on the black-box use of a dynamic (or deletion-only) convex hull data structure [18, 6]. We assume that points are in general position. This assumption may be lifted using perturbation methods [25].

Figure 1: Here point $v$ was peeled from the convex hull and replaced by $v^{\prime}$. The previous triangle $\triangle tuv$ for $u$ contained no points. However, when $u$’s triangle becomes $\triangle tuv^{\prime}$, the set of points $\Delta A$ affect the sensitivity $\sigma\!\left(u\right)$ of $u$. The size of $\Delta A$ may be $\Omega\!\left(n\right)$.

The main challenge is maintaining the sensitivities as points are peeled. When peeling a single point $v$, there may be $\Omega\!\left(n\right)$ new points affecting the sensitivity $\sigma\!\left(u\right)$ for a different point $u\neq v$, as in Figure 1. In that case, naively computing the new sensitivity $\sigma\!\left(u\right)$ would take $\Omega\!\left(n\right)$ time. Nevertheless, we show that our algorithm runs in $\mathcal{O}\!\left(n\log{n}\right)$ time for any $1\leq k\leq n$.

2 Related work

The two existing approaches for finding outliers based on the area of the convex hull took a more ideal approach. They considered finding the $k$ points (outliers) whose removal together causes the area of the convex hull to decrease the most. We call this a $k$-peel and note that it always yields an area smaller or equal to that of performing $k$ individual $1$-peels. It is not hard to come up with examples where the difference in area between the two approaches is arbitrarily large such as in Figure 2. Still, these examples are quite artificial and require that outliers have at least one other point close by. More importantly, these methods are combinatorial in nature, and much less efficient than our algorithm. The state-of-the-art algorithms for performing a $k$-peel run in $\mathcal{O}\!\left(n^{2}\log{n}+(n-k)^{3}\right)$ time and $\mathcal{O}\!\left(n\log{n}+(n-k)^{3}\right)$ space by Eppstein [12, 14] and $\mathcal{O}\!\left(n\log{n}+\binom{4k}{2k}(3k)^{k}n\right)$ time by Atanassov et al. [4]. While excellent theoretical results, for most values of $1\leq k\leq n$ and $n$, the running time of both of these algorithms is prohibitive for practical purposes. Our contribution is a fast and practical heuristic for these ideal approaches. There are also several results for finding the $k$ points minimizing other objectives such as the minimum diameter, perimeter, or area-enclosing rectangle [13, 29].

Figure 2: This figure demonstrates the limitations of our heuristic weighted-peeling approach. Clearly, the red squares are outliers, but because there are two squares close-by, the sensitivity of the red squares is minimal. Thus, our algorithm may peel all the valid points before peeling the outlier squares. Note that two $k$-peels for $k=2$ would be sufficient to remove all outliers.

Another convex hull peeling algorithm is presented in [17]. Unlike in area-based peeling, they repeatedly remove the point furthest from the mean under various distance metrics. Letting $d$ be the time to compute the distance between two points, their algorithm runs in $\mathcal{O}\!\left(n\log{n}+knd\right)$ time, which is also significantly slower than our algorithm for most values of $k$. Since they maintain the mean of the remaining points during the peeling process, each peel takes $\Theta\!\left(n\right)$ time.

Some depth-based outlier detection methods also use convex hulls. They compute a point set’s convex layers, which can be defined by iteratively computing $P\setminus CH(P)$ and are computable in $\mathcal{O}\!\left(n\log{n}\right)$ time [7]. Here, points are deleted from the outermost-layer-in [20, 2, 19, 30]. While efficient, the natural example in Figure 3 is a bad instance for this approach.

Figure 3: This example shows points drawn uniformly from a target disk $P$. Clearly, the outliers are the points marked as red squares. It shows the downside of peeling based on depth since many points have to be peeled before reaching the outliers on the second and third layers. In particular, if there are $n$ points drawn uniformly from $P$, then its convex hull has expected size $\mathcal{O}\!\left(n^{1/3}\right)$ [16].

3 Results

The main result of our paper is Theorem 3.1, that there exists an algorithm for efficiently performing area-weighted-peeling.

Theorem 3.1.

Given $n$ points in 2D, Algorithm 1 performs area-weighted-peeling, repeatedly removing the point from the convex hull which causes its area to decrease the most, in $\mathcal{O}\!\left(n\log{n}\right)$ time.

To prove Theorem 3.1, we derive Theorem 6.7, which bounds the total number of times points become active in any 2D convex hull peeling process to $\mathcal{O}\!\left(n\right)$.

Definition 3.2 (Active Points).

Let $(t,u,v)$ be consecutive points on the first layer in clockwise order. A point $p$ is active for $u$ if, upon deleting $u$ and restoring the first and second layers, $p$ moves to the first layer.

Intuitively, the active points are the points not on the convex hull that affect the sensitivities. Note that the active points form a subset of the points on the second convex layer. We define $A(u)$ to be the set of active points for point $u$ in a given configuration. Furthermore, all points in $A(u)$ can be found by performing gift-wrapping starting from $u$’s counterclockwise neighbor $t$ while ignoring $u$. We use this ordering for the points in $A(u)$. In Theorem 7.1, we show that our algorithm generalizes to other objectives such as perimeter where the sensitivity only depends on the points on the first layer and the active points.

4 Machinery

In this section, we describe some of the existing techniques we use. To efficiently calculate how much the hull shrinks when a point is peeled, we perform tangent queries from the neighbours of the peeled point to the second convex layer. The tangents from a point $q$ to a convex polygon $L$ can be found in $\mathcal{O}\!\left(\log{n}\right)$ time both with [27] and without [21] a line separating $q$ and $L$. In our application, such a separating line is always available, and either approach can be used. Tangent queries require that $L$ is represented as an array or a balanced binary search tree of its vertices ordered (cyclically) as they appear on the perimeter of $L$. To allow efficient updates to $L$ we use a binary tree representation that is leaf-linked such that given a pointer to a vertex its successor/predecessor can be found in $\mathcal{O}\!\left(1\right)$ time.

The convex layers of $n$ points can be computed in $\mathcal{O}\!\left(n\log{n}\right)$ time using an algorithm by Chazelle [7]. Given $l$ convex layers, after a single peel they can be restored in $\mathcal{O}\!\left(l\log{n}\right)$ time (Lemma 3.3 [24]). However, for our purposes we only need the 2 outermost layers for area calculations. As such, we explicitly maintain the two outermost layers $L^{1}$ and $L^{2}$, and we store all remaining points $P\setminus\left\{L^{1}\cup L^{2}\right\}$ in a center convex hull. To restore $L^{1}$ we use tangent queries on $L^{2}$ as in [24]. To restore $L^{2}$ we use extreme point queries on the center convex hull which we maintain using a semi-dynamic [18] or fully-dynamic [6] convex hull data structures supporting extreme point queries in worst case $\mathcal{O}\!\left(\log{n}\right)$ time and updates in amortized $\mathcal{O}\!\left(\log{n}\right)$ time.

5 Area-Weighted-Peeling Algorithm

In this section, we describe Algorithm 1 in detail and show that its running time is $\mathcal{O}\!\left(n\log{n}\right)$.

Figure 4: Using $u$’s neighbors, we can perform two tangent queries on $L^{2}$ to recover the first and last active point of $u$, labeled $u_{s}$ and $u_{e}$ respectively, in $\mathcal{O}\!\left(\log n\right)$ time. Because we represent $L^{2}$ as a leaf-linked tree, we can walk along $L^{2}$ to recover all points of $A(u)$. The shaded part of the figure represents $\sigma\!\left(u\right)$.

At a high level, we want to repeatedly identify and remove the point which causes the area of the convex hull to decrease the most. Such an iteration is a peel, and we call the amount the area would decrease if point $u$ was peeled the sensitivity $\sigma\!\left(u\right)$ of $u$. To efficiently find the point to peel, we maintain a priority queue $Q$ on the sensitivities of hull points. Only points on the convex hull may have positive sensitivity, and in lines 1-1 we compute the initial sensitives of the points on the convex hull and store them in $Q$. For a hull point $u$, to compute its sensitivity $\sigma\!\left(u\right)$ we find its active points $A(u)$. Note they must be on the second convex layer, and if $u$’s neighbors are $t$ and $v$, then the points $A(u)$ are in the triangle $\triangle tuv$. In line 1 we compute the two outer convex hull layers represented as balanced binary trees. That allows us to compute $A(u)$ using tangent queries on the inner layer from $t$ and $v$. Then $\sigma\!\left(u\right)$ can be found by computing the area of the polygon $\pentagon\!\left(t\circ v\circ A(u)\right)$.

As points are peeled (lines 1-1) layers $L^{1}$ and $L^{2}$ must be restored. To restore $L^{1}$ when point $u$ is peeled (line 1) we perform tangent queries on $L^{2}$ as in [24] to find $u$’s active points $A(u)$ (line 1) and move $A(u)$ from $L^{2}$ to $L^{1}$. See Figure 4 for an example of tangent queries from $L^{1}$ to $L^{2}$.

To restore the broken part of $L^{2}$, we perform extreme point queries on the remaining points efficiently using a dynamic convex hull data structure $D_{CH}$ (line 1) as in [18] or [6]. As described in Lemma 6.9, $A(u)$ is always contiguous on $L^{2}$. Therefore, removing $A(u)$ from $L^{2}$ requires us to restore it between two ”endpoints” $a$ and $b$. The first extreme point query uses line $\overline{ab}$ in the direction of $u$. If a point $z$ from $D_{CH}$ is found then at least two more queries are performed with lines $\overline{za}$ and $\overline{zb}$. In general, if $k$ points are found then the number of queries is $2k+1$. The $k$ points are deleted from $D_{CH}$. This all happens on line 1.

Next, we compute the sensitivities of the new points on the hull (line 1) and insert them into the priority queue. Finally, we update the sensitivities of $u$’s neighbors $t$ and $v$ (line 1), which, by Lemma 6.1(4), are the only two points already in $Q$ whose sensitivity changes.

Input: A set of $n$ points $P$ in 2D

1

2$L^{1},L^{2}\longleftarrow$ the first two convex layers of $P$

3 $Q\longleftarrow$ empty max priority queue

4 for $i=1$ to $\left|L^{1}\right|$ do

5       $u\longleftarrow L^{1}_{i}$

6       Compute sensitivity $\sigma\!\left(u\right)$ for $u$

7       $Q.insert\!\left(u,\sigma\!\left(u\right)\right)$

8      

9

10$D_{CH}\longleftarrow$ a dynamic convex hull data structure on $P\setminus\left\{L^{1}\cup L^{2}\right\}$

11

12for $i=1$ to $n$ do

13       $u\longleftarrow Q.extractMax$

14       $A(u)\longleftarrow$ $u$’s active points

15       Delete $u$ from $L^{1}$ and update $L^{1}$, $L^{2}$ and $D_{CH}$

16       for $i=1$ to $\left|A(u)\right|$ do

17             $\bar{u}\longleftarrow A(u)_{i}$

18             Compute sensitivity $\sigma\!\left(\bar{u}\right)$ for $\bar{u}$

19             $Q.insert\!\left(\bar{u},\sigma\!\left(\bar{u}\right)\right)$

20            

21      $t,v\longleftarrow$ neighbors of $u$ in $L^{1}$

22       Update $Q\!\left[t\right]$ and $Q\!\left[v\right]$

23      

24

Algorithm 1 Weighted peeling

5.1 Analysis

The hardest part of the analysis is showing that the overall time spent on lines 1 and 1 is $\mathcal{O}\!\left(n\log n\right)$. We first show that, excluding the time spent on these lines, the running time of Algorithm 1 is $\mathcal{O}\!\left(n\log{n}\right)$. In line 1 we compute the first and second convex layers in $\mathcal{O}\!\left(n\log{n}\right)$ time by running any optimal convex hull algorithm twice. In lines 1 to 1, we compute the initial sensitivities by finding the points active for each $u\in L^{1}$. As described above, we can do this by applying two tangent queries, allowing us to recover the first and last extreme point for $u$. We can walk along $L^{2}$ between them to recover $A(u)$. Once $A(u)$ is found for each $u$, we find $\sigma\!\left(u\right)$ by computing the area of the polygon $\pentagon\!\left(t\circ u\circ v\circ A(u)\right)$, where $t$ and $v$ are $u$’s neighbors. By Lemma 6.1(1), in this initial configuration each point on $L^{2}$ is active in at most three triangles. Thus, we make in total $\mathcal{O}\!\left(|L^{2}|\right)=\mathcal{O}\!\left(n\right)$ tangent queries, each of which costs $\mathcal{O}\!\left(\log n\right)$ time. Since the area of a simple polygon can be computed in linear time [26], all the area computations take $\sum_{u\in L^{1}}\Theta\!\left(1+\left|A(u)\right|\right)=\mathcal{O}\!\left(\left|L^{1}\right|+\left|L^{2}\right|\right)=\mathcal{O}\!\left(n\right)$ time. Therefore, the overall time to initialize the priority queue is $\mathcal{O}\!\left(n\log n\right)$.

Initializing $D_{CH}$ in line 1 takes $\mathcal{O}\!\left(n\log n\right)$ time [18]. In line 1, we can perform tangent queries on $L^{2}$ from $t$ and $v$ to find the first and last active points of $u$. In line 1, it will take no more than $\mathcal{O}\!\left(n\right)$ tangent queries to restore $L^{1}$ and $L^{2}$ throughout the algorithm by charging the queries to the points moved from the center convex hull to $L^{2}$ or from $L^{2}$ to $L^{1}$. Using an efficient dynamic convex hull data structure, it takes $\mathcal{O}\!\left(\log n\right)$ amortized time to delete a point and thus $\mathcal{O}\!\left(n\log{n}\right)$ time overall [18, 6]. We add points to the priority queue $n$ times, delete points from the priority queue $n$ times, and perform $\mathcal{O}\!\left(1\right)$ priority queue update operations for each iteration of the outer loop on line 1. Excluding lines 1 and 1 this establishes the overall $\mathcal{O}\!\left(n\log{n}\right)$ running time.

To bound the total time spent on line 1 to $\mathcal{O}\!\left(n\log n\right)$, we prove Theorem 6.7, bounding the total number of times points becomes active to $\mathcal{O}\!\left(n\right)$. Computing $\sigma\!\left(\bar{u}\right)$ in line 1 requires us to find $A(\bar{u})$, where $\bar{u}$ is a new point added to the first layer. From the theorem, it takes $\mathcal{O}\!\left(n\log{n}\right)$ time to compute $A(\bar{u})$ for every $\bar{u}$. In addition, because it takes $\Theta\!\left(1+|A(\bar{u})|\right)$ to compute $\sigma\!\left(\bar{u}\right)$ from $A(\bar{u})$, overall it takes $\mathcal{O}\!\left(n\right)$ time to compute $\sigma\!\left(\bar{u}\right)$ for every $\bar{u}$.

To bound the total time spent on line 1 on updating the sensitivities of $u$’s neighbors to $\mathcal{O}\!\left(n\log n\right)$, we prove Lemma 6.9. Together with Theorem 6.7, it implies the desired result.

6 Geometric properties of peeling

In this section, we develop an amortized analysis of peeling to show that lines 1 and 1 can be computed efficiently. We ultimately aim to show that the number of times that any point becomes active for any triangle is $\mathcal{O}\!\left(n\right)$, bounding the amount of work done to initialize new triangles to $\mathcal{O}\!\left(n\log n\right)$. Then we show that the amount of work done to update the sensitivities of neighbor points is proportional to the number of new active points for them and an additive $\mathcal{O}\!\left(\log n\right)$ term. Thus, updating the sensitivities over all $n$ iterations takes $\mathcal{O}\!\left(n\log n\right)$.

6.1 Preliminaries

When considering outer hull points, we use the notation $\triangle tuv$ for the triangle formed by $u$, its counterclockwise neighbor $t$, and its clockwise neighbor $v$. For a set of ordered vertices $V$ we let $\pentagon\!\left(V\right)$ be the polygon formed by the points in the (cyclical) order. We say $p\in\pentagon\!\left(V\right)$ if $p$ is strictly inside the polygon.

The following Lemma 6.1 combines a number of simple but useful propositions.

Lemma 6.1.

For a set of points $P$, the following propositions are true:

1. Any point $p\in P$ is active for at most three points on the first layer.

2. Let $\triangle tuv$ be a triangle for consecutive vertices $(t,u,v)$ on the first layer and let $p\neq q$ be points $p\in\triangle tuv$ and $q\in\triangle tpv$. Then $q\notin A(u)$.

3. Let $p$ be a point on any layer $k$. After deleting any point $q\neq p$ and reconstructing the convex layers, $p$ is on layer $k-1$ or $k$.

4. Let $(t,u,v)$ be consecutive vertices on the first layer $L^{1}$. Then if $u$ is deleted, among the vertices in $L^{1}$, only the sensitivities of vertices $t$ and $v$ change.

5. For adjacent points $(u,v)$ on the hull, $|A(u)\cap A(v)|\leq 1$.

Proof 6.2.

See Section 7.2 in the appendix.

6.2 Bounding the active points

We will show that once a point is active for a hull point, it remains active for that hull point until the point is moved to the first layer. This implies a much stronger result by Lemma 6.1(1): over the entire course of the algorithm, a point becomes active for at most three other points. To do so, we first show that for each peel the active points $A(u)$ remain in $u$’s triangle (Lemma 6.3) and second that the points in $A(u)$ remain active (Lemma 6.5).

Lemma 6.3.

Given a set of points $P$, for all adjacent hull points $(u,v)$ and for all points $p\in A(u)\setminus A(v)$, if $v$ is deleted then $p$ still remains within $u$’s triangle.

Proof 6.4.

Let $t$ be $u$’s other neighbor, and w.l.o.g. let the clockwise order on the hull be $(t,u,v)$. Then if $v^{\prime}$ is $u$’s new neighbor after deleting $v$, the clockwise order on the new hull will be $(t,u,v^{\prime})$. Because $p$ is active for $u$ before $v$ is deleted, $p\in\triangle tuv$.

First, we consider the case where $v^{\prime}\notin\triangle tuv$. We want to show that $p\in\triangle tuv^{\prime}$. Equivalently, that $p$ is in the intersection of the three half-planes $\overrightarrow{tu}$, $\overrightarrow{uv^{\prime}}$, and $\overrightarrow{tv^{\prime}}$. Clearly, $p$ must satisfy the half-planes $\overrightarrow{tu}$ and $\overrightarrow{uv^{\prime}}$ as these coincide with hull edges. In addition, since $v^{\prime}\notin\triangle tuv$, the half-plane for $\overrightarrow{tv}$ is a subset of the half-plane for $\overrightarrow{tv^{\prime}}$. Because $p\in\triangle tuv$, $p$ satisfies $\overrightarrow{tv}$. Therefore, $p$ must satisfy $\overrightarrow{tv^{\prime}}$.

Now we consider the case where $v^{\prime}\in\triangle tuv$. Assume that $p\notin\triangle tuv^{\prime}$. Then because we know that $p\in\triangle tuv$, either $p\in\triangle tv^{\prime}v$ or $p\in\triangle uv^{\prime}v$. If $p\in\triangle tv^{\prime}v$, by Lemma 6.1(2), $p$ could not have been active for $u$ prior to deleting $v$. If $p\in\triangle uv^{\prime}v$, $p$ is now outside of the convex hull. Either way, this is a contradiction.

The following Lemma 6.5 shows that if $p$ is in $A(u)$, it remains in $A(u)$ until moved to the first layer, after which it never becomes active again. It also shows that the active points $A(u)$ only change by adding or deleting points from either end, and thus can easily be found.

Lemma 6.5.

Given a set of points $P$, for all hull points $u$ and $v$ and for all points $p\in A(u)\setminus A(v)$, upon deleting $v$, $p$ is in $A(u)^{\prime}$, $u$’s new set of active points.

Proof 6.6.

Case 1 ($u$ is not adjacent to $v$)

If $u$ is not adjacent to $v$, there are no changes to $\triangle u$ upon deleting $v$, and thus, $A(u)=A(u)^{\prime}$.

For the following cases, assume that $u$ was adjacent to $v$. Then by Lemma 6.3, $p$ is still in the triangle defined by $u$ even after deleting $v$. Also, w.l.o.g. let $(u,v)$ be the clockwise ordering of the points, and let $v^{\prime}$ be $u$’s new neighbor.

Case 2 ($v^{\prime}\in A(u)$)

By Lemma 6.1(5), $A(u)\cap A(v)=v^{\prime}$. By Lemma 6.3, all points $A(u)\setminus\left\{v^{\prime}\right\}$ are in $\triangle tuv^{\prime}$. Because the second layer is a convex hull, each consecutive pair of points $(a,b)$ in $t\circ A(u)$ define a half-plane $\overrightarrow{ab}$ with only points from the first layer to the left of each half-plane. This is still the case after deleting $v$ by Lemma 3. Since the only new points on the first layer are $A(v)$ then all points in $A(u)\setminus\left\{v^{\prime}\right\}$ remain on the second layer. Thus, the gift-wrapping starting from $t$ wraps around all points in $A(u)\setminus\left\{v^{\prime}\right\}$. Gift wrapping can hit no new points because, if that were true, there must be some point on the second layer to the left of one of the half-planes in described above. Thus, $A(u)^{\prime}=A(u)\setminus\left\{v^{\prime}\right\}$.

Case 3 ($v^{\prime}\notin A(u)$)

Let $u_{e}$ be the last point $A(u)$. Similar to the previous case, the gift-wrapping certifies all points in $A(u)$. Again, wrapping will not hit new active points before wrapping around $u_{e}$ because that would imply the points hit were to the left of the half-planes described previously. When wrapping continues around $u_{e}$, several new active points may appear, until the wrapping terminates at $v^{\prime}$. Thus, $A(u)\subseteq A(u)^{\prime}$.

Theorem 6.7.

For any 2D convex hull peeling process on $n$ points the total number of times any point becomes active in any triangle is at most $3n$.

Proof 6.8.

This follows directly from the results of Lemma 6.1(1) and Lemma 6.5.

6.3 Updating sensitivities

Next, we show that the total time to update the sensitivities in line 1 when peeling all $n$ points takes $\mathcal{O}\!\left(\Delta+n\log{n}\right)$ time. Here $\Delta$ is the the number of times any point becomes active for any triangle. Theorem 6.7 proves that $\Delta=\mathcal{O}\!\left(n\right)$. The following lemma shows that the sensitivity of a point $u$ can be updated in time proportional to the increase to $\left|A(u)\right|$ and an additive $\mathcal{O}\!\left(\log{n}\right)$ term. Figure 5 shows an example of how the sensitivity of a point changes when its neighbor is peeled.

Lemma 6.9.

Let $(u,v)$ be points on the first layer. Consider a peel of $v$ where $\delta_{u}$ new points become active points for $u$. Then the updated sensitivity $\sigma\!\left(u\right)$ can be computed it $\Theta\!\left(\delta_{u}+\log n\right)$ time, excluding the time to restore the second and first layer.

Proof 6.10.

The sensitivity $\sigma\!\left(u\right)$ is equal to the area of the polygon $U=\pentagon\!\left(t\circ u\circ v\circ A(u)\right)$. By the shoelace formula, the area of $U$ can be computed as the sum $S(U)$ of certain simple terms for each of its edges [5, 8]. We consider how $U$, and thus $S(U)$, changes when $v$ is peeled. Inspecting the proof of Lemma 6.5, we see that at most two vertices are removed from $U$ and at most $1+\delta_{u}$ vertices are added to $U$. Furthermore, all the new vertices are located contiguously on the restored second layer and can be found in $\mathcal{O}\!\left(\delta_{u}+\log{n}\right)$ time using a tangent query from $u$’s new neighbor which replaces $v$. To update $\sigma\!\left(u\right)=S(U)$, we simply add and subtract the appropriate $\mathcal{O}\!\left(\delta_{u}\right)$ terms depending on the removed and added edges.

Figure 5: This figure shows how the sensitivity $\sigma\!\left(u\right)$ changes when point $v$ is peeled. The point $q$ is the intersection of the tangent from $v$ to $u_{e}$ and the tangent from $u$ to $v^{\prime}$, where $u_{e}$ is the last active point in $A(u)$ and $v^{\prime}$ is the first active point in $A(v)$. After the peel, $v^{\prime}$ replaces $v$ as $u$’s neighbor, and the points $\Delta A$ are newly active for $u$. The sensitivity $\sigma\!\left(u\right)$ before peeling $v$ was equal to the area of $\pentagon\!\left(t\circ u\circ v\circ A(u)\right)$. After peeling $v$, the sensitivity $\sigma\!\left(u\right)$ equals the area of $\pentagon\!\left(t\circ u\circ v^{\prime}\circ\Delta A\circ A(u)\right)$. Note how this can be computed in $\mathcal{O}\!\left(\left|\Delta A\right|\right)$ time from $\sigma\!\left(u\right)$ before the peel of $v$ by subtracting the red area of $\triangle uvq$ and adding the green area of $\pentagon\!\left(u_{e}\circ q\circ v^{\prime}\circ\Delta A\right)$.

7 Generalization and open problems

Theorem 7.1 shows that Algorithm 1 generalizes straightforwardly to other objectives such as peeling the point that causes the perimeter of the convex hull to decrease the most each iteration.

Theorem 7.1.

Let $u$ be a point and $O$ an objective where $\sigma_{O}\!\left(u\right)$ is the sensitivity of $u$ under $O$. Consider the following three conditions:

1. If $u\notin L^{1}$, then $\sigma_{O}\!\left(u\right)=0$.

2. If $u\in L^{1}$, then $\sigma_{O}\!\left(u\right)>0$, and $\sigma_{O}\!\left(u\right)$ depends only on $u$, $u$’s neighbors and its active points $A(u)$.

3. If a single point $p$ is added or removed from $A(u)$, then provided $\sigma_{O}\!\left(u\right)$ and the neighbors $a_{i}$ and $a_{j}$ of $p$ in $A(u)$, the new sensitivity $\sigma_{O}\!\left(u\right)^{\prime}$ can be computed in $\mathcal{O}\!\left(\log{n}\right)$ time.

If $O$ satisfies the above conditions, then Algorithm 1 runs in $\mathcal{O}\!\left(n\log{n}\right)$ time for objective $O$.

Proof 7.2.

By conditions C1 and C2, it is always a point $u$ on the first layer that is peeled. Furthermore, when $u$ is peeled only the sensitivities of the new points on the first layer and the neighbors of $u$ must be updated since they are the only points for which their active points or neighbors change. Thus, Algorithm 1 can be used for objective $O$. Now we will show that the runtime of Algorithm 1 remains $\mathcal{O}\!\left(n\log{n}\right)$.

First, observe that all parts unrelated to computing sensitivities behave the same and still take $\mathcal{O}\!\left(n\log{n}\right)$ time. By condition C3, for a point $u$ on the first layer, its sensitivity $\sigma_{O}\!\left(u\right)$ only depends on its neighbors and active points $A(u)$. As described in the proof of Lemma 6.9, when the set of points that affect $\sigma_{O}\!\left(u\right)$ changes, these points are readily available. The total number of neighbor changes is $\mathcal{O}\!\left(n\right)$ since, in each iteration, only the neighbors of the points adjacent to the peeled point change. The total number of changes to active points is $\mathcal{O}\!\left(n\right)$ by Theorem 6.7. If there are multiple changes to the active points in one iteration, such as when deleting one of $u$’s neighbors, we perform one change at a time and, by condition C3, the total time to update sensitivities is $\mathcal{O}\!\left(n\log{n}\right)$.

For concrete examples, we show how the three objectives area ($O_{A}$), perimeter ($O_{P}$), and number of active points ($O_{N})$ fit into this framework.

Let $f\!\left(\sigma\!\left(u\right),a_{i},p,a_{j}\right)=\sigma\!\left(u\right)-d\!\left(a_{i},a_{j}\right)+d\!\left(a_{i},p\right)+d\!\left(p,a_{j}\right)$ be a function for computing the sensitivity $\sigma\!\left(u\right)$ when $p$ is added to $A(u)$ between $a_{i}$ and $a_{j}$ (the functions where a point is removed from $A(u)$ or a neighbor of $u$ changes are similar). For $f$ to match each of the objectives it is sufficient to implement $d\!\left(\cdot,\cdot\right)$ as follows for points $a,b\in\mathbf{R}^{2}$:

1. $d\!\left(a,b\right)=\frac{1}{2}\left(a_{2}b_{1}-a_{1}b_{2}\right)$

2. $d\!\left(a,b\right)=\sqrt{\left(b_{2}-a_{2}\right)^{2}+\left(b_{1}-a_{1}\right)^{2}}$

3. $d\!\left(a,b\right)=1$

The case with $O_{A}$ is based on the shoelace formula. Additionally, for $O_{N}$ to satisfy condition C2, we add $1$ when computing the sensitivity of $u\in L^{1}$ to ensure that $\sigma\!\left(u\right)>0$ even if $|A(u)|=0$. For the three objectives, $f$ takes $\mathcal{O}\!\left(1\right)$ time to compute satisfying the $\mathcal{O}\!\left(\log{n}\right)$ time requirement from condition C3.

7.1 Open problems

The first open problem is extending the result to $\mathbf{R}^{3}$ or higher. Directly applying our approach requires a dynamic 3D convex hull data structure, and Theorem 6.7 has to be extended to 3D. Second, is it possible to improve the quality of peeling by performing $z$-peels, even for $z=2$ in $\mathchoice{{\scriptstyle\mathcal{O}}}{{\scriptstyle\mathcal{O}}}{{\scriptscriptstyle\mathcal{O}}}{\scalebox{0.6}{$\scriptscriptstyle\mathcal{O}$}}\!\left(n\right)$ time? Third, is there an efficient approximation algorithm for $k$-peeling?

Appendix

7.2 Proof of Lemma 6.1

Lemma 6.1(1)

Fix a point set $P$. Any point $p\in P$ is active in at most three triangles.

Proof 7.3.

First, note that a point can only be active for a hull point $u$ if it is located inside $\triangle u$, so it is sufficient to show that any $p$ is strictly inside at most three triangles. In addition, one can prove this by showing that $\triangle u$ only intersects with its neighbors’ triangles $\triangle t$ and $\triangle v$.

Consider some $\triangle z$, such that $z$ is not a neighbor of $u$. That is, $u$ is not one of the vertices of $\triangle z$. If $\triangle z$ intersects with $\triangle u$, then either a vertex of $\triangle z$ is inside $\triangle u$ or the convex hull is a self-intersecting polygon, both violating convexity.

Lemma 6.1(2)

Let $\triangle tuv$ be a triangle for consecutive vertices $(t,u,v)$ on the first layer and let $p\neq q$ be points $p\in\triangle tuv$ and $q\in\triangle tpv$. Then $q\notin A(u)$.

Proof 7.4.

By definition, $p\in\pentagon\!\left(t\circ v\circ A(u)\right)$ or $p\in A(u)$. Either way, $q\in\triangle tpv$ implies that $q\in\pentagon\!\left(t\circ v\circ A(u)\right)$, so $q\not\in A(u)$.

Lemma 6.1(3)

Let $p$ be a point on any convex layer $k$. After deleting any point $q\neq p$ and reconstructing the convex layers, $p$ is on layer $k-1$ or $k$.

Proof 7.5.

First we show that $p$ never moves inward to layer $k^{\prime}>k$. Consider the outermost layer $L^{1}$. By a property of convex hulls, every point $v$ inside the convex hull is a convex combination of the hull points whereas any point $u\in L^{1}$ is not a convex combination of $L^{1}-\{u\}$. If deleting $q$ causes $p\in L^{1}$ to descend to a layer inside $L^{1}$, that implies that $p$ is a convex combination of some subset of $P-\{q,p\}$. This contradicts the fact that $p$ is not a convex combination of $L^{1}-\{p\}$ and by extension is not a convex combination of $P-\{p\}$. Because of the recursive definition of convex layers, the proof for subsequent layers is symmetric.

Now we will show that $p$ never moves up more than one layer at a time. This is clearly true for $L^{1}$ and $L^{2}$ because only one point is completely removed from the structure at at time (i.e. shifts to layer 0). For layers $k\geq 3$, consider a point $p$ on layer $k$ that moves to layer $k^{\prime}\leq k-2$. Let $L^{*k^{\prime}}$ be the set of points on layer $k^{\prime}$ after deleting $q$. Let $L^{k-1}$ be the set of points on layer $k-1$ before deleting $q$.

Because $p\in L^{*k^{\prime}}$, no convex combination of the points in $L^{*k^{\prime}}-\{p\}$ equals $p$ by convexity. By the inductive hypothesis, all points on $L^{k-1}$ are convex combinations of $L^{*k^{\prime}}$ because upon deleting $q$ no point on $L^{k-1}$ advances above layer $k^{\prime}$. Furthermore, they are all convex combinations of $L^{*k^{\prime}}-\{p\}$ as $p$ itself is a convex combination of $L^{k-1}$. But if $p$ is not a convex combination of $L^{*k^{\prime}}-\{p\}$, and all the points on layer $k-1$ are convex combinations of $L^{*k^{\prime}}-\{p\}$, then prior to deleting $q$, $p$ was above layer $k-1$, which is a contradiction.

Lemma 6.1(4)

Let $(t,u,v)$ be consecutive vertices on the first layer $L^{1}$. Then if $u$ is deleted, among the vertices in $L^{1}$, only the sensitivities of vertices $t$ and $v$ change.

Proof 7.6.

Consider a vertex $z$ not adjacent to $u$. By the same arguments as in the proof of Lemma 6.1(1), the vertices defining $\triangle z$ do not change upon deleting $u$ because it does not intersect $\triangle u$. In addition, because their triangles do not intersect, $|A(u)\cap A(z)|=0$. Therefore, no points are removed from $A(z)$ upon deleting $u$.

Lastly, we will show that no points are added to $A(z)$ upon deleting $u$. Assume that there is some point $p$ added to $A(z)$ when we delete $u$. But if $p$ satisfies the conditions of being active for $z$ and $\triangle z$ did not change upon deleting $u$, it should have been active for $z$ before $u$ was deleted, which is a contradiction.

Because $\triangle z$ and $A(z)$ do not change upon deleting $u$, it must be that $\sigma\!\left(z\right)$ remains the same.

Lemma 6.1(5)

For adjacent points $(u,v)$ on the hull, $|A(u)\cap A(v)|\leq 1$.

Proof 7.7.

We assume the contrary. Let $p\neq p^{\prime}$ be two points such that $p,p^{\prime}\in A(u)\cap A(v)$. By the definition of active and Lemma 6.1(3), $p$ and $p^{\prime}$ must be on the second layer. W.l.o.g. let $(u,v)$ be the clockwise ordering of the points on the first layer. In addition, let $t$ be $u$’s counterclockwise neighbor.

Say that $p$ is the first point in $A(v)$. Then we have the tangent line $\overrightarrow{up}$ that defines $p$. By definition of tangent lines, no point on the second layer can be to the left of $\overrightarrow{up}$. But for $p^{\prime}$ to be active for $v$, then $p^{\prime}$ must be to the left of $\overrightarrow{pv}$. The only way to satisfy both half-planes is for $p^{\prime}$ to be placed such that $p\in\triangle tp^{\prime}v$, in which case by Lemma 6.1(2) $p$ cannot be in $A(u)$, which is a contradiction.