Theory of Combinatorial Algorithms Institute of Theoretical Computer Science Department of Computer Science ETH Zurich

Approximate Methods in Geometry
(251-0456-00L) - SS 2007


Time & Place


Instructors

Lecturers:
Bernd Gärtner, CAB G32.2
Uli Wagner, CAB G33.2
Emo Welzl, CAB G15.2

Assistant:
Marek Sulovský, CAB G32.1/ Tel: 044 632 80 75. e-mail:

Course description

The course is concerned with approximate geometric methods for the analysis of large data sets represented by point clouds.

Data is being collected in order to draw conclusions from it, i.e. to discover relations, make extrapolations into the future, etc. More often than not, data comes as a set or sequence of points describing objects, with each coordinate representing some quantification of some feature. On a computer such data is just a sequence of 0's and 1's; the need to analyze and "understand" it calls for means to support the process. One way is to visualize the data. For example, a data set representing a number of people by their respective heights and weights can be drawn as a point set in the plane, and this drawing may reveal some correlation that could be approximated by a linear function.

For a wide range of applications (brain research, robotics, statistics, bioinformatics, character and speech recognition, computer graphics etc.) this approach is too simplistic, for various reasons. First of all, the size of the data may be huge (in the millions and billions, and sometimes so huge that we cannot even store it). And secondly, objects may have many features, giving rise to sets of dimension in the hundreds - and we know that simple visualization methods tend to fail starting in dimension 4. (Many features may in fact be redundant, but it is part of the endeavor to find out which ones.)

Many of the arising problems appear to be too hard to be solved exactly in an efficient fashion. The course discusses several approximate methods for the analysis of large high-dimensional data sets that have been developed over the last years in response to the issues indicated above. While we have applications in mind for the questions we address, we emphasize theoretical aspects in the solutions.

Methods we cover are random sampling, grid structures, core-sets, well separated pair decomposition, low distortion low-dimensional embeddings. Applications we address are shape and dimension analysis, nearest neighbor search, clustering etc.

Examples for specific questions arising in these applications are the following: for some point in d-space, what is its closest neighbor in the point cloud? What is the closest pair in the point cloud? What is the "best" grouping of the points in the cloud into k groups? Which subset of the point set of size k provides the "best" description of the point cloud? What is the dimensionality of the point cloud and what does dimensionality mean here? Can the point cloud be embedded into a lower-dimensional space while preserving many of its characteristics?

Procedures, Testat, Exercises

In every lecture we provide you with an exercise sheet. You should solve it in written form and return the solutions at the beginning of the subsequent lecture. Solving the exercises in teams is not allowed. Your solutions will be graded. If you reach at least 80% of all possible points you will get the grade 6.0

Exam

There will be an oral exam of 15 minutes at the end of the course. Your final grade consists to 50% of the grade for the exam and to 50% of the grade for the exercises. Passing grades from both parts are required.

Language

English

Course material


Lectures Lecture Notes Problems

Lecture 1, March 20
Introduction to geometry
Chapter 1 [PDF]
Lecture 2, March 27
Low distortion embeddings
Chapter 2
Bibliography (Chapters1, 2)
[PDF]
Lecture 3, April 3
Low distortion embeddings
[PDF]
Lecture 4, April 10
SDP and maximum cut
[PDF] [solution]
Lecture 5, April 17
Lower bounds for the Hamming cube
[PDF]
Lecture 6, April 24
Low distortion embeddings
[PDF]
Lecture 7, May 8
Epsilon nets and VC dimension (1)
Chapter 3 [PDF]
Lecture 8, May 15
Epsilon nets and VC dimension (2)
[PDF]
Lecture 9, May 22
Epsilon nets and VC dimension (3)
[PDF]
Lecture 10, May 29
Bounding volumes: smallest enclosing balls
Chapter 4 [PDF]
Lecture 11, June 5
Smallest enclosing cuboids, Directional width
Chapters 5-6 [PDF]
Lecture 12, June 12
Directional width (2)
---
Lecture 13, June 19
Directional width (3)
---




Further Literature

References from the Lecture Notes

  • M.Badoiu and K.L.Clarkson. Optimal core-sets for balls.
    Submitted, 2002.

  • G.Barequet and S.Har-Peled. Efficiently approximating the minimum-volume bounding box of a point set in three dimensions
    J. of Algorithms (JoA), volume 38 (1), pages 91-109, January 2001.

  • K.Fischer and B.Gärtner. The smallest enclosing ball of balls: combinatorial structure and algorithms.
    Proceedings of the nineteenth annual symposium on Computational geometry, pages 292-301, 2003.

  • A.Goel, P.Indyk and K.R.Varadarajan. Reductions among high dimensional proximity problems.
    Proceedings of the twelfth annual ACM-SIAM symposium on Discrete algorithms, pages 769-778, 2001.

  • B.Schölkopf and A.Smola. Learning with Kernels.
    MIT Press, Cambridge Massachusetts, 2002.

  • E.Welzl. Smallest Enclosing Disks (Balls and Ellipsoids).
    In H.Maurer, editor, New Results and New Trends in Computer Science, volume 555 of Lecture Notes in Computer Science, pages 359-370, 1991.

  • Applications and data sets


    Last edited: March 28, 2007