LSDE2015 · LSDE2015-2016 · LSDE2016 · LSDE2017 · LSDE2018 · VU Canvas
LSDE: Large Scale Data Engineering 2018

Dataset. The Actuale Hoogtekaart Nederland (AHN) is a so-called point-cloud, consisting of 3D points measured using LIDAR technology. LIDAR stands for Light Detection and Ranging - a remote sensing method that uses light in the form of a pulsed laser to measure ranges to the Earth, in the case of AHN taken from an airplane. We got 2TB of point cloud data for you to analyze.

You may find the following Spark package useful: https://github.com/IGNF/spark-iqmulus though it works only with Spark 1.6.2 (which you would have to install yourself, as the preinstalled version now is 2.1.1)

C0: Tom Tom. Tom Tom gave access to an internal dataset of road trips, which could be combined with the point cloud data.

Summary. The topic of the project was changed as this team is affiliated with TomTom and therefore had access to additional datasets. So, the idea became to exploit LIDAR data to predict scenic drives, which was only partially a success. The project eventually performed complex spatial aggregation exploiting additional datasets (ranked routes from GPSies and point-of-interest data) on a bunch of paths and this does provide interesting results.

Data Curiosity: ****
Paper Writing: ****
Technical difficulties mastered: ***
Visualization coolness: ****

Scenic Routes -- Jayme Bird and Stephen Nicholas Swatman (paper)