Technische Universität München Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz

DriveAssist – A V2X-Based Driver Assistance System for Android

Stefan Diewald, Andreas Möller, Luis Roalter and Matthias Kranz

Konstanz, September 11, 2012 Automotive HMI

Workshop at Mensch und Computer 2012

Technische Universität München Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz

11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 2

Outline

§  Motivation of our Solution

§  System Overview

§  DriveAssist - Functionality Overview

§  Supported Use-Cases

§  Live Demo

§  Conclusion and Future Work

Technische Universität München Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz

Motivation and State of the Art

11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 3

•  V2X-Communications §  Goal: Increase traffic safety and driving convenience §  In-Car-Applications and Services §  State of the Art: e.g. radio communication concepts, GeoNetworking, data

generation concepts

•  Smartphone Integration §  Android as an economic and easily accessible platform §  High availability of devices §  Users are accustomed to devices and HMI §  State of the Art: e. g. pothole/traffic sign detection, vehicle state monitoring

V2X- Communications

Smartphone Integration

Driver Assistance System

Technische Universität München Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz

Bridge the Gap – Automotive vs. Consumer

11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 4

time

Apps

Mobile Devices

Vehicle: electronics

Vehicle: mechanical

new old obsolete

Technische Universität München Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz

11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 5

System Overview

Technische Universität München Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz

11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 6

§  Reception and decoding of CAMs/DENMs (V2X) §  Warning generation on map view or with a warning screen §  Algorithms for complex scenarios with multiple events / participants §  Extendable platform to support Central Traffic Services (CTS), TomTom HD

Traffic implemented (screenshots)

DriveAssist – Functionality Overview (1)

Technische Universität München Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz

11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 7

§  Several customizable parameters (screenshots)

§  Database support

§  Debugging options

§  Location service supporting GPS, EGO CAM, AP/Network and static position

DriveAssist – Functionality Overview (2)

Technische Universität München Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz

11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 8

DriveAssist – Warning Screen

§  Background service running on the Android device §  Automatically triggered, shown on top of all other applications §  Shows distance and direction of next relevant traffic incident §  Configurable radius of interest §  Accompanied by text-to-speech (TTS) output

Technische Universität München Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz

11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 9

DriveAssist – Map View

§  Overview of (nearby) traffic incidents §  Driver awareness with configurable radius §  Notification about new traffic incidents §  Detailed information by tapping warning sign

Technische Universität München Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz

11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 10

Supported Use-Cases Signaled by DENM: 1.  Electronic Emergency Brake Lights 2.  Working Area Warning 3.  Stationary Vehicle Warning 4.  Hazardous Location Notification 5.  Traffic Jam Ahead Warning

Images 2, 4, 5: from http://de.wikipedia.org/wiki/Bildtafel_der_Verkehrszeichen_in_Deutschland

1 2 3 4 5 6

Signaled by CAM: 6. Approaching Emergency Vehicle

Priority Mechanisms: 1.  Moving events have higher priority than static events. 2.  Events with decreasing distance to user have higher priority than

events with increasing distance. 3.  Near events have higher priority than events which are further away.

Technische Universität München Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz

11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 11

Scenario 1

Live Demo

Scenario 2

Technische Universität München Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz

11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 12

Conclusion and Outlook

§  DriveAssist as first research prototype §  Combination of V2X communication and central traffic services:

Good operability from the beginning on, even when there are only a few vehicles equipped with V2X

§  Active and passive awareness and warning element

Future Work: §  Evaluation of DriveAssist: user study §  HMI rework §  Integration of route and map context

Technische Universität München Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz

11.09.2012 Dipl.-Ing. Stefan Diewald Automotive HMI 13

DriveAssist – A V2X-Based Driver Assistance System for Android

Technische Universität München Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz

Thank you for your attention! Questions?

? ? 20.09.2012 Luis Roalter 14

stefan.diewald@tum.de www.vmi.ei.tum.de/team/stefan-diewald.html

Technische Universität München Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz

Paper Reference

•  Please find the associated paper at: https://vmi.lmt.ei.tum.de/publications/2012/DriveAssist_preprint.pdf

•  Please cite this work as follows: •  Stefan Diewald, Andreas Möller, Luis Roalter, Matthias Kranz. 2012.

DriveAssist - A V2X-Based Driver Assistance System for Android In: Automotive HMI Workshop at Mensch und Computer 2012, Konstanz, Germany, September 2012

20.09.2012 Luis Roalter 15

Technische Universität München Fachgebiet Verteilte Multimodale Informationsverarbeitung Prof. Dr. Matthias Kranz

If you use BibTex, please use the following entry to cite this work:

20.09.2012 Luis Roalter 16

@inproceedings{DBLP:conf/mc/DiewaldMRK12, author = {Stefan Diewald and Andreas M{\"o}ller and Luis Roalter and Matthias Kranz}, title = {{DriveAssist - A V2X-Based Driver Assistance System for Android}}, booktitle = {Mensch {\&} Computer Workshopband}, year = {2012}, pages = {373--380}, ee = {http://dl.mensch-und-computer.de/handle/123456789/2990}, crossref = {DBLP:conf/mc/2012w}, bibsource = {DBLP, http://dblp.uni-trier.de}, } @proceedings{DBLP:conf/mc/2012w, editor = {Harald Reiterer and Oliver Deussen}, title = {Mensch {\&} Computer 2012 - Workshopband: interaktiv informiert - allgegenw{\"a}rtig und allumfassend!? Konstanz, Germany, September 9-12, 2012}, booktitle = {Mensch {\&} Computer Workshopband}, publisher = {Oldenbourg Verlag}, year = {2012}, ee = {http://dl.mensch-und-computer.de/handle/123456789/2858}, bibsource = {DBLP, http://dblp.uni-trier.de}, }