Senses for Safety

Driver assistance systems help save lives

Chassis & Safety | Advanced Driver Assistance Systems

Elektronische Sinne und Künstliche Intelligenzfür das Automatisierte Fahren

Donnerstag, 11. Mai 2017, 18:00 Uhr

Graf-Zeppelin-Haus Friedrichshafen

Public

BU ADAS 11 May 2017

2Dr. Thomas Brohm © Continental AG

Your SpeakerDr. Thomas Brohm› born 1963 in Stuttgart, Germany

› graduate degree and PhD in physics

› 23 years in automotive, 18 years at Continental

› head of engineering, business unit ADAS

source: VARTA AG

Public

BU ADAS 11 May 2017

3Dr. Thomas Brohm © Continental AG

near

far

distant

individual

mobility

machinepilotself

near

source: mercedes.com

images: pixabay.com

Public

BU ADAS 11 May 2017

4Dr. Thomas Brohm © Continental AG

Benefits of Assisted and Automated DrivingSafetyEfficiencyAvailability

source: bmwblog.com

source: cbc.ca source: ourdailybreadalbany.com

Public

BU ADAS

0

5

10

15

20

25

1953 1958 1963 1968 1973 1978 1983 1988 1993 1998 2003 2008 2013 2018

11 May 2017

5Dr. Thomas Brohm © Continental AG

1973: Safety Seat Belt

1978: ABS

1995/96: ESC, BA, Euro NCAP

1982: Airbag

1985: Front Passenger Airbag

1998: ACC2001: LDW

* Federal Statistics Office, Germany (Destatis);

ABS - Anti-lock Brake System, ESC - Electronic Stability Control , BA - Brake Assist, ACC - Adaptive Cruise Control, LDW - Lane Departure Warning, AEB – Autonomous Emergency Braking

10

00

Fa

taliti

es

pe

r Y

ea

r

2006: AEB

Evolution of Vehicle Safety TechnologiesFatal Accidents in Germany 1953-2016*

Public

BU ADAS 11 May 2017

6Dr. Thomas Brohm © Continental AG

Benefits of Assisted and Automated DrivingSafety

EfficiencyAvailability

Public

BU ADAS 11 May 2017

7Dr. Thomas Brohm © Continental AG

Benefits of Assisted and Automated DrivingSafetyEfficiency

Availability

source: gosanangelo.comsource: carinsurancecomparison.com

source: bast.de

Public

BU ADAS 11 May 2017

8Dr. Thomas Brohm © Continental AG

Electronic Senses for Assisted and Automated DrivingUltrasonicRadarLidarCamera

SHORT RANGE RADAR

SURROUND VIEW

& ULTRASONICHIGH – RESOLUTION

FLASH LIDAR

CAMERA (opt. LIDAR) ASS./AUT. DRIVING

CONTROL UNIT

LONG RANGE RADAR

STEREO CAMERA

eHorizon

cloud

services

Public

BU ADAS 11 May 2017

9Dr. Thomas Brohm © Continental AG

Electronic Senses for Assisted and Automated DrivingUltrasonic

RadarLidarCamera

Capturing the

Enviromment

Public

BU ADAS 11 May 2017

10Dr. Thomas Brohm © Continental AG

0

0,5

1

1,5

2

WeatherRobustness

Dark & GlarePerformance

Image Range& Resolution

Rel. VelocityMeasurement

ObjectClassification

3D ShapeDetection

Electronic Senses for Assisted and Automated DrivingUltrasonic

RadarLidarCamera

Public

BU ADAS 11 May 2017

11Dr. Thomas Brohm © Continental AG

environment sensing

field of view (h x v)

wavelength

resolution

luminosity range *

blind periods

3D perception

sense-plan-act time **

raw data rate

data processing

* instantaneous ** unexpected obstacle

human driver

160° x 130°

400 – 700 nm

0.02°

100 k : 1

5%

mental reconstruction

2 s

[ 10 Mbit/s ]

[ >10 Pflops ]

[ ] digital equivalent

self-driving car

360° x 120°

400 – 1000 nm

0.03°

10 bn : 1

0%

direct measurement *

0.5 s

10 Gbit/s

10 Tflops

* with radar & lidar

Electronic Senses for Assisted and Automated DrivingMachines Outperform Humans in Environment Sensing

Public

BU ADAS 11 May 2017

12Dr. Thomas Brohm © Continental AG

Electronic Senses for Assisted and Automated DrivingHumans Have Excellent Object Detection Capabilities

Queen Elizabeth II

Human Vision

Pattern Recognition

System trained by

Human Learning

lookalikes

false positive

true negative

source: 21entertainment.co.uk

source: royal-lookalikes.co.uk

real ones

true positive

false negative

source: gala.de

source: mirror.co.uk

Public

BU ADAS 11 May 2017

13Dr. Thomas Brohm © Continental AG

Electronic Senses for Assisted and Automated DrivingMachines Have Limited Object Detection Capabilities

Queen Elizabeth II

lookalikes

false positive

true negative

real ones

true positive

false negative

Computer Vision

Pattern Recognition

System trained by

Machine Learning

Public

BU ADAS 11 May 2017

14Dr. Thomas Brohm © Continental AG

From Environment Sensing to Scene UnderstandingMachines Learn to Improve

Object Detection

by Feature Classification

3D Reconstruction

by Structure-from-Motion

+Computer Vision

classical methods

Scene Understanding

=Road

Road Boundary Car

Pedestrian

Semantic Segmentation

by Deep Neural Network

+

enhanced by

Deep Neural Networks

Public

BU ADAS 11 May 2017

15Dr. Thomas Brohm © Continental AG

the vehicle environment and state

The Chain of Effects Asssisted and Automated Driving are based on

and decide the

actions along the path

with actuatorsand control systems

Public

BU ADAS 11 May 2017

16Dr. Thomas Brohm © Continental AG

From Assisted to Automated DrivingDriving Functions for Many Scenarios

Safety Functions

Maneuvering Functions

Cruising Functions

Public

BU ADAS 11 May 2017

17Dr. Thomas Brohm © Continental AG

From Assisted to Automated DrivingDriving Functions for Many Scenarios

control

authority

human

(low)

machine

(high)

driver

(automation)

driving

scenarios

regular

long

huge

hazard

short

low

type

duration

complexity

SAE J3016

UN-ECE, FMVSS

Public

BU ADAS 11 May 2017

18Dr. Thomas Brohm © Continental AG

From Assisted to Automated Driving

Level 0

Level 1

Level 2

Level 3

Level 4

Level 5

Driver Only

Assisted

PartialAutomation

ConditionalAutomation

HighAutomation

FullAutomation

Chauffeur

Assistant

Robot

Driver Only

Assistant

Chauffeur

‘Vehicle supports the driver.

Driver must monitor the system at all times.’

‘Vehicle performs driving functions

partially or fully.’

Source: SAE J3016

Public

BU ADAS 11 May 2017

19Dr. Thomas Brohm © Continental AG

From Assisted to Automated Driving Enabling Developments

Testing andValidation

Public

BU ADAS 11 May 2017

20Dr. Thomas Brohm © Continental AG

From Assisted to Automated DrivingEnabling Developments

Sensors and Actuators

p

t

Public

BU ADAS 11 May 2017

21Dr. Thomas Brohm © Continental AG

From Assisted to Automated DrivingEnabling Developments

Car2X andeHorizon

Public

BU ADAS 11 May 2017

22Dr. Thomas Brohm © Continental AG

From Assisted to Automated Driving Enabling Developments

Human MachineInterface

source: mercedes-benz.com

Public

BU ADAS 11 May 2017

23Dr. Thomas Brohm © Continental AG

From Assisted to Automated DrivingEnabling Developments

Cognitive Systems

source: salon.com

Public

BU ADAS 11 May 2017

24Dr. Thomas Brohm © Continental AG

Mercedes: ‚intelligent drive‘

Nissan: ‚intelligent driving‘

Ford: ‚smarter safer driving‘

Toyota: ‚safety sense‘

Hyundai: ‚ intelligent safety‘

Audi: ‚piloted drive‘

Volvo: ‚drive me‘

Honda: ‚ automated drive‘

BMW: ‚connected drive‘

Uber: ‚autonomous taxi‘

Tesla: ‚autopilot‘

Google: ‚self-driving car‘

source: mercedes-benz.com

source: media.blog.alliance-rnault-nissan.com

source: autoguide.com

source: toyotoaoforlando.com

source: drive.com.au

source: audi-mediacenter.com

source: carsuk.net

source: caradvice.com.au

source: bimmertoday.de

source: wired.com

source: wccftech.com

source: engadget.com

Public

BU ADAS 11 May 2017

25Dr. Thomas Brohm © Continental AG

Lindau Ulm

RiemerlingMemmingen

Frankfurt

Ingolstadt

Continental Business Unit ADAS in Germany

Continental

Geschäftsbereich

Fahrerassistenzsysteme

Peter-Dornier-Str. 10

88131 Lindau, Germany

Telefon +49 8382 9699 200

www.continental-automotive.de