Public | STVC/PRM| 22.12.2007 | © Alle Rechte bei Robert Bosch GmbH, auch für den Fall von Schutzrechtsanmeldungen. Jede Verfügungsbefugnis, wie Kopier-

Public | STVC/PRM| 22.12.2007 | © Alle Rechte bei Robert Bosch GmbH, auch für den Fall von Schutzrechtsanmeldungen. Jede Verfügungsbefugnis, wie Kopier- und Weitergaberecht, bei uns.

IVA 3.5 – Intelligent Video Analysis

Bosch IVA 3.5 Introduction

Embedded analysis at the edge!

in BOSCH IP Encoders:

VIP X1600VideoJet X10/X20/X40

In BOSCH IP Cameras:Dinion IP

FlexiDome IPAutodome IP 100 Series



Introduction of BOSCH IVA 3.5

BOSCH IVA 3.5 is an Embedded Analysis – means a standalone solution with no PCs, OS or software to maintain

This embedded Analysis enables the so called „Intelligence at the Edge“

Our Latest BOSCH IP Network Video products have enough processor power to even allow to run functionalities like IVA additionally to the encoding

This helps in larger CCTV surveillance systems to provide more automation by

for excample what we at BOSCH call „Guard Assistance Systems“

Goal of using „Guard Assistance Systems“ is to move Video from pure Data

to Information and by that looking forward to be more proactive or even

preventive.



Introduction of BOSCH IVA 3.5

These Guard Assistance Systems are resulting in Benefits like

less bandwidth usage and less storage capacity needed less human interference and errors less time invest thanks direct immediate access to scenes of interest in

even huge Databases scanned by BOSCH Forensic Search within seconds

lower running expenses, maintainance, HW costs, timeinvest for search: signific improvement in search by „Google Search Functionality“ With additionally providing more reliability in alarm handling

Improved Security



VCA capabilities of encoders and IP cameras MOTION+ Motion detection

Standard feature, no additional license Built-in to all encoders and IP cameras Robust motion detection Object size discrimination

Tamper detection: video loss image too bright (detect blinding) image too dark (hooding, spray painting) image too noisy (camera defocused) gross scene change (camera repositioned) reference frame comparison



VCA capabilities of encoders and IP cameras IVMD 1.0 Intelligent Video Motion Detection

Add-on VCA feature for all VIP X and VJ X encoders and IP cameras

Licensable advanced Video Content Analysis option only license, no hardware or firmware change

Features: Background learning algorithm from Bosch’s own

research group up to 16 independent detector fields for alarm generation Size, speed and direction discrimination Camera calibration for metric and imperial measurements



IVA capabilities of encoders and IP cameras

IVA 3.5 Intelligent Video Analysis

Add-on VCA features for VIP X1600, VJ X10 family and IP Cameras

Licensable, more advanced Video Content Analysis option

only license, no hardware change

Self-explaining wizard-based GUI and “Click Object in Scene” for easy Setup and Configuration



IVA capabilities of encoders and IP cameras

Features: basic feature set from IVMD 1.0 improved object detection algorithm Additional filter for aspect ratio Additional filter for Color Histograms image stabilization for vibrating camera FIR Camera support Trajectories (follow route) Line Crossing (single/multiple) intrinsic application coverage:

idle object removed object loitering Condition change



Target markets

Outdoor and indoor use at Industrial estates, airports Public surveillance Traffic and Transportation Military areas Facility surveillance, Perimeterprotection Correctional facilities Museums, warehouses

Mainly: Higher security market in the whole world



IVA 3.5 – in a nutshell (1)

Simple configuration via wizard based GUI and “In scene click on object” selection

Flexible selection of active area and tasks sensitive area single or multiple tasks per camera

Perspective correction using improved 3D grid In Scene Camera calibration for metric/imperial

measures



IVA 3.5 – in a nutshell (2)

All tasks with filters to define: Colorhistogramm; Object size, speed, 2-way motion direction, aspect ratio

Statistics for Feedback and Overview about Alarms Detection of idle objects, removed objects, loitering,

line-crossing and trajectory, global change Camera image stabilization Enhanced Separation Algorithm Dynamic adaptation to

global lighting changes weather conditions like rain, snow, leaves, slow wind



Key Features “Idle object”

Object left in scene Vehicles stopped or parked Object (person) stopped moving

“Removed object” High value objects from displays in Retail or Museums

“Loitering” Banks, ATM, schools, Parking

„Image stabilisation“ pre-processing if camera is exposed to vibration or pole mounting

„Condition change“ Object changes Aspect Ratio/Size/Speed within a configurable time

„Line Crossing“ Single or multiple lines even with logical combination

„Trajectory“ Object following a certain route – mainly used in Forensic searches



IVA Technology (1)

Based on digital image processing Uses experience in vision-based automatic driving

concept for cars by Bosch Multi-level image analysis of

pixel changes texture analysis motion analysis

Image sequence

Adaptation of reference data

Analysis of pixel changes

Textural analysis

Motion Analysis

Object detection

12

3

4

5



IVA Technology (2)

IVA adapts automatically to the surveillance area by statistical analysis of measured image data.

IVA suppresses unwanted notification from trees, branches, leaves, clouds, rain, shadows and snow Providing reliable detection as shown here:



IVA – a System Feature Cameras and encoders

use IVA results as alarm triggers stream live metadata through the network

iSCSI or other Recording systems store both video and metadata

Management systems display metadata as video overlays use alarm triggers from edge devices

Replay gains fully free configurable Forensic search capabilities

on stored metadata not dependend onpreconfigured tasks.

Management Station

IP Network

Network-attached iSCSI

Camera with IVA

Encoder with IVA

Review Station



Metadata – the „vehicle“ of IVA Short and compact information given by the

VCA algorithm interpreting the image

Any related data can be added to metadata

Hierarchical structure for fast search on differently detailed levels

Distributed storage allows parallel search

Quickly available „forensic search“ results without watching for hours hundreds of unrelevant video

(„Google Search Functionality“)

Management Station

IP Network

Network-attached iSCSI

Camera with IVA

Encoder with IVA

Review Station



IVA General Operation Motion in all sensitive area is detected

size, speed, Color; direction, aspect ratio and perspective dependent Object not triggering an alarm is outlined in Yellow All detected objects are continuously compared

against filter settings When fitting, moving object is tracked in active area

object is outlined in RED Alarm is raised with definable actions

Trajectory lines are displayed in green MPEG-ActiveX component allows to

switch on/off outline display change of colour on alarm is already

working during configuration, Several Statistics allow operational proof And continuous fine tuning



IVA 3.5 Key Features Improved object detection algorithm

Objects are tracked even under difficult conditions with low contrast



IVA 3.5 Key Features Intrinsic applications (Please view Demo CD for explaining Clips!)

Idle object

An idle object will be discovered after a defined time, its idle state displayed, and then being learned into background.

The object’s idle state is displayed by red (alarm) or yellow blinking edge markers signed with an “I”.




Removed object

A removed object will be discovered as soon as a change in the formerly learned background has been identified.

Even if the moment of removing, happens during the object itself is covered by another (bigger, overlapping) object

The missing object is displayed by red (alarm) or yellow blinking edge markers signed with an “X”.




Loitering

Loitering is discovered when an object has been identified to stay within a configured area for a configured time.

The loitering object is displayed by red outlines and an alarm is generated.




Image stabilization

Image stabilization is of advantage if the camera is mounted on a lantern or fence pole which would move in strong wind or if shaken (tampered), or exposed to vibration, e.g. in a vehicle.

Pre-processing to make IVA work more reliable

without Image Stabilization with Image Stabilization




Trajectory

Trajectory – Object following a certain route is mainly used feature with forensic search in Databases




Line Crossing

Single or multiple linecrossings can be detected. even logical combination within the linecrossings are possible




FIR Camera Support

Far infrared Camera is supported with the IVA 3.5 with a functionality to adopt the algorithm exactly to the specific needs in respect to.



VMS handling IVA alarms Alarms from IVA are combined into

general motion alarm for quick detection

Video management systems can evaluate all 8 tasks separately, allowing Alarm differentiation to

prioritize alarm conditions combine specific alarm conditions create complex rules to work out

alarm scenarios

VIDOS, e.g., shows the first two VCA alarms separately, the remaining 6 tasks are combined into a collective third alarm

BVMS shows 8 VCA alarms separately,



Configuration (1)

Configuration Manager is used to configure IVA 3.5 click tab „VCA“ set motion detection to „ON“ select analysis

type „ IVA 3.5 “

Preview showsdetected objectswith outlines, trajectoriesand alarm states

Click „Select ...“ to enter configuration



Configuration (2)

Objects within the sensitive area are

marked with outlines or bounding boxes

An object, detected but not generating

an alarm, is outlined in yellow

An object, detected and generating an

alarm, is outlined in red

Trajectories are marked

as green lines



Configuration (3)

Right-click outside of a detector field to get the global settings menu

Size constraint defined by minimum and maximum

area size of detected objects in image

Extended functions idle object detection with global

delay before creating an alarm removed object detection image stabilization to remove jitter

from camera image, e.g. when mounted on a pole or in a vehicle

FIR Camera connected to the Encoder Enhanced Separation for improved

Anti merge.(Dynamic Occlusion)



Configuration (4)

The sensitive area can be set to the interesting zone to reduce the required calculation power

A set of drawing tools is offered via the menu



Configuration (5)

By default, the window shows one single detector field, covering the whole sensitive area

Up to 16 detection items (fields, routes, lines) can be defined and freely positioned

Up to 8 alarm tasks can be configured utilizing the configured detection items

Right-clicking the mouse in the related detector field opens the context menu to set all related parameters



Configuration (6)

A detector field without an object generating

an alarm is green

A detector field with an object generating an

alarm is red

The detector field can be selected for modification by simply clicking it

Click and drag a border line or right-click to add a node (vertex)

Click and drag a vertex to modify the shape Modify the polygone with up to 16 vertices

to match the area to be searched



Configuration (7)

Filters can be individually defined for each task

Each filter can be ranked by defining its Precesion with a slider

Filters can be defined by hand each or simply by using „clicked object data“

FILTERS: Object size in square meters * Object Aspect Ratio (relation length/broad) Object speed in km/h * Object motion direction one- or two-way

with independent angle settings Colorhistogramm of Object

* Measurements can be switched to imperial measures



Configuration (8)Configuration (8)

Colorhistogram: Click on the related color that shall be

detected (up to 5 colors can be selected per task)

The importance of the configured colors is from left to right: 25%; 20%; 15%;10%; 5% of the monitored object

With the “Saturation” slider the intensity of the monitored colors can be set up.

With the Slider “Precision” the accuracy of the monitored color, can be defined.

25% 20% 15% 10% 5%



Configuration (9)

Task wizard:

Loitering defined by spatial tolerance and delay Idle object idle time defined globally for all objects Removed object immediately detected on „background change“ Aspect ratio defined by minimal and maximal vertical to

horizontal ratio of objects Condition change

Aspect Ratio/Size/Speed within certain time Trajectory

Object following a certain route Object Enters/leaves/is inside area/field …others…



Configuration (10)

Metric measurements can be done when the camera is calibrated for viewing angle, perspective and sizes to represent the real view

3D grid placed into the camera scene allows to set viewing angle and perspective graphically

Two cubes representing a given size ease

adaptation to objects

*



Configuration (11)

Statistics once the detector field has been

configured statistics can be used to check the results of the settings and tweak them until the result equals the expectations

black zones indicate the active parameter range for creating alarms

*



Configuration (12)

Object properties The moment you click an object in the

scene, you will get a corridor of 30sec. shown with even all the specific information regarding this specific object.

You are welcome to take this information to configure a certain Task, by symply activating„ Use tracked object data“In the task wizard

*



Application Examples exclude unwanted areas (like glass building, sky, water, public areas) simple areas

watch a door watch a fence watch a place

multiple areas watch different areas, e.g. a few doors watch areas differently in same scene

direction detection one-way (wrong way) two-way (crossing, turning)

speed discrimination special cases in areas (entering/leaving/inside) special object behaviour (loitering, idle object, removed object, global

change)



License Activation (1)

Attention: IVA 3.5 is just an Upgrade of the main product IVA 3.0 In SAP and Licencing only IVA 3.0 is available and up- grades automatically with using the FW 3.5 to

the IVA 3.5

You require:

your „Authorization Number“ attached to the IVA 3.0 License Package

an IP Network Video product with firmware release 3.5 Web browser access to the product Internet access to use the Bosch

Software License Management System SLMS at http://activation.boschsecurity.com/

Then execute the following steps:




1. Open the product‘s license menu via the Configuration Manager using the „License“ tab or via the Web browser at

„SETTINGS->Service settings->Licenses“

2. Mark and copy the product‘s „Installation Code“

3. Visit the SLMS site and enter your „Authorization Number“(don‘t drop the blanks)




4. Paste the product‘s „Installation Code“ into the respective field

5. Fill in additional locationparameters and comments on your convenience

6. Click „Submit“ to get the „Activation Key“ displayed




7. Mark and copy the „Activation Key“

8. You may like to print this page or send the Activation Key via email




9. Paste the „Activation Key“ into the product‘s appropriate menu field and click „Set“

10. A confirmation message will be displayed below

Now you can start configuring your IVA 3.5By upgrading from an elder version IVMD 2.0 or IVA 3.0, the settings keep still available



Packaging – what you get An IVA 3.x license has content of delivery:

a printed manual in English with a license Authorization Number label

on the back of the manual additionally, a product CD

with software tools and documentation in other languages is included with the manual

all packed into an envelope with a product label in the lower left corner

Documents

Public | STVC/PRM| 22.12.2007 | © Alle Rechte bei Robert Bosch GmbH, auch für den Fall von Schutzrechtsanmeldungen. Jede Verfügungsbefugnis, wie Kopier-