ICTEAM > ISPGroup > Research@ISPGroup > MultiObjectTracking

Multiple object tracking with prior detections and graph formalisms

Our research considers the tracking of multiple objects in video sequences. Even though fairly good solutions have been proposed in the literature to track a small number of isolated objects, tracking remains challenging when the target featuresí ability to reliably discriminate objects varies across time and scene context. This is because most of the existing solutions assume that the features' relevance remains constant along the time, which generally simplifies the tracking formulation dramatically, typically by limiting the investigation of appearance similarities on short time neighbourhoods. In doing so, they assume that the inconsistency, measured along a path can be accurately measured by accumulation of the appearance dissimilarities measured between pairs of consecutive nodes.

In practice, however, most features are subject to non-stationary noise, and their relevance varies with time and space. This, for example, happens due to occlusions, illumination changes, scene complexity, etc. For example, color histograms appear to be quite noisy in presence of occlusions, and object positions do not help to disambiguate a clutter of targets. In other cases, highly discriminant features are only available sporadically. This occurs, for example, when cells are captured under changing illumination, each lightning condition emphasizing some specific characteristics of the cell. This case also happens when a feature is only visible in some observation configurations (e.g., a digit on a jersey of a player is only visible when facing the camera).

Figure: Appearance features can be noisy and/or sporadic.

Figure: Sporadic features help to prevent incompatible associations.

To address the above limitation, our research primarily aims at developing generic multi-object tracking methods that are able to cope with the variability of features relevance while matching the detections across time. In order to limit the scope of our research, we focus on the scenarios in which the plausible detections are known a-priori. Obviously, to fit the practical constraints of real-life cases, we do not assume that the pre-computed detections are reliable. They are just plausible.

In this context, we are currently investigating a deterministic framework using graph-based formalism.


Discriminative Label Propagation for Multi-object Tracking with Sporadic Appearance Features
Amit Kumar K.C., and Christophe De Vleeschouwer
International Conference on Computer Vision (ICCV 2013), Sydney, Australia
Paper, Demo

Iterative Hypothesis Testing for Multi-object Tracking with Noisy/Missing Appearance Features
Amit Kumar K.C., Damien Delannay, Laurent Jacques, and Christophe De Vleeschouwer
Detection and Tracking in Challenging Environments (DTCE) workshop on Asian Conference on Computer Vision (ACCV 2012), Daejeon, Korea
Paper, Supplementary material, Demo 1, Demo 2

Prioritizing the Propagation of Identity Beliefs for Multi-object Tracking
Amit Kumar K.C., and Christophe De Vleeschouwer
British Machine Vision Conference (BMVC 2012), Guildford, UK
Paper, 1 Page Abstract, Supplementary Material, Demo

Inline Demos:


IntelVision MultipleObjectTracking AnalysisInterpretation ResearchCategoryAll


ISPGroup Participant

Last updated December 05, 2017, at 02:39 PM