In the context of the DrivSco project, we applied the Early Cognitive Vision framework to the problem of interpreting visual scenes in a driving context. This involved several components:
First, making use of the semantics attached to the visual primitives and the relations thereof in the Early Cognitive Vision framework, we designed a Bayesian driving scene interpretation approach [2,3,4]. This was concerned with the extraction of the road's lanes and driving relevant signs.
Second, one important information to be processed by a driver assistance system is other vehicles on the road. We approached this problem by combining an optic flow based independent motion detection technique with a sparse feature-based tracking and modelling of independently moving objects [1].
This is illustrated by the following video of the system's analysis of a typical driving scene.
This research was conducted at the Cognitive Vision Lab, of the University of Southern Denmark, as part of the European project DrivSco. Acknowledgements: Lars Baunegaard With Jensen, Emre Başeski, Bart Boesman, Younes Peter Touati, Karl Pauwels, Marc Van Hulle, Florian Pilz, Sinan Kalkan, Florentin Wörgötter and Norbert Krüger (see references for details).
[1] Pugeault, N., Pauwels, K., Van Hulle, M., Pilz, F., and Krüger, N. (2010). A multi-level architecture for detection and tracking of independently moving objects. In Proceedings of the Int. Conf. on Computer Vision Theory and Applications (VISAPP'10), (pdf)
[2] Baseski, E., Baunegaard With Jensen, L., Pugeault, N., Pilz, F., Pauwels, K., Van Hulle, M. M., Wörgötter, F., and Krüger, N. (2009) Road Interpretation for Driver Assistance Based on an Early Cognitive Vision System. In Proceedings of the Int. Conf. on Computer Vision Theory and Applications (VISAPP'09), 2009, 1, 496-505 (pdf)
[3] Boesman, B., Baunegaard With Jensen, L., Başeski, E., Pugeault, N., and Kruger, N. (2009). Bayesian reasoning using 3D relations for lane marker detection. In Proceedings of VMV 2009. (pdf)
[4] Baunegaard With Jensen, L., Başeski, E., Pugeault, N., Kalkan, S., Wörgötter, F., and Krüger, N. (2008) Semantic Reasoning for Scene Interpretation. International Cognitive Vision Workshop, ICVW 2008, at the International Conference on Computer Vision System, ICVS 2008