On-chip Monitoring for Self-Aware Multi-Stream Vision System

Abstract : The integration of multiple and technologically heterogeneous sensors (infrared, color, etc) in vision systems tends to democratize. Thus, the advanced driver assistance, 3-D vision, inspection systems or military equipment benefit from this multi-modal perception allowing to improve the resulting quality and robustness; or simply enabling the new applications. According to the applicative context, the parameters of each sensor can dynamically vary as well as the number of 'active sensors' used at the moment. This makes the design of computing resources very arduous task in the context of latency critical application. The proposed solution is based on the self-awareness of such vision system. We propose an original on-chip monitor, completed by an observation and command network-on-chip allowing the system resources supervision and their on-the-fly adaptation. We present the evaluation of the proposed monitoring solution through FPGA implementation. We estimate the cost of the proposed solution in the terms of surface occupation and latency. We show that the proposed solution guarantees a processing of 1080p resolution frames at more than 60 fps.
Type de document :
Pré-publication, Document de travail
Liste complète des métadonnées

Littérature citée [18 références]  Voir  Masquer  Télécharger

Contributeur : Eva Dokladalova <>
Soumis le : vendredi 9 juin 2017 - 11:40:08
Dernière modification le : jeudi 11 janvier 2018 - 06:20:23
Document(s) archivé(s) le : dimanche 10 septembre 2017 - 13:17:02


Fichiers produits par l'(les) auteur(s)


  • HAL Id : hal-01535640, version 1



Ali Isavudeen, Nicolas Ngan, Eva Dokladalova, Mohamed Akil. On-chip Monitoring for Self-Aware Multi-Stream Vision System. 2017. 〈hal-01535640〉



Consultations de la notice


Téléchargements de fichiers