Efficient transport of streams with acceptable playout quality in in heterogenous, dynamic environment (e.g. home networks) requires management of both networks and CPUs. This paper presents a framework for applying real-time resource management methods for decoupled video streaming of heterogenous devices. It is based on a global abstraction of device states, which reduces system state information and decreases overheads for its determination and dissemination. It provides access to the entire system state in acceptable fresh way, enabling system wide optimized decisions to be taken. This work has started as part of a FABRIC EU IST project. The aim of the FABRIC project was to develop an architecture in which several interoperability standards and technologies in the home networking context can be integrated. In addition, the FABRIC aimed to handle the complete network to satisfy End-to-End Quality of service (QoS) requirements. In this paper we propose an adaptive QoS framework for efficient resource management, called the Matrix approach. The Matrix is a concept to abstract from having detailed technical data at the middleware interface. In stead of having technical data referring to QoS parameters like: bandwidth, latency and delay we only have discrete portions that refer to levels of quality. The underlying middleware must interpret these values and map them on technical relevant QoS parameters.