A comprehensive vision-aware-computing-based interactive system with agent-based collaborative information processing

In this chapter, we present an application of image-recognition-based awareness computing for a mixed reality interactive system. Related issues, such as intelligent human-computer-interaction (HCI), information security, quality of experience (QoE) and quality of service (QoS), have been discussed regarding the enhancement of information processing for mixed reality applications. Aiming at an intelligent solution to the issues, the concept of agent awareness and agent-aware computing are proposed and discussed. We focus on awareness of interactive target, awareness of user-experience, awareness of system performance, awareness of confidentiality, and awareness of agent identification. The strategies, such Thorne as context pattern analysis, data-aware user experience management, and data-aware confidential communication, and scalable learning, are applied to perform that agent-aware computing in the system. Each processing in the system is designed as an agent responsible for a specific computing. All the agents collaborate to perform tasks for mixed reality applications, including information capture, scenario fusion, context pattern analysis, user data management. Related agent subsystems, such as camera system, QoE-QoS Management, scenario fusion, analysis of target of interest (TOI), user identification, confidentiality processing, are designed and implemented. Related results are given as well. The results show that the system can capture and process the information of user collaboratively with the QoE-QoS balance and confidential communication and perform scenario fusion for mixed reality applications.