In smart home environment, different kinds of system components including hardware elements, software components, network connections, and sensors are required to cooperate with each other to reduce environmental burden by energy management and to support human’s life allow for a comfortable lifestyle. This paper proposes a concept of an agent-oriented middleware for smart home that consists of various home electric appliances and various sensors related to smart grid or micro grid. The agents acquire variety of information, data, etc. from the smart home environment and store/manage them in a methodical manner. Then agents configure and provide the home energy management service, life-support service, multimedia service etc. based on the information and user requests. In this paper, we describe the concept, design and initial implementation based on our agent-oriented middleware. We implemented initial applications related to multimedia and energy management to confirm the effectiveness and feasibility of our middleware to apply for smart home.