a very difficult task and we are not aware of any algoThis paper considers the decomposition of video sequences into so-called video object planes, which is required for the content-based representation of visual objects in MPEG-4. A new segmentation algorithm will be described that identifies physical objects using a morphological motion jiltel: For the object of interest, a twodimensional binary model is derived based on areas in the scene that are moving diferently from the background. This model is updated each frame to pick up possible rotation and changes in shape of the object. Temporal correspondence is established by a Hausdoif object tracker The binary model sequences guide the actual video object plane extraction. Since the model points correspond to edges detected by the Canny operatol; a high object boundary location is achieved. Experimental results demonstrate that our proposed technique can successfilly extract physical object from video sequences.