The paper deals with a novel segmentation technique applicable to colour video sequences. The algorithm uses Fast Marching Method for automatic extraction of semantic objects from natural colour video sequences by joint motion and colour analysis. The algorithm handles background in the same way as other objects, thus it does not need global motion compensation. The number of control parameters is small.