Video segmentation became popular and most important in the digital storage media. Effective segmentation is a challenging problem in digital storage media. In this video segmentation technique, initially similar shots are segmented, and subsequently the track frames in every shots are assorted using the extracted objects of every frame which highly reduces the processing time. In this hybrid video segmentation technique, it yields the effective video segmentation results by performing intersection on the segmented results provided by both the frame difference method as well as consecutive frame intersection method. The frame difference method considers the key frame as background and it segments the dynamic objects whereas the frame difference method segments the static and dynamic objects by intersection of objects in consecutive frames. The new hybrid technique is evaluated by varying video sequences and the efficiency is analyzed by calculating the statistical measures and kappa coefficient.