In this paper, we present stereo vision based real-time object extraction algorithm. this algorithm can be used for Smart Human Gesture Interface. we use 2D motion and 3D depth information for this algorithm. this algorithm is robust to noise and illumination change.