We consider the problem of estimating the motion of a light source, given a sequence of images of a stationary, unknown object illuminated by it. The apparent ow eld induced on the image plane is used to recover the motion parameters. The motion is assumed to be uniform between the successive image frames. A recursive total least squares estimator is developed in this paper to track the motion of the illuminant. We present typical simulation results to validate the proposed scheme.