In this paper, we propose a multi-buffer scheduling scheme for streaming video systems. A transmission rate is obtained via a rate control algorithm, which optimally utilizes the network bandwidth and client buffer resources. The server side maintains multiple buffers for packets of different importance levels. It schedules the transmission of each packet based on the source buffer size and playback deadline to reduce the end-to-end distortion. The performance of proposed scheme is evaluated in terms of peak signal-to-noise ratio (PSNR) in the simulations, and the simulation results demonstrate the improvement of the average PSNR values compared with two other scheduling schemes.