Video thumbnail preview in xp

I wanted to know if there is any software which can play videos right in explorer itself. something like if you roll your cursor on it, a small window opens up and the video plays, or the thumbnail starts playing.

it would be a great help if that can be done.

i have done it in flash, but for that i have to convert everything to .flv format.

Is there any other option?