Media preview on windows explorer

There's a single software you need to have video previews on windows explorer and that is Media Preview from babelsoft.

It does not install codecs and both 32 and 64 bit version of windows are supported.