Support video with an alpha channel (transparency) so that one video can frame some other content

I want to be able to use one video with an alpha channel as a "frame" and overlay it on top of another video that is the main focus. For now, I'm simply layering the one video on top of the other, but that means that there are really hard edges at the edge of the video.