You can preview videos from the storyboard view, as well as within the Video Editor.

When you are in list or grid mode of a Story, simply click the play button at the bottom of the page.

This opens the video preview and begins playing your video from the selected spot on the timeline.  To close the video preview and resume editing your story, click the X in the top right.