OpenAI’s Sora offers a fantastic platform for unleashing creativity, but how does it handle the task of recreating existing videos? I tested the software to find out, and the results were decidedly mixed.
My Experience Replicating a Video with Sora
To get started, I uploaded a video directly to gauge Sora’s effectiveness at replication. I also tried using prompts and storyboarding to see how these methods would compare. Here’s the video I provided to Sora:
Ultimately, my results were quite inconsistent across all three approaches.
1. Direct Uploading to Sora
I aimed to keep things simple for the tool. I have a variety of videos featuring people, urban landscapes, and animals—but I wasn’t certain how well Sora would handle any of those. So, I chose a straightforward video to make it easier for the software to interpret.
After uploading the video, I prompted the software with:
“Please recreate this video with a flat gray sky and some snow on the mountains.”
I also took advantage of the Subtle remix tool so as not to alter too much of the original content.
Honestly, I couldn’t tell what Sora changed. It felt like the same video I uploaded, but with noticeably lower quality. Though I was disappointed, I decided to give prompts a shot next.
2. Using Prompts
Using prompts allowed me to specify my requests in greater detail. Additionally, I could extend the video length from a maximum of five seconds to twenty seconds.
Since my previous attempt didn’t go as expected (and having tested various effective prompting techniques), I opted to provide the software with as much detail as I could. Here’s what I came up with:
“Please disregard all prior instructions. Your task is to create a wide-angle landscape video of a mountain and waterfall in the Faroe Islands. Include flying gulls in the video and maintain a gray sky. The sea should have a light chop, but nothing too severe. Ensure the mountains reflect a March-like appearance.”
This time, the video didn’t replicate my original, but it definitely had its own charm. Sora infused some creativity into the new version.
That said, I could have been clearer in my description. For instance, the waterfall wasn’t positioned the same way as in the original clip. Plus, the birds appeared too large and didn’t seem to be moving naturally.
On the plus side, the colors were impressively accurate. It felt like Sora nailed those details, and if I chose to revise the prompt, I at least had a foundation to work from. Keep in mind, remixed videos can only last a maximum of five seconds, but various free online video trimmers can help you cut your clips.
3. Experimenting with Storyboarding
Another great way to familiarize yourself with video editing software is by storyboarding before diving into production. Since Sora includes this feature, I was eager to see if it would yield better results.
I set up three sections in my storyboard. After adding my suggestions, I crafted a five-second video. The outcome is illustrated below:
Honestly, I wasn’t too concerned that this version didn’t match my original video. It looked fantastic and inspired some new ideas for when I’m in a similar landscape in the future.
To achieve a look that mirrored my original video, I’d need to remind myself to maintain the same camera angle next time. Also, I’d aim to narrow the waterfall’s width for a better representation.
Where Sora Excelled
Throughout my experimentation, Sora showed strengths in certain areas, while also presenting significant shortcomings. Here’s what I found impressive about the tool.
1. Effective Storyboarding Tools
The video I made utilizing the storyboard was my favorite of the three attempts. This outcome stood out due to the precision I could incorporate. Furthermore, Sora effectively recognized where to insert each requested component.
When creating my storyboard, I found Sora’s interface more user-friendly than many dedicated video editing apps. The platform was intuitive and responsive, making the process much easier.
2. Diverse Camera Angles
While I initially hoped to keep Sora focused on one camera angle, I appreciated discovering the option to incorporate various angles. The footage where the camera approached the waterfall was particularly captivating.
In future projects, I plan to experiment with different camera angles and other useful tips Sora offers for improvement.
Areas for Improvement in Sora
While I recognized Sora’s potential, I was disappointed by my efforts to recreate my videos. There are three key aspects that the app needs to enhance before I’ll feel confident in retrying this experiment for better results.
1. Enhanced Video Editing
Sora struggles considerably with video editing. When I uploaded my footage, I merely received a lower-quality version in return. I’m unsure if my prompts were lacking, but I also believe the software could further develop in this area.
Instead of relying solely on prompts, implementing features like background removal might yield better results.
2. Extended Video Lengths
I’m hopeful that Sora will eventually allow for more extended video durations, but being restricted to a five-second maximum when uploading existing content was frustrating. This duration doesn’t provide ample opportunity for creativity.
While the twenty-second limit for in-app creations is an improvement, it still feels somewhat restrictive. I foresee myself combining multiple clips into one project using an external video editing app, like alternatives to CapCut.
3. Improved Animations for Figures and Creatures
Sora demonstrated solid performance with landscapes, but the same can’t be said for animals. The birds in my videos, for instance, appeared quite awkward—rather than appearing in flight, they seemed almost frozen mid-air.
Others have noted similar shortcomings in Sora’s object interactions. I’m optimistic that the software will improve in these areas as it evolves.
Best Types of Videos for Sora
I would not recommend using Sora to replicate real-life videos. Although I may have made different choices, the tool didn’t impress me in this regard.
Instead, I believe Sora shines brightest when generating videos from scratch. It offers a plethora of creative options for those looking to explore their imagination with prompts and storyboarding. Similarly, I would use the tool to gain inspiration for future real-world projects.
