The team also found that using everyday filmmaking language yielded inconsistent results, indicating that the tool's developers hadn't been thinking like filmmakers. Furthermore, the tool recognizes and refuses to generate content that infringes on copyright, such as "Star Wars" clips. Despite these limitations, Sora is seen as a powerful tool in filmmaking, but not yet capable of creating films independently.
Key takeaways:
- OpenAI's video generation tool Sora, while impressive, requires a lot of professional production work including robust storyboarding, editing, color correction, and post work like rotoscoping and VFX.
- Control over the generated content is still elusive and requires elaborate workarounds for simple tasks like choosing the color of a character’s clothing.
- Using everyday language of filmmaking like “panning right” or “tracking shot” were inconsistent in Sora, indicating that the researchers hadn't been thinking like filmmakers.
- Sora has mechanisms to recognize and refuse copyright infringement, raising questions about the content it was trained on.