However, some are skeptical about the impact of AI on gaming, noting that even existing technologies like GPT have not yet significantly impacted the industry. Concerns are raised about the difference between generating a video offline and doing it in real-time, with the latter requiring a frame to be generated in 30-40ms. Others argue that rendering in-engine, in real-time, will always be less costly than using a remote API, and that the only reason to choose AI would be to cut employment costs.
Key takeaways:
- The main impact of Sora AI on gaming is likely to be on cutscenes and trailers rather than gameplay, as creating environments that look good and run well are different things, and Sora AI may not be optimized for the latter.
- Generating instant frames in response to player input with Sora AI is not seen as effective or realistic with current hardware. However, Sora AI could potentially be used to design 3D worlds for use in traditional game engines, which could accelerate development.
- There is potential for style transfer on a framebuffer before pushing it out, which could be interesting if it can look correct over time. The AI's capacity to preserve structure over time suggests there's some representation of objects or an equivalent to it, which could potentially be controlled more.
- There are concerns that Sora AI could be used to create more intrusive and clickbaity mobile game ads. The difference between generating a video offline and doing it in real-time is significant, with real-time requiring a frame to be generated in the magnitude of 30-40ms.