Pika's new feature will generate sound effects in two ways: contextual generation, where the AI decides what audio best fits the clip, and a follow-up approach, where users can add specific AI-generated sounds after they've generated or uploaded an audio-less clip. The company plans to gradually roll out the feature to all users, using feedback from early users to improve the capability. Pika, which has raised $55 million in funding at a nearly $200 million valuation, is competing with other major players in the creative AI space, including Adobe, Runwa, Stability AI, and recently-introduced Haiper.
Key takeaways:
- Pika has added a new feature that allows users to automatically generate sound effects for their AI videos made on the web platform, pika.art.
- The new feature comes less than two weeks after its launch of lip-syncing capabilities, making Pika one of the first “all-in-one” major generative AI video creation platforms.
- Currently, the sound effects feature is in the beta stage and accessible only to those who are on the company’s super-collaborators program or are paying $58/month for its Pro subscription.
- Other companies, such as ElevenLabs and Meta, are also exploring sound generation with text prompts, but Pika is the first to include generated audio as part of the video output.