Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

GitHub - openai/openai-realtime-embedded-sdk: A SDK to using the Realtime API with Microcontrollers like the ESP32

Dec 20, 2024 - github.com
The Open RealtimeAPI Embedded SDK is designed for use with the `esp32s3` microcontroller and Linux systems, allowing developers to run the SDK without needing physical hardware. It has been tested on the Freenove ESP32-S3-WROOM and the Sonatino ESP32-S3 Audio Development Board, though other microcontrollers may also be compatible. The SDK requires `protoc` and `protobufc` to be installed, and users must set their target platform to either `linux` or `esp32s3` using the `idf.py set-target` command.

Installation involves configuring device-specific settings, setting environment variables for WiFi SSID, password, and OpenAI API key, and building the project with `idf.py build`. For the `esp32s3`, the build can be flashed to the device using `sudo -E idf.py flash`, while for Linux, the binary can be run directly. A Docker command is available in the build.yaml file to streamline the process.

Key takeaways:

  • The Open RealtimeAPI Embedded SDK supports both `esp32s3` and `linux` platforms, allowing usage without physical hardware directly from Linux.
  • Supported microcontrollers include Freenove ESP32-S3-WROOM and Sonatino - ESP32-S3 Audio Development Board, though other ESP32S3 variants may also work.
  • Installation requires `protoc` and `protobufc`, with specific commands for setting the target platform and configuring device settings.
  • For `esp32s3`, the build process includes flashing the device, while for `linux`, the binary can be run directly.
View Full Article

Comments (0)

Be the first to comment!