Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

GitHub - Dabble-Studio/3d-to-photo: 3D to Photo is an open-source package by Dabble, that combines threeJS and Stable diffusion to build a virtual photo studio for product photography. Load a 3D model into the browser and virtual shoot it in any kind of scene you can imagine

Oct 19, 2023 - github.com
3D to Photo is an open-source package developed by Dabble that uses threeJS and Stable Diffusion to create a virtual photo studio for product photography. Users can load a 3D model into the browser and virtually photograph it in any scene they can imagine. The application is currently using Stable Diffusion 1.5-inpainting, hosted on Replicate. The process involves uploading a 3D model in .glb format, adjusting its position and orientation on the canvas, and describing the desired scene in a text box before generating the image.

The package has several use cases, including product photography, synthetic data generation, and previsualization of game assets. The tech stack includes ThreeJS, Stable Diffusion 1.5 by stability.ai, Replicate, NextJS by Vercel for the front-end, and a Python Flask Server for some backend image processing functions. To install and run the package, users need to clone the repository, install necessary packages for the front end and the Python backend, run the Flask Server, set the Replicate API key, run the NextJS app, and then use a sample 3D model to generate an image.

Key takeaways:

  • 3D to Photo is an open-source package that allows users to create virtual photo studios for product photography by loading a 3D model into the browser and virtually shooting it in any scene.
  • The app uses technologies like ThreeJS, Stable Diffusion 1.5 (inpainting), Replicate, NextJS, and Python Flask Server.
  • It has various use cases including product photography, synthetic data generation, and previsualization of game assets.
  • To use the app, users need to clone the repository, install necessary packages, run the Flask Server, set the Replicate API key, run the NextJS app, and then upload a 3D model and generate an image.
View Full Article

Comments (0)

Be the first to comment!