Chat With RTX

Chat With RTX Overview

Chat With RTX is a personalized AI chatbot demo application that allows users to connect a GPT large language model to their own content such as documents, notes, videos, and other data. The application leverages retrieval-augmented generation (RAG), TensorRT-LLM, and RTX acceleration to provide contextually relevant answers to queries. It is designed to run locally on a Windows RTX PC or workstation, ensuring fast and secure results. The application supports various file formats and can even load transcriptions from a YouTube playlist. It also provides a developer reference project for those interested in developing their own RAG-based applications.

Chat With RTX Highlights

• Personalized AI chatbot that connects to your own content for contextually relevant responses.
• Supports a wide range of file formats and can load transcriptions from YouTube playlists.
• Provides a developer reference project for building RAG-based applications.