GPT Prompt Engineer

gpt-prompt-engineer Overview

The gpt-prompt-engineer is an innovative tool designed to optimize the process of prompt engineering. It allows users to input a description of their task and some test cases, after which the system generates, tests, and ranks a multitude of prompts to find the ones that perform the best. The tool uses GPT-4 and GPT-3.5-Turbo for prompt generation and an ELO rating system for ranking the prompts based on their performance. It also features a classification version for handling classification tasks and optional logging to Weights & Biases.

gpt-prompt-engineer Highlights

• Prompt Generation: The tool uses GPT-4 and GPT-3.5-Turbo to generate a variety of possible prompts based on a provided use-case and test cases.
• Prompt Testing and Ranking: The system tests each prompt against all the test cases, comparing their performance and ranking them using an ELO rating system.
• Classification Version: The gpt-prompt-engineer features a classification version designed to handle classification tasks, evaluating the correctness of a test case by matching it to the expected output.