Despite these limitations, the team believes the underlying architecture can be generalized to other problems. They are now focusing on developing a semantic search that can help law firms navigate through thousands of legal documents. The team is also seeking a co-founder to help build a meaningful product in the legal tech space.
Key takeaways:
- The team at Hotseat attempted to improve the reasoning capabilities of ChatGPT for legal questions by breaking down complex tasks into simpler subtasks.
- Despite improvements, the system still has limitations including high latency, faulty reasoning, and the inability to process more than one document at a time.
- The system was tested with dozens of lawyers, with a GDPR specialist rating 8 out of 10 responses as excellent.
- While the system is not yet useful for lawyers, the underlying architecture could be generalized to other problems and used to answer arbitrary questions about arbitrary documents.