Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of AI on Knowledge Worker Productivity and Quality

Jan 16, 2024 - news.bensbites.co
The study, conducted by researchers from Harvard University, University of Pennsylvania, MIT, and Boston Consulting Group, explores the impact of Artificial Intelligence (AI) on the productivity and quality of work in knowledge-intensive tasks. The experiment involved 758 consultants and found that AI significantly increased productivity and quality of results in a set of 18 realistic consulting tasks. However, for tasks outside the AI's capabilities, consultants using AI were less likely to produce correct solutions.

The study also identified two patterns of successful AI use: "Centaurs", who divided and delegated tasks between themselves and the AI, and "Cyborgs", who integrated their workflow with the AI. The researchers suggest that the capabilities of AI create a "jagged technological frontier", where AI can easily accomplish some tasks but struggles with others of similar difficulty.

Key takeaways:

  • The study examines the performance implications of AI on realistic, complex, and knowledge-intensive tasks, using a pre-registered experiment involving 758 consultants from Boston Consulting Group.
  • The capabilities of AI create a “jagged technological frontier” where some tasks are easily done by AI, while others, though seemingly similar in difficulty level, are outside the current capability of AI.
  • For a set of 18 realistic consulting tasks within the frontier of AI capabilities, consultants using AI were significantly more productive and produced significantly higher quality results.
  • Two distinctive patterns of successful AI use by humans emerged along a spectrum of human-AI integration. One set of consultants acted as “Centaurs,” dividing and delegating their solution-creation activities to the AI or to themselves. Another set of consultants acted more like “Cyborgs,” completely integrating their task flow with the AI and continually interacting with the technology.
View Full Article

Comments (0)

Be the first to comment!