Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

Microsoft releases Phi-2, a small language model AI that outperforms Llama 2, Mistral 7B

Dec 12, 2023 - venturebeat.com
Microsoft Research has announced the release of its Phi-2 small language model (SML), a text-to-text AI program that can run on a laptop or mobile device. Despite its smaller size, with 2.7 billion parameters, Phi-2's performance is comparable to larger models such as Meta’s Llama 2-7B and Mistral-7B, both with 7 billion parameters. It also outperforms Google’s Gemini Nano 2 model, offering less "toxicity" and bias in its responses.

However, Phi-2 is currently licensed only for research purposes and not for commercial use, as per the Microsoft Research License. This means businesses cannot use it to build products. The model was also able to correctly answer complex physics questions and correct student errors, similar to Google's Gemini Ultra model, despite likely being a fraction of its size.

Key takeaways:

  • Microsoft Research has announced the release of its Phi-2 small language model (SML), a text-to-text AI program that can run on a laptop or mobile device.
  • Despite its smaller size, Phi-2 boasts performance comparable to larger models, including Meta’s Llama 2-7B and Mistral-7B, and outperforms Google’s Gemini Nano 2 model.
  • Phi-2 also demonstrated the ability to solve complex physics problems and correct student mistakes, similar to Google's Gemini Ultra model.
  • However, Phi-2 is currently licensed only for research purposes and not for commercial usage, limiting its application for businesses.
View Full Article

Comments (0)

Be the first to comment!