Sign up to save tools and stay up to date with the latest in AI
bg
bg
1

Meta releases ‘Code Llama 70B’, an open-source behemoth to rival private AI development

Jan 29, 2024 - venturebeat.com
Meta AI has released an updated version of its code generation model, Code Llama 70B, which can write code in various programming languages, including Python, C++, Java, and PHP. The model can generate code from natural language prompts or existing code snippets, making it one of the largest open-source AI models for code generation. Code Llama 70B has been trained on 500 billion tokens of code and code-related data, and it has a larger context window of 100,000 tokens, enabling it to process and generate more complex code.

The new model includes CodeLlama-70B-Instruct, a variant fine-tuned for understanding natural language instructions and generating code accordingly, and CodeLlama-70B-Python, a variant optimized for Python. Code Llama 70B is available for free download under the same license as previous models, allowing both researchers and commercial users to use and modify it. It is expected to significantly impact the field of code generation and the software development industry, offering a powerful tool for creating and improving code.

Key takeaways:

  • Meta AI has released a new and improved version of its code generation model, Code Llama 70B, which can write code in various programming languages from natural language prompts or existing code snippets.
  • Code Llama 70B is one of the largest open-source AI models for code generation currently available and is considered a benchmark in the field of code generation.
  • Code Llama 70B includes variants such as CodeLlama-70B-Instruct, which is fine-tuned for understanding natural language instructions and generating code, and CodeLlama-70B-Python, which is optimized for Python.
  • The model is available for free download under the same license as previous models, allowing both researchers and commercial users to use and modify it. It can potentially enable new applications such as code translation, code summarization, code documentation, code analysis, and code debugging.
View Full Article

Comments (0)

Be the first to comment!