Opening article
Anthropic News reports on the integration of Claude 3.5 Sonnet into GitHub Copilot. The announcement brings Anthropic's advanced AI model to the widely used developer platform. Further details on the integration were not provided in the source excerpt.
Starting today, the new Claude 3.5 Sonnet begins rolling out on GitHub Copilot, enabling developers to choose Claude 3.5 Sonnet for coding—directly in Visual Studio Code and GitHub.com. This integration brings Claude’s coding capabilities to GitHub’s community of over 100 million developers.
The upgraded Claude 3.5 Sonnet outperforms all publicly available models on SWE-bench Verified , a benchmark that measures how models solve real-world GitHub issues. It also achieves the top score in its class (93.7%) on HumanEval, a benchmark testing the ability to write correct Python functions from natural language descriptions.
Claude 3.5 Sonnet will be available in public preview to all GitHub Copilot Chat users and organizations over the coming weeks.
GitHub is releasing Claude 3.5 Sonnet in public preview starting today. Claude 3.5 Sonnet runs on GitHub Copilot via Amazon Bedrock, leveraging Bedrock’s cross-region inference to further enhance reliability.
With context about your entire codebase, you can use Claude 3.5 Sonnet on GitHub Copilot to:
All developers and organizations should have access to Claude 3.5 Sonnet over the coming weeks. Explore the GitHub blog and documentation to learn more.
To evaluate the safety of our systems, Anthropic is giving employee-like access to a team from METR, a nonprofit that evaluates frontier AI models, and we're in early discussions with several other organizations, including Hugging Face.
Integrating Claude 3.5 Sonnet into GitHub Copilot highlights the increasing interoperability of leading AI models within major developer ecosystems.