Claude 3.5 Sonnet v2
The upgraded Claude 3.5 Sonnet is now state-of-the-art for a variety of tasks including real-world software engineering, enhanced agentic capabilities, and computer use.The upgraded Claude 3.5 Sonnet is now state-of-the-art for a variety of tasks including real-world software engineering, enhanced agentic capabilities, and computer use.
The new Claude 3.5 Sonnet delivers these advancements at the same price and speed as its predecessor.
Characteristics | Claude 3.5 Sonnet v2 |
---|---|
Maximum tokens / request | Input: 200,000 Output: 8,000 |
Preferred use case | Coding, visual data extraction, agentic tasks, computer use and tool use |
Enable the Vertex AI API.
Authenticate with one of the standard mechanisms documented here.
Note: It is always recommended to utilize the pinned version of the model to ensure consistent behavior and avoid potential disruptions to existing workflows when model updates occur.
The following is a sample prompt to the model. To learn more about the possible request parameters, see the Claude Messages API Reference.
Note that the API for Claude on Vertex differs from the Anthropic API documentation in the following ways:
"vertex-2023-10-16"
.Also note that the Anthropic Text Completions API is not available on Vertex AI.
Request JSON body:
For the media type field, Claude 3 models support image/png
, image/jpeg
, image/gif
, or image/webp
. The data part of the image is the file bytes encoded to a base64 string (e.g. base64 -i my_image.png
).
Set stream
to true to incrementally stream the response using server-sent events. Streaming substantially reduces end-user perception of latency, because the response is returned incrementally as it's generated.
Save the request body in a file named request.json and then execute the following command in Cloud Shell or a local terminal window with the gcloud CLI installed. Authenticate and replace PROJECT_ID
with your Google Cloud project ID.
Note: It is always recommended to utilize the pinned version of the model to ensure consistent behavior and avoid potential disruptions to existing workflows when model updates occur.
There are Anthropic SDKs available for Python and TypeScript.
To install the Anthropic Python SDK:
To use the SDK:
To use the SDK to stream messages:
To use the SDK to process images:
This model supports the following set of features:
Claude models are general purpose large language models. They use a transformer architecture and are trained via unsupervised learning, RLHF, and Constitutional AI (including both a supervised and Reinforcement Learning (RL) phase). Claude 3.5 Sonnet v2 is trained with hardware supplied by Amazon Web Services (AWS) and Google Cloud Platform (GCP). Core frameworks include PyTorch, JAX, and Triton.
Claude models are trained on a proprietary mix of publicly available information on the Internet as of August 2023 (Claude 3.5 Sonnet v2’s training data cutoff is April 2024), as well as non-public data from third-parties, data that Anthropic's users or companies hired to provide data labeling and creation services voluntarily create and provide, and data Anthropic generates internally. Anthropic employs several data cleaning and filtering methods, including deduplication and classification to filter data.
For data Anthropic obtains by crawling public web pages, Anthropic follows industry practices with respect to robots.txt instructions and other signals that website operators use to indicate whether they permit crawling of the content on their sites. In accordance with Anthropic's policies, Anthropic does not access password-protected or sign-in pages or bypass CAPTCHA controls when accessing data to include in training sets, and Anthropic conducts diligence on the data that it uses. Anthropic operates its crawling system transparently, which means website operators can easily identify Anthropic visits and signal their preferences to Anthropic.
See Anthropic's Claude 3 model card for more details. Details about Claude 3.5 Sonnet can be found at the bottom as an addendum to the model card.
All Claude models have been tested pre-deployment with a suite of evaluations. These include capabilities evaluations – which help measure the model's skills, strengths, and weaknesses across a range of tasks – as well as safety and alignment evaluations, which evaluate whether the model poses specific risks and the degree to which the model conforms to the ethical and behavioral expectations set for it.
Anthropic conducted a comprehensive evaluation of the Claude 3.5 Sonnet v2 to analyze trends in its capabilities across various domains. Anthropic's assessment included several broad categories:
Image & text input: With state of the art vision capabilities, Sonnet 3.5 v2 can process images and return text outputs to analyze and understand charts, graphs, technical diagrams, reports, and other visual assets.
Text output: Sonnet 3.5 v2 can output text of a variety of types and formats, such as prose, lists, Markdown tables, JSON arrays, HTML, code in various programming languages, and more.
Resource ID | Release date | Release stage | Description |
---|---|---|---|
claude-3-5-sonnet-v2@20241022 | 2024-12-17 | Preview Release | Prompt Caching, Token Counting |
claude-3-5-sonnet-v2@20241022 | 2024-12-10 | Preview Release | Batch Prediction |
claude-3-5-sonnet-v2@20241022 | 2024-10-22 | General Availability | Updated version with enhanced quality |
Google Cloud Console has failed to load JavaScript sources from www.gstatic.com.
Possible reasons are: