Description

Anthropic on google vertex supports image attachments, but requires the base64 image data. Right now, vercel ai-sdk uses anthropic provider settings under the hood for Google Vertex Anthropic resulting in it wrongly assuming image URLs are supported.

The ai-sdk for google vertex with anthropic should fetch the base64 data and plumb it into the request or throw an error to the user saying image urls are not supported.

"For the media type field, Claude 3 models support image/png, image/jpeg, image/gif, or image/webp. The data part of the image is the file bytes encoded to a base64 string (e.g. base64 -i my_image.png)."

Cloud console documentation link for vertex:
https://console.cloud.google.com/vertex-ai/publishers/anthropic/model-garden/claude-3-7-sonnet

Code example

No response

AI provider

@ai-sdk/google-vertex v2.1.29

Additional context

No response