AWS Bedrock Runtime - token count - requestId #5879
Unanswered
agustinp93
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hello!
My team is using
@aws-sdk/client-bedrock-runtime
and everything is working fine but we are missing metadata that is visible in other SDK's.We are using:
Request is based in this example: https://docs.aws.amazon.com/bedrock/latest/userguide/bedrock-runtime_example_bedrock-runtime_InvokeClaude_section.html
In the response we don't receive the token count of the request and response done to Bedrock:
metadata { httpStatusCode: 200, requestId: '########-####-####-####-#########', extendedRequestId: undefined, cfId: undefined, attempts: 1, totalRetryDelay: 0 }
I can see in the docs that other SDK like PHP do return headers in the response and the token count is one of them. I also saw them while doing requests from a React app. But in this scenario where we moved to a lambda to be able to collect large amounts of data before invoking Bedrock this metadata we need is missing.
I'm missing something in the request config? is a bug we need to report?
Thanks
Beta Was this translation helpful? Give feedback.
All reactions