Tracking Amazon Bedrock Claude token usage is simple using Langchain! How to track tokens using Langchain For OpenAI models, Langchain provides a native Callback handler for tracking token usage as documented here. 1from langchain.callbacks import get_openai_callback 2from langchain.llms import OpenAI 3 4llm = OpenAI(temperature=0) 5with get_openai_callback() as cb: 6 llm("What is the square root of 4?") 7 8total_tokens = cb.total_tokens 9assert total_tokens > 0However, other model families d...
