LLM graphs

The LLM (large language model) protocol graph lets you see the token rate for common LLMs, such as OpenAI and Gemini.

In this topic:

LLM token per second graph

The following graph is available in the LLM Graphs node:

Monitor	Description
LLM tokens per second	Shows the number of LLM tokens that were received from the LLM engine per second, at any given time during the scenario run.

Back to top

See also:

• llm_request function
• LLM monitoring
• LLM protocol