Administration & observability · Reliability and controls

Which BI tools let you measure AI response time?

6 of 15 tools do, according to their public docs, and 2 partly.

Yes: Snowflake, Omni, Hex, Sigma, BigQuery, Looker. Partly: Databricks, Power BI.

The question we asked: Can customers measure the built-in AI’s response time on their own workload by agent, model or evaluation run?

Prompt your agent about thisClaudeChatGPT
Grading standard

Customers can measure response time on their own workload by agent, model or evaluation run. Marketing estimates and generic timeouts do not count.

Databricks

Partlypreview
Quoted from Databricks’s docsQuery system.ai_gateway.usage to analyze model requests by user, model, or workspace, including token usage, latency, and errors.
Source: docs.databricks.com/aws/en/ai-gateway/coding-agent-observability · checked Oct 26, 2026 · quoted by Claude
Claude partly (preview) · GPT partly (preview) · Gemini yes

Snowflake

Yes
Quoted from Snowflake’s docsUse the agent-observability-report sub-skill of the CoCo agent-studio skill in the CoCo CLI to generate a report on agent monitoring metrics pulled from SNOWFLAKE.LOCAL.AI_OBSERVABILITY_EVENTS, including usage and adoption, latency percentiles, token economics, tool execution stats, conversation depth and completion, and a breakdown of user feedback.
Source: docs.snowflake.com/en/user-guide/snowflake-cortex/cortex-agents-monitor · checked Oct 26, 2026 · quoted by Claude
Claude yes · GPT yes · Gemini yes

Omni

Yes
Quoted from Omni’s docsAggregate metrics for the run include total credits, total duration, and overall accuracy, so you can summarize a run at a glance.
Source: docs.omni.co/ai/evals · checked Oct 26, 2026 · quoted by Claude
Claude yes · GPT yes · Gemini yes

Hex

Yes
Quoted from Hex’s docsMeasure consistency, run time, and credit usage
Source: learn.hex.tech/docs/agent-management/evals · checked Oct 26, 2026 · quoted by Claude
Claude yes · GPT yes · Gemini yes

Sigma

Yes
Quoted from Sigma’s docsDetails about requests by model, tokens by model, average response time by model, and unique users by model.
Source: help.sigmacomputing.com/docs/ai-usage · checked Oct 26, 2026 · quoted by Gemini
Claude yes · GPT yes · Gemini yes

BigQuery

Yespreview
Quoted from BigQuery’s docsAgent metrics include agent usage, model calls, tool usage, health, latency, and token usage.
Source: docs.cloud.google.com/bigquery/docs/create-data-agents · checked Oct 26, 2026 · quoted by Claude
Claude yes (preview) · GPT yes (preview) · Gemini yes

Looker

Yespreview
Quoted from Looker’s docsLatency: The end-to-end duration, in seconds, of a single conversation turn from the moment a user submits a query to when the final response is delivered.
Source: cloud.google.com/looker/docs/system-activity-dashboards · checked Oct 26, 2026 · quoted by Claude
Claude yes (preview) · GPT yes (preview) · Gemini yes (preview)

Tableau

Not found
Nothing in the docs settles this.
Claude nothing found · GPT nothing found · Gemini nothing found

Power BI

Partly
Quoted from Power BI’s docsThe time in seconds it took to load or query the visual
Claude partly · GPT nothing found · Gemini partly

Metabase

Not found
Nothing in the docs settles this.
Claude nothing found · GPT nothing found · Gemini nothing found

Alteryx

Not found
Nothing in the docs settles this.
Claude nothing found · GPT nothing found · Gemini nothing found

MotherDuck

Not found
Nothing in the docs settles this.
Claude nothing found · GPT nothing found · Gemini nothing found

Mode

Not found
Nothing in the docs settles this.
Claude nothing found · GPT nothing found · Gemini nothing found

Redshift

Not found
Nothing in the docs settles this.
Claude nothing found · GPT nothing found · Gemini nothing found

Streamlit

Not found
Nothing in the docs settles this.
Claude nothing found · GPT nothing found · Gemini nothing found