Administration & observability · Reliability and controls
Which BI tools let you measure AI response time?
6 of 15 tools do, according to their public docs, and 2 partly.
Yes: Snowflake, Omni, Hex, Sigma, BigQuery, Looker. Partly: Databricks, Power BI.
The question we asked: Can customers measure the built-in AI’s response time on their own workload by agent, model or evaluation run?
Grading standard
Customers can measure response time on their own workload by agent, model or evaluation run. Marketing estimates and generic timeouts do not count.
Databricks
Partlypreview
Quoted from Databricks’s docsQuery system.ai_gateway.usage to analyze model requests by user, model, or workspace, including token usage, latency, and errors.
Source: docs.databricks.com/aws/en/ai-gateway/coding-agent-observability · checked Oct 26, 2026 · quoted by Claude
Snowflake
Yes
Quoted from Snowflake’s docsUse the agent-observability-report sub-skill of the CoCo agent-studio skill in the CoCo CLI to generate a report on agent monitoring metrics pulled from SNOWFLAKE.LOCAL.AI_OBSERVABILITY_EVENTS, including usage and adoption, latency percentiles, token economics, tool execution stats, conversation depth and completion, and a breakdown of user feedback.
Source: docs.snowflake.com/en/user-guide/snowflake-cortex/cortex-agents-monitor · checked Oct 26, 2026 · quoted by Claude
Omni
Yes
Quoted from Omni’s docsAggregate metrics for the run include total credits, total duration, and overall accuracy, so you can summarize a run at a glance.
Source: docs.omni.co/ai/evals · checked Oct 26, 2026 · quoted by Claude
Hex
Yes
Quoted from Hex’s docsMeasure consistency, run time, and credit usage
Source: learn.hex.tech/docs/agent-management/evals · checked Oct 26, 2026 · quoted by Claude
Sigma
Yes
Quoted from Sigma’s docsDetails about requests by model, tokens by model, average response time by model, and unique users by model.
Source: help.sigmacomputing.com/docs/ai-usage · checked Oct 26, 2026 · quoted by Gemini
BigQuery
Yespreview
Quoted from BigQuery’s docsAgent metrics include agent usage, model calls, tool usage, health, latency, and token usage.
Source: docs.cloud.google.com/bigquery/docs/create-data-agents · checked Oct 26, 2026 · quoted by Claude
Looker
Yespreview
Quoted from Looker’s docsLatency: The end-to-end duration, in seconds, of a single conversation turn from the moment a user submits a query to when the final response is delivered.
Source: cloud.google.com/looker/docs/system-activity-dashboards · checked Oct 26, 2026 · quoted by Claude
Power BI
Partly
Quoted from Power BI’s docsThe time in seconds it took to load or query the visual
Source: learn.microsoft.com/en-us/power-bi/explore-reports/copilot-pane-summarize-content · checked Oct 26, 2026 · quoted by Gemini
Tableau
Metabase
Alteryx
MotherDuck
Mode
Redshift
Streamlit