Skip to content

Add a Kane CLI natural-language E2E test for the public dashboard - #4525

Open
bhawana001 wants to merge 1 commit into
umami-software:masterfrom
bhawana001:add-kane-cli-e2e-test
Open

bhawana001 wants to merge 1 commit into
umami-software:masterfrom
bhawana001:add-kane-cli-e2e-test

Conversation

@bhawana001

@bhawana001 bhawana001 commented Sep 9, 2026

Copy link
Copy Markdown

Add a Kane CLI natural-language end-to-end test

This adds one plain-markdown, natural-language end-to-end test covering loading Umami's public demo analytics dashboard and verifying the visitors/views metrics and traffic chart render.

Why it might help

  • Readable by anyone: no selectors, no scripting. It lives in the repo as a test.md and re-runs on every deploy.
  • Kane CLI drives a real browser, verifies each step with a visual/network check, and produces a sharable evidence report (video, steps, network). It also automates mobile apps on the iOS Simulator and Android Emulator.

Evidence from a live run (passed):
https://test-manager.lambdatest.com/projects/01KJSH1ECPR455A3XRGBKR3NV3/test-cases/01M237HV37D9RKTRKN7CM79J02/dashboard/share/US_JUFYX2K79J8RUP9JLY9MHZVO9H09S7LSUWK75Q5XQNJNC8ZWD3F0366BKN48WVEP?type=summary&agentView=true&fqdn=summary-page

How to run

kane-cli testmd run tests/kane-cli/public-dashboard_test.md --agent

Opening this for your consideration; approval is entirely yours. Happy to adjust the flow, the file location, or the format.

@vercel

vercel Bot commented Sep 9, 2026

Copy link
Copy Markdown

@bhawana001 is attempting to deploy a commit to the Umami Software Team on Vercel.

A member of the Team first needs to authorize it.

@greptile-apps

greptile-apps Bot commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

Greptile Summary

This PR adds a natural-language Kane CLI scenario that opens Umami’s public demo dashboard and checks for headline metrics and a traffic chart.

  • Adds one public-dashboard browser scenario under tests/kane-cli.
  • The scenario is not currently connected to a repository test command or CI workflow.

Confidence Score: 4/5

The change is safe to merge from a runtime perspective, but the new test provides no automated coverage until Kane is integrated with the repository’s test workflow.

The added file does not affect application behavior, but existing test runners and CI do not discover or invoke it, leaving the intended E2E check inactive.

Files Needing Attention: tests/kane-cli/public-dashboard_test.md

Important Files Changed

Filename Overview
tests/kane-cli/public-dashboard_test.md Adds a readable public-dashboard E2E scenario, but no repository automation currently executes it.

Reviews (1): Last reviewed commit: "test: add Kane CLI natural-language E2E ..." | Re-trigger Greptile

@@ -0,0 +1,11 @@
# Umami — public analytics dashboard renders

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Kane test is not run

This new test is not connected to any repository command or CI workflow. Existing test commands run Vitest or Playwright, and Playwright only discovers tests/e2e, so routine test runs never execute this file. As a result, the intended dashboard coverage can silently regress. Please add a Kane invocation to the test infrastructure or document the required execution path.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant