Skip to content

feat: list the tests behind a message in the test messages graph (#384) - #386

Open
timdegroot1996 wants to merge 1 commit into
mainfrom
feat/384-message-tests
Open

timdegroot1996 wants to merge 1 commit into
mainfrom
feat/384-message-tests

Conversation

@timdegroot1996

Copy link
Copy Markdown
Collaborator

Closes #384

Problem

The Test Messages graph shows the most common failure messages, but not which tests produced them.

Change

  • Click a message to open a Tests With This Message dialog: a bar or its (rotated) label in the Bar view, the message label on the axis in the Timeline view. A timeline point still opens the log of its run.
  • The dialog shows the full message and one row per test with the number of runs it got the message in, most runs first; hovering a row shows the full suite path. Tests with the same name in different suites stay apart.
  • It stays open so names can be selected; Copy All copies every test name, one per line.
  • With --uselogs, clicking a test name opens the log.html of the latest run in which that test got the message, at that test.
  • Messages grouped by a message config list the tests of every message in the group.
  • Tooltip hints and the graph info text mention the click.
  • Fix: Escape in a fullscreen graph no longer also closes fullscreen when it closes a modal opened from it.

Chart.js only calls onClick inside the chart area, so axis label clicks are handled by a small chart plugin reading chart.data.messageTests (refreshed on every update_chart).

Tests

  • JS: get_message_tests (counts, latest run, same name in different suites), the message config merge, open_test_log. 549 passed.
  • Robot: Clicking A Message Lists The Tests That Produced It in 03_dashboard.robot (timeline label + bar), fails without the click handling. Full suite in Docker: 146 tests, 146 passed, 0 failed.

Docs

New section in docs/graphs-tables.md.

🤖 Generated with Claude Code

Clicking a message in the Test Messages graph (a bar or its label in the
bar view, the message label in the timeline view) opens a dialog with
the full message and one row per test that produced it, with the number
of runs it got the message in. The dialog stays open for selecting
text, Copy All copies every test name, and with --uselogs a test name
opens the log of the latest run with that message at that test.
Messages grouped by a message config list the tests of the whole group.

Chart.js only calls onClick inside the chart area, so the axis label
clicks go through a small chart plugin that reads chart.data.messageTests,
which update_chart refreshes on every rebuild.

Escape in a fullscreen graph no longer also closes the fullscreen view
when it closes a modal opened from that graph.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Show the tests behind a message in the test messages graph

1 participant