Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions dist/freebsd/tracer.env.sample
Original file line number Diff line number Diff line change
Expand Up @@ -12,3 +12,5 @@ TRACER_URL=https://
# TRACER_ISSUES_LABELS=a,b the labels each issue gets (none without it)
# TRACER_UPSTREAM_REPO=OWNER/NAME the repository whose main a report's build is compared with, its owner's nightly
# the nightlies' (scarletnx/ScarletNX without it; asked with TRACER_ISSUES_TOKEN)
# TRACER_MIN_FREE=MiB the site's file system's MiB kept free: a report that would go under it is refused (1024
# without it; 0 for no floor)
31 changes: 19 additions & 12 deletions docs/TESTING.md
Original file line number Diff line number Diff line change
Expand Up @@ -76,7 +76,9 @@ temporary folder:
brings screenshots to a report full of logs, one too large said with its size, one whose bytes fail the zip's check;
the issue's screenshots as the site's pictures;
- a database of the first schema upgraded, a deleted message, a report's number never reused, the hourly limit, the
JSON with no Discord id, the channels it answers in (a list, `all`, none, and other words refused);
site's disk kept free (a report and an update refused under `TRACER_MIN_FREE` before any download, with the MiB
said, one that fits taken, a disk that cannot be read, no floor), the JSON with no Discord id, the channels it
answers in (a list, `all`, none, and other words refused);
- the issues an approval files, through a fake GitHub: an administrator's reaction files one, a second files none,
anyone else's reaction or another emoji nothing, a refusal said and tried again, the settings and their refusals;
- how old a report's build is, through a fake GitHub: behind main, the plurals, a commit asked once an hour, `-dirty`
Expand All @@ -89,15 +91,18 @@ temporary folder:
in;
- the MCP server over that site: its handshake and protocol versions, notifications, broken and unknown requests, each
tool's filters, limits and errors, and a query's 16 words at most;
- runs of edenprobe: edenprobe's families and which lose their detail, the drivers by the ban table's names and by
their own, each driver's version numbering both ways, the system's family; the cut of a log (the service, net, pad
and unknown suites' details and the net notes, every other byte as it was); ScarletNX's log, Eden's, rEden's and a
report.jsonl read, two copies of a run, a run cut short, a launch that went on after a crash, lines edenprobe does
not write; a run through JSON and the answers refused (another emulator, a detail the cut takes out, a case that is
none); the run in a Share Log zip, a run begun, none; whole runs as reports (the reply's counts and what was left
out, the database and the kept log without the player, no game's list, the same run again from one person and from
another, Eden's and the console's, deleted with their message, a resumed launch kept as a log, one through the
worker), and a report kept before made the run's at the next start;
- runs of Amberlith (edenprobe before its 1.0.0): its families and which lose their detail, the drivers by the ban
table's names and by their own, each driver's version numbering both ways, the system's family; the cut of a log
(the service, net, pad, libc and unknown suites' details and the net notes, every other byte as it was), Amberlith
1.0.0's new suites in their families; ScarletNX's log,
Eden's, rEden's and a report.jsonl read, a run that Amberlith 1.0.0's note opens and a name that only begins like
it, two copies of a run, a run cut short, a launch that went on after a crash, lines Amberlith does not write; a run
through JSON and the answers refused (another emulator, another program or none, a detail the cut takes out, a case
that is none); the run in a Share Log zip, a run begun, none; whole runs as reports (the reply's counts and what was
left out, the database and the kept log without the player, no game's list, the same run again from one person and
from another, Eden's and the console's, deleted with their message, a resumed launch kept as a log, a run of
Amberlith named so in the reply, the title and the page, one kept before the database knew the program's name read
as edenprobe's, one through the worker), and a report kept before made the run's at the next start;
- the rules over the runs ([What the runs say together](./TRACER.md#what-the-runs-say-together)), on fixtures that sit
on each threshold: a candidate and its draft line, and none with one person, two failing reports, one other driver,
two passing reports, a passing build eight days before or after (seven count), a failure Eden's or of another mode;
Expand All @@ -115,8 +120,10 @@ temporary folder:
tests to fail on each: `tracer/src/rules.c` (a threshold one off, a comparison that lets one more in, a condition left
out: 19 mutants, `test_tracer --rules`); what a report keeps of its files, in `files.c`, `report.c` and `issues.c` (a
zip's screenshots, a picture never read as a log, the paths outside a home, the limits said with their values: 30
mutants, `test_tracer --files`); and the worker's locale for a zip's names, made before it shuts itself in (1 mutant,
the whole suite). A mutant they pass, or one whose text its file no longer has once, fails it. About 30 s.
mutants, `test_tracer --files`); what a log holds of a run, in `probe.c` (Amberlith's starting note, a name that only
begins like it, libc's detail kept, a worker's answer naming another program: 4 mutants, `test_tracer --probe`); and
the worker's locale for a zip's names, made before it shuts itself in (1 mutant, the whole suite). A mutant they pass,
or one whose text its file no longer has once, fails it. About 30 s.

`make -C tracer bench [RUNS=1000] [FOLDER=/tmp/tracer-bench]` (`tracer/tests/bench_probe.c`, built by `make test`,
run by hand) keeps RUNS runs like edenprobe 0.9.0's graphics run (1069 cases) on fifteen machines in a new database in
Expand Down
6 changes: 3 additions & 3 deletions docs/TRACER-MCP.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,9 +19,9 @@ one either. It is built and packaged with Tracer ([Build](./BUILD.md#tracer)).
| `read_log` | a log's lines with their numbers, from a line on or those that hold some text, and where to go on |
| `get_screenshot` | one of a report's screenshots, as an image (8 MiB at most; a larger one is named by its address) |
| `signatures` | the failures grouped by where they happened, across games, the most reported first |
| `probe_matrix` | edenprobe's cases by machine (an emulator, a driver and its version, a system), each case's results on each as `[pass, fail, skip, crashed]`; by words, suite, family, driver, emulator, the failing cases alone (the default) or all |
| `probe_case` | one case of edenprobe, by its key or by words of its suite and name (words that find several list them): its results on each machine and its newest failures and skips, each with its report, machine and detail |
| `ban_candidates` | what the runs of edenprobe say together ([What the runs say together](./TRACER.md#what-the-runs-say-together)): ban candidates with their draft lines, ScarletNX's own failures and regressions; by driver and by kind |
| `probe_matrix` | Amberlith's cases (edenprobe's, before its 1.0.0) by machine (an emulator, a driver and its version, a system), each case's results on each as `[pass, fail, skip, crashed]`; by words, suite, family, driver, emulator, the failing cases alone (the default) or all |
| `probe_case` | one case of Amberlith, by its key or by words of its suite and name (words that find several list them): its results on each machine and its newest failures and skips, each with its report, machine and detail |
| `ban_candidates` | what the runs of Amberlith say together ([What the runs say together](./TRACER.md#what-the-runs-say-together)): ban candidates with their draft lines, ScarletNX's own failures and regressions; by driver and by kind |

An agent adds it by its address, Claude Code with:

Expand Down
Loading