Repository navigation
Add Excel skill-value case study and reproducible formatting example - #114
Merged
Merged
Conversation
Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Dependency Review✅ No vulnerabilities or license issues or OpenSSF Scorecard issues found.Scanned FilesNone |
Merged
19 of 35 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Add the prepared Excel skill-value case study and a small four-case example comparing one self-authored formatting request through native MCP and CLI, with and without matching skills. The example uses the public
CopilotEvalAPI, default offline checks, no-send skill discovery, explicit paid-attempt limits, and independent saved-workbook verification through desktop Excel COM. It reuses the existing rootuv.lock; no framework runtime or dependency changes are included.The separate historical receipt records 48/48 independently verified unique cases and 24/24 treatments that read their skills. Recorded tokens increased 23.4% for MCP and 72.4% for CLI, with equal correctness. Its 50 reserved attempts include two interrupted attempts whose usage remains unknown, not zero. These results are not pooled with older runs or presented as results from the four-case example. No working live event journal is claimed; the callback received zero live events. New narrow formatting skills remain unproven.
Include 27 MCP and 26 CLI frozen historical guidance files, their MIT license, and the sanitized receipt. These are test fixtures, not framework companion/product skills. Git attributes preserve their exact bytes and historical whitespace; all 53 committed fixture hashes match the receipt. Add website navigation, the examples index, root type-check coverage, and an Unreleased changelog entry. No SpreadsheetBench input/golden workbooks, raw native traces, customer data, preparation notes, or duplicate lockfiles are included.
Type of Change
Checklist
Testing
Commands run from this isolated worktree's repository root:
Commands run from
examples\excel-skill-value:The desktop Excel proof ran after the other session released Excel; no Excel-dependent commands overlapped. It rejected the unformatted input, accepted properly formatted output, and rejected a changed fractional-rate value. This verifies the fixed workbook checker, not model performance.
Additional checks verified all 53 fixture hashes in both copied files and staged Git blobs, 48 distinct historical case identifiers, historical group token totals, and the unchanged root lock.
No paid model runs, real-Copilot integration runs,
--run-liveexecutions, or new narrow-skill comparisons were authorized or performed. Framework execution behavior is unchanged. Offline checks establish framework/checker contracts, not model performance. The live example remains explicitly opt-in and unproven.Related Issues
N/A — user-requested upstream contribution; no linked issue.