Markdown Attachments by AenEnlil · Pull Request #277 · testomatio/check-tests

AenEnlil · 2026-09-10T14:31:03Z

Ticket: #276

github-actions · 2026-09-10T14:31:41Z

🌀 Tests overview by Testomatio

Found 299 mocha tests in 27 files

✔️ Added 25 tests

+ analyzer: attachments (manual/markdown push): readAttachments: should resolve, validate and base64-encode attachments, keyed by filename only
+ analyzer: attachments (manual/markdown push): readAttachments: should silently skip attachments that cannot be read from disk
+ analyzer: attachments (manual/markdown push): readAttachments: should skip attachments with disallowed extensions
+ analyzer: attachments (manual/markdown push): readAttachments: should skip attachments larger than the size limit
+ analyzer: attachments (manual/markdown push): extractAttachments: should resolve declarations collected during the last analyze() pass into file content
+ analyzer: attachments (manual/markdown push): extractAttachments: should drop a declaration entirely when every attachment fails validation
+ analyzer: attachments (manual/markdown push): extractAttachments: should return an empty list when nothing was collected during parsing
+ analyzer: attachments (manual/markdown push): resolveTestId: should look up a test id by exact name in the id map
+ analyzer: attachments (manual/markdown push): resolveTestId: should fall back to matching the tag-stripped name
+ analyzer: attachments (manual/markdown push): resolveTestId: should return null when there is no match
+ analyzer: attachments (manual/markdown push): resolveTestId: should return null when idMap is missing
+ analyzer: attachments (manual/markdown push): resolveTestId: should prefer the file#suite#test key when suite and file are known
+ analyzer: attachments (manual/markdown push): resolveTestId: should disambiguate same-named tests in different suites via the suite#test key
+ analyzer: attachments (manual/markdown push): resolveTestId: should fall back to the bare name key when no suite context is given
+ analyzer: attachments (manual/markdown push): resolveTestId: should consume a matched key so it cannot be handed out to a second test
+ analyzer: attachments (manual/markdown push): resolveAttachmentIds: should leave an existing id untouched
+ analyzer: attachments (manual/markdown push): resolveAttachmentIds: should patch in the id from idMap when the declaration has none (new test)
+ analyzer: attachments (manual/markdown push): resolveAttachmentIds: should leave id null when it cannot be resolved
+ analyzer: attachments (manual/markdown push): resolveAttachmentIds: should correctly disambiguate same-named tests across different suites
+ analyzer: attachments (manual/markdown push): resolveAttachmentIds: should disambiguate by suite end-to-end, through extractAttachments() output (regression: extractAttachments must not drop suiteName/file)
+ analyzer: attachments (manual/markdown push): integration with the markdown parser: should populate attachmentDeclarations while analyzing, without putting attachments on the test object
+ manual (markdown) parser: attachments YAML-list metadata: should collect attachments as a separate declaration, not on the test object
+ manual (markdown) parser: attachments YAML-list metadata: should support a single attachment item
+ manual (markdown) parser: attachments YAML-list metadata: should not treat attachments as a list when the key has no following "- " lines
+ manual (markdown) parser: attachments YAML-list metadata: should not confuse other keys after the list with list items

📑 List all tests

📝 tests/analyzer_test.js

📎 analyzer
- ✔️ can import analyzer from main index
- ✔️ should parse all mocha files
- ✔️ should parse all typescript files
- ✔️ should exclude dir in file name if dir specified
- ✔️ should include full dir in file name
- ✔️ should avoid node_modules
- ✔️ should read char`
- ✔️ should not load dirs as files
- ✔️ should exclude files matching exclude pattern
- ✔️ should exclude specific file patterns
- ✔️ should work without exclude option
- 📎 env variable params
  - ✔️ should prepend a dir from env variable
  - ✔️ should parse TypeScript files with ES2023 Explicit Resource Management
  - ✔️ should sort files alphabetically
  - ✔️ should maintain consistent file order across multiple runs
- 📎 attachments (manual/markdown push)
  - 📎 readAttachments
    - ✔️ should resolve, validate and base64-encode attachments, keyed by filename only
    - ✔️ should silently skip attachments that cannot be read from disk
    - ✔️ should skip attachments with disallowed extensions
    - ✔️ should skip attachments larger than the size limit
  - 📎 extractAttachments
    - ✔️ should resolve declarations collected during the last analyze() pass into file content
    - ✔️ should drop a declaration entirely when every attachment fails validation
    - ✔️ should return an empty list when nothing was collected during parsing
  - 📎 resolveTestId
    - ✔️ should look up a test id by exact name in the id map
    - ✔️ should fall back to matching the tag-stripped name
    - ✔️ should return null when there is no match
    - ✔️ should return null when idMap is missing
    - ✔️ should prefer the file#suite#test key when suite and file are known
    - ✔️ should disambiguate same-named tests in different suites via the suite#test key
    - ✔️ should fall back to the bare name key when no suite context is given
    - ✔️ should consume a matched key so it cannot be handed out to a second test
  - 📎 resolveAttachmentIds
    - ✔️ should leave an existing id untouched
    - ✔️ should patch in the id from idMap when the declaration has none (new test)
    - ✔️ should leave id null when it cannot be resolved
    - ✔️ should correctly disambiguate same-named tests across different suites
    - ✔️ should disambiguate by suite end-to-end, through extractAttachments() output (regression: extractAttachments must not drop suiteName/file)
  - 📎 integration with the markdown parser
    - ✔️ should populate attachmentDeclarations while analyzing, without putting attachments on the test object

📝 tests/codeceptjs_test.js

📎 codeceptjs parser
- 📎 create todo tests
  - ✔️ should parse codecept file
  - ✔️ should include code
- 📎 Parse CodeceptJS tags
  - ✔️ should include tags
- 📎 Parse CodeceptJS tags & datatable
  - ✔️ should include data and tags
- 📎 Parse CodeceptJS hooks code - default opts
  - ✔️ should include Before hook code
  - ✔️ should include BeforeSuite hook code
  - ✔️ should include AfterSuite hook code
- 📎 [opts.noHooks = true] Parse CodeceptJS hooks code
  - ✔️ should exclude Before hook code
  - ✔️ should exclude BeforeSuite hook code
  - ✔️ should exclude AfterSuite hook code
- 📎 Parse CodeceptJS test with --line-numbers option
  - ✔️ [lineNumbers=true opts] each section should include line-number as part of code section
  - ✔️ [no SET the lineNumbers opts] should exclude line-number
  - ✔️ [noHooks=true + lineNumbers=true opts] line-number as part of code section

📝 tests/comment_test.js

📎 Comment
- ✔️ should refer to proper skipped line in comment

📝 tests/decorator_test.js

📎 Decorator
- ✔️ should print markdown
- ✔️ should validate tests with empty titles
- ✔️ should print markdown2

📝 tests/error_message_test.js

📎 formatErrorMessage
- ✔️ should format 504 responses without a body
- ✔️ should use server body message when response has a body
- ✔️ should keep regular Error messages
- ✔️ should not return undefined for plain objects

📝 tests/gauge_test.js

📎 gauge parser
- 📎 basic gauge specs
  - ✔️ should parse specification title as suite
  - ✔️ should parse scenarios as tests
  - ✔️ should extract steps as test code
  - ✔️ should handle line numbers correctly
- 📎 gauge specs with tags
  - ✔️ should handle tags correctly
  - ✔️ should parse multiple scenarios with tags
  - ✔️ should include tables in test code
- 📎 gauge specs with alternative format
  - ✔️ should parse underlined specification title
  - ✔️ should handle scenario tags
- 📎 edge cases
  - ✔️ should handle empty file
  - ✔️ should handle file with only specification
  - ✔️ should handle file with no tags
- 📎 with options
  - ✔️ should respect noHooks option
  - ✔️ should respect lineNumbers option

📝 tests/jasmine_test.js

📎 jasmine parser
- 📎 jasmine tests
  - ✔️ should parse jasmine file
  - ✔️ should include code

📝 tests/jest_test.js

📎 jest parser
- 📎 jest tests
  - ✔️ should parse jest file
  - ✔️ should include code
- 📎 exclusive tests
  - ✔️ should throw an error if a file contains .only
- 📎 hooks tests - default opts
  - ✔️ should include beforeAll hook code
  - ✔️ should include beforeEach hook code
  - ✔️ should include afterAll hook code
- 📎 [opts.noHooks = true] hooks tests
  - ✔️ should exclude beforeAll hook code
  - ✔️ should exclude beforeEach hook code
  - ✔️ should exclude after hook code
- 📎 test with --line-numbers option
  - ✔️ [lineNumbers=true opts] each section should include line-number as part of code section
  - ✔️ [no SET the lineNumbers opts] should exclude line-number
  - ✔️ [noHooks=true + lineNumbers=true opts] line-number as part of code section
- 📎 jest concurrent
  - ✔️ shuld parse it.concurrent
  - ✔️ should parse test.concurrent
- 📎 ES2023 Explicit Resource Management tests
  - ✔️ should parse jest file with using keyword without errors
  - ✔️ should find test with using declaration
  - ✔️ should include code with using keyword

📝 tests/manual_test.js

📎 manual (markdown) parser
- 📎 markdown manual tests
  - ✔️ should parse markdown file
  - ✔️ should extract suite information
  - ✔️ should mark tests as manual
  - ✔️ should include test metadata
  - ✔️ should not include test content in code property
  - ✔️ should set correct line numbers
- 📎 markdown multiple-suites
  - ✔️ should parse markdown file with multiple suites
  - ✔️ should extract all suites information
- 📎 single-line comments /
  - ✔️ should extract all suite information for suites with single-line comments
  - ✔️ should extract all test information with single-line comments
- 📎 mixed single-line and multiline comments
  - ✔️ should parse file with mixed single-line and multiline comments
- 📎 tags / labels comma-separated metadata (arrays)
  - ✔️ should split tags by comma, trim segments
  - ✔️ should yield empty array when tags key has no values
  - ✔️ should parse single tag without comma
  - ✔️ should parse labels like tags (comma split, trim)
  - ✔️ should yield empty labels array when empty value
- 📎 attachments YAML-list metadata
  - ✔️ should collect attachments as a separate declaration, not on the test object
  - ✔️ should support a single attachment item
  - ✔️ should not treat attachments as a list when the key has no following "- " lines
  - ✔️ should not confuse other keys after the list with list items

📝 tests/mocha_test.js

📎 mocha parser
- 📎 mocha tests
  - ✔️ should parse mocha file
- 📎 cypress tests
  - ✔️ should parse cypress file
  - ✔️ should include code
- 📎 cypress tags
  - ✔️ should sync tags from describe config to tests
  - ✔️ should combine suite tags with test tags
  - ✔️ should inherit tags from all parent suites
  - ✔️ should not add tags to tests without them
  - ✔️ should parse tags of skipped tests
- 📎 graphql tests
  - ✔️ should parse codeceptjs internal test
- 📎 Cypress: hooks tests
  - ✔️ should include before hook code by default
  - ✔️ should include beforeEach hook code by default
  - ✔️ should include after hook code by default
- 📎 [opts.noHooks = true] Cypress: hooks code
  - ✔️ should exclude before hook code
  - ✔️ should exclude beforeEach hook code
  - ✔️ should exclude after hook code
- 📎 Cypress: test with --line-numbers option
  - ✔️ [lineNumbers=true opts] each section should include line-number as part of code section
  - ✔️ [no SET the lineNumbers opts] should exclude line-number
  - ✔️ [noHooks=true + lineNumbers=true opts] line-number as part of code section

📝 tests/newman_test.js

📎 newman parser
- ✔️ should parse newman collection
- ✔️ should properly get test name
- ✔️ should properly get suites for test inside nested folder
- ✔️ should properly get suite for test within collection (not in any folder)

📝 tests/nightwatch_test.js

📎 nightwatch parser
- ✔️ should parse basic nightwatch describe/it tests
- ✔️ should parse mixed patterns with skipped tests
- ✔️ should parse module.exports pattern (JavaScript)
- ✔️ should parse TypeScript nightwatch tests with describe pattern
- ✔️ should parse TypeScript nightwatch tests with hooks (ecosia example)
- ✔️ should parse TypeScript nightwatch tests with module exports pattern
- ✔️ should handle hooks correctly
- ✔️ should forbid .only tests
- ✔️ should handle no-hooks option
- ✔️ should parse classic Nightwatch CommonJS syntax
- ✔️ should parse page objects pattern
- ✔️ should parse complex classical Nightwatch tests with hooks
- ✔️ should handle @tags and metadata in classic syntax
- ✔️ should handle classic Nightwatch with custom commands
- ✔️ should parse classic Nightwatch ESM syntax
- ✔️ should parse TypeScript Nightwatch export default pattern

📝 tests/playwright_test.js

📎 playwright parser
- ✔️ should parse basic playwright-js tests
- ✔️ should forbid describe.only tests
- ✔️ should parse basic playwright-ts tests
- ✔️ should parse multiple playwright-js tests
- ✔️ should parse multiple playwright-ts tests
- ✔️ should update playwright suite if no suite set
- 📎 tags
  - ✔️ should parse playwright-ts test with signle tag on the same line
  - ✔️ should parse playwright-ts test with opening brace on the same line and signle tag on the next line
  - ✔️ should parse playwright-ts test with signle tag on the next line
  - ✔️ should parse playwright-js test with multiple tags
  - ✔️ should parse playwright-js test with multiple tags on multiple lines
- 📎 annotations
  - ✔️ should parse playwright test with single annotation
  - ✔️ should parse playwright test with multiple annotations
  - ✔️ should parse playwright-ts tests with params
  - ✔️ should parse playwright-js tests with annotation
  - ✔️ should parse playwright-js tests with annotation including fixme
  - ✔️ should parse playwright-ts tests with annotations
  - ✔️ should parse playwright test with test.skip annotation inside a test
  - ✔️ should parse playwright-js tests with skip() annotation for the description and test sections
  - ✔️ should parse playwright-js tests with fixme() annotation for the description and test sections
- 📎 Parse Playwright hooks code - default opts
  - ✔️ should include beforeAll hook code
  - ✔️ should include beforeEach hook code
  - ✔️ should include afterAll hook code
- 📎 [opts.noHooks = true] Parse Playwright hooks code
  - ✔️ should exclude beforeAll hook code
  - ✔️ should exclude beforeEach hook code
  - ✔️ should exclude afterAll hook code
- 📎 **Default playwright file parsing **
  - ✔️ should parse basic playwright-ts DEMO tests ("todo" name as part of inner function args)
  - ✔️ should return suite name if used test.describe without parallel mode
  - ✔️ should return suite name if used test.describe.parallel mode
  - ✔️ should return suite name if used test.describe.serial mode
- 📎 test with --line-numbers option
  - ✔️ [lineNumbers=true opts] each section should include line-number as part of code section
  - ✔️ [no SET the lineNumbers opts] should exclude line-number
  - ✔️ [noHooks=true + lineNumbers=true opts] line-number as part of code section
  - ✔️ should parse playwright test with custom alias (fixture/test name)
  - ✔️ should parse annotations (.skip/.fixme/.fail) on a custom test alias
  - ✔️ should not parse custom alias annotations when the alias is not configured
- 📎 annotations status (.skip/.fixme/.fail/.slow)
  - ✔️ registers every named test exactly once (runtime no-title forms excluded)
  - ✔️ keeps .fail tests runnable (not skipped)
  - ✔️ keeps .slow tests runnable (not skipped)
  - ✔️ treats .fail inside a skipped suite as skipped
  - ✔️ ignores runtime test.fail()/test.skip()/test.slow() calls without a title
  - ✔️ should not leak a skipped suite onto sibling tests declared after it
  - ✔️ should not crash when test is assigned to a variable or inside an array (regression for issue #1)

📝 tests/pull_test.js

📎 Pull
- 📎 pullFiles
  - ✔️ should create files from server response
  - ✔️ should create directories if they do not exist
  - ✔️ should overwrite existing files
  - ✔️ should handle empty files response
  - ✔️ should handle server errors
- 📎 dry run mode
  - ✔️ should not create files in dry run mode
  - ✔️ should show what files would be created
- 📎 file tree display
  - ✔️ should display file tree after successful pull
- 📎 git checks
  - 📎 non-empty directory without git
    - ✔️ should exit with error when directory has files but no git
    - ✔️ should pass when directory is empty and no git
    - ✔️ should pass when directory has only hidden files and no git
  - 📎 git repository with dirty working tree
    - ✔️ should exit with error when working tree is dirty
    - ✔️ should pass when working tree is clean
  - 📎 force mode
    - ✔️ should bypass git checks with force mode
    - ✔️ should bypass dirty working tree check with force mode

📝 tests/push_command_test.js

📎 push command
- ✔️ should be available as a command
- ✔️ should process markdown files like manual command
- ✔️ should accept same options as main command
- ✔️ should produce same output as manual command
- ✔️ should handle directory option correctly
- ✔️ should accept a single file path via --files
- ✔️ should accept multiple file paths via --files
- ✔️ should accept a glob pattern via --files
- ✔️ should accept a file path inside a subdirectory via --files
- ✔️ should expose --files option in --help output
- ✔️ should work with empty directory (finds tests in current project)

📝 tests/qunit_test.js

📎 qunit parser
- 📎 qunit tests
  - ✔️ should parse qunit file

📝 tests/require_ids_test.js

📎 --require-ids functionality
- ✔️ should pass when all tests have Testomat.io IDs
- ✔️ should detect tests missing Testomat.io IDs
- ✔️ should ignore skipped tests when checking for missing IDs

📝 tests/testcafe_test.js

📎 testcafe parser
- 📎 Testcafe tests
  - ✔️ should parse testcafe file
  - ✔️ should include testcafe code

📝 tests/update_fs_test.js

📎 UpdateIds FS
- ✔️ should add suite and test ids
- ✔️ should clean suite and test ids safely
- ✔️ should clean suite and test ids unsafely

📝 tests/updateIds_codeceptjs_test.js

📎 update ids tests(codeseptJS adapter)
- 📎 [codeseptJS examples] includes Feature + Scenario
  - ✔️ [js file]: file includes Feature + one Scenario
  - ✔️ [js file]: test file does not include Feature, only Scenario
  - ✔️ [js file]: test file does not include Scenario, only Feature
- 📎 [codeseptJS examples] clean-ids
  - ✔️ can remove ids from the file with Scenario only
  - ✔️ can remove ids form the Feature & Scenario

📝 tests/updateIds_gauge_test.js

📎 Gauge update-ids
- 📎 updateIdsGauge
  - ✔️ adds suite IDs to specification titles
  - ✔️ adds test IDs to scenario titles
  - ✔️ handles underlined specification titles
  - ✔️ handles underlined scenario titles
  - ✔️ prevents duplicate ID addition
  - ✔️ replaces previously added IDs (suite and tests)
  - ✔️ handles simple key matching
  - ✔️ handles tags in titles
- 📎 cleanIdsGauge
  - ✔️ removes specific suite and test IDs
  - ✔️ removes all IDs in dangerous mode
  - ✔️ handles underlined format cleaning
  - ✔️ preserves original formatting when cleaning

📝 tests/updateIds_markdown_test.js

📎 updateIds markdown
- 📎 updateIdsMarkdown
  - ✔️ should add ID to test metadata
  - ✔️ should add ID to suite metadata
  - ✔️ should update existing ID
  - ✔️ should handle metadata without ID field
  - ✔️ should add ID to test and suite with tags in name
  - ✔️ should handle markdown with multi suites
  - ✔️ should expand single-line  and  and add IDs
  - ✔️ should expand single-line comments and assign IDs to correct suites
  - ✔️ should skip tests without metadata comment
  - ✔️ should accept an array of patterns and update every matched file
  - ✔️ should accept an array of glob patterns
- 📎 cleanIdsMarkdown
  - ✔️ should remove ID from metadata
  - ✔️ should handle multiple IDs in file
  - ✔️ should accept an array of patterns

📝 tests/updateIds_nightwatch_test.js

📎 update ids for nightwatch
- 📎 classical nightwatch format
  - ✔️ should update ids in classical nightwatch syntax
  - ✔️ should update ids in classical nightwatch with ESM syntax
- 📎 describe/it nightwatch format
  - ✔️ should update ids in describe/it nightwatch syntax
- 📎 clean ids
  - ✔️ should clean ids from classical nightwatch syntax
  - ✔️ should clean ids from describe/it nightwatch syntax

📝 tests/updateIds_playwright_test.js

📎 update ids tests(playwright adapter)
- 📎 [Playwright examples] includes/no includes main suite
  - ✔️ [ts file]: test file includes suite with tests
  - ✔️ [ts file]: test file does not include suite name, only tests
  - ✔️ [ts file]: test file test.describe.parallel mode should returns updated title.
- 📎 [Playwright examples] lines processing
  - ✔️ [ts file]: the same import name as suite name
  - ✔️ [ts file]: test file without imports should update only suite & test name
  - ✔️ [js file]: the same require name as suite name
  - ✔️ [js file]: suite name as a new line
  - ✔️ test.skip() annotation inside a test is propersly processed
- 📎 [Playwright examples] clean-ids for the --typescript mode
  - ✔️ can remove ids from the file with suite
  - ✔️ can remove ids if no suites in the file

📝 tests/updateIds_test.js

📎 update ids
- 📎 update-ids
  - ✔️ should update id by title
  - ✔️ should update id with tags by title
  - ✔️ updates ids from server
  - ✔️ ignore duplicates for ids from server
  - ✔️ should not update other strings in file
  - ✔️ allows multi-line titles
  - ✔️ respects string literals
  - ✔️ respects variables in string literals
  - ✔️ respects variables in string literals and JSON report mode
  - ✔️ respects variables in string literals in double param and JSON report mode
  - ✔️ works ok with empty files
  - ✔️ supports typescript
  - ✔️ supports typescript with types
  - ✔️ should not reformat the Array code with --typescript option
  - ✔️ should update nested scenarios
  - ✔️ should update ids based on filename for suites with included nested suites
- 📎 clean-ids
  - ✔️ cleans up ids from strings
  - ✔️ cleans up ids from string literals
  - ✔️ unsafely cleans up ids from string literals
  - ✔️ can remove ids from typescript

📝 tests/utils_test.js

📎 util functions
- ✔️ #replaceAtPoint
- 📎 #getAllSuiteTags
  - ✔️ should return empty array when no suites provided
  - ✔️ should return empty array when suites have no tags
  - ✔️ should collect tags from a single suite
  - ✔️ should collect tags from multiple suites
  - ✔️ should handle mixed suites with and without tags
  - ✔️ should not modify original suites array

AenEnlil added 3 commits September 8, 2026 16:11

markdown attachments handle

d37fd78

revert reporter changes

a331689

reworked attachemnts processing

a442f54

AenEnlil requested a review from DavertMik September 10, 2026 14:31

github-actions Bot added the ✔️ has tests label Sep 10, 2026

AenEnlil closed this Sep 11, 2026

AenEnlil deleted the feat/markdown-attachments branch September 11, 2026 08:45

Navigation Menu

Markdown Attachments - #277

Markdown Attachments#277
AenEnlil wants to merge 3 commits into
masterfrom
feat/markdown-attachments

AenEnlil commented Sep 10, 2026

Uh oh!

github-actions Bot commented Sep 10, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

AenEnlil commented Sep 10, 2026

Uh oh!

github-actions Bot commented Sep 10, 2026

✔️ Added 25 tests

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant