[Pipeline Bug]: "08. Installation Validation" pipeline logs do not show any relevant debug info if "Validation-Executable-Error" is given.

[DandelionSprout]

The recentmost case I've encountered:

• https://github.com/microsoft/winget-pkgs/pull/420467/checks?check_run_id=96008645292

For PRs that fail with Validation-Executable-Error, the GitHub App pipelines don't show what the actual error is, something that even the Azure pipelines were (60% of the time) able to do. They simply claim "Status": "Completed" and then throw the error label without any further log details.

[Trenly]

I'm not able to replicate your issue. I was able to download the logs using the link included in 10. Validation Completed and see the errors pretty clearly in the *_InstallationClient_*.txt file AND in InstallationVerification_Result.json

Exe files having non-zero exit code - InstallationClient

Checking if C:\Program Files\389 Management Console\certutil.exe executable file can be started.
Launching executable file: C:\Program Files\389 Management Console\certutil.exe
Executable C:\Program Files\389 Management Console\certutil.exe ran for less than 10 seconds: True
Executable C:\Program Files\389 Management Console\certutil.exe returned exit code: 1
Checking if C:\Program Files\389 Management Console\pk12util.exe executable file can be started.
Launching executable file: C:\Program Files\389 Management Console\pk12util.exe
Executable C:\Program Files\389 Management Console\pk12util.exe ran for less than 10 seconds: True
Executable C:\Program Files\389 Management Console\pk12util.exe returned exit code: 2
Checking if C:\Program Files\389 Management Console\certutil.exe executable file can be started.
Launching executable file: C:\Program Files\389 Management Console\certutil.exe
Executable C:\Program Files\389 Management Console\certutil.exe ran for less than 10 seconds: True
Executable C:\Program Files\389 Management Console\certutil.exe returned exit code: 1
Checking if C:\Program Files\389 Management Console\pk12util.exe executable file can be started.
Launching executable file: C:\Program Files\389 Management Console\pk12util.exe
Executable C:\Program Files\389 Management Console\pk12util.exe ran for less than 10 seconds: True
Executable C:\Program Files\389 Management Console\pk12util.exe returned exit code: 2
Checking if C:\Program Files\389 Management Console\certutil.exe executable file can be started.
Launching executable file: C:\Program Files\389 Management Console\certutil.exe
Executable C:\Program Files\389 Management Console\certutil.exe ran for less than 10 seconds: True
Executable C:\Program Files\389 Management Console\certutil.exe returned exit code: 1
Checking if C:\Program Files\389 Management Console\pk12util.exe executable file can be started.
Launching executable file: C:\Program Files\389 Management Console\pk12util.exe
Executable C:\Program Files\389 Management Console\pk12util.exe ran for less than 10 seconds: True
Executable C:\Program Files\389 Management Console\pk12util.exe returned exit code: 2
Checking if C:\Program Files\389 Management Console\certutil.exe executable file can be started.
Launching executable file: C:\Program Files\389 Management Console\certutil.exe
Executable C:\Program Files\389 Management Console\certutil.exe ran for less than 10 seconds: True
Executable C:\Program Files\389 Management Console\certutil.exe returned exit code: 1
Checking if C:\Program Files\389 Management Console\pk12util.exe executable file can be started.
Launching executable file: C:\Program Files\389 Management Console\pk12util.exe
Executable C:\Program Files\389 Management Console\pk12util.exe ran for less than 10 seconds: True
Executable C:\Program Files\389 Management Console\pk12util.exe returned exit code: 2
Checking if C:\Program Files\389 Management Console\certutil.exe executable file can be started.
Launching executable file: C:\Program Files\389 Management Console\certutil.exe
Executable C:\Program Files\389 Management Console\certutil.exe ran for less than 10 seconds: True
Executable C:\Program Files\389 Management Console\certutil.exe returned exit code: 1
Checking if C:\Program Files\389 Management Console\pk12util.exe executable file can be started.
Launching executable file: C:\Program Files\389 Management Console\pk12util.exe
Executable C:\Program Files\389 Management Console\pk12util.exe ran for less than 10 seconds: True
Executable C:\Program Files\389 Management Console\pk12util.exe returned exit code: 2

From InstallationVerfication_Result.json

| Truncated
      "Diagnostics": {
        "C:\\Program Files\\389 Management Console\\certutil.exe": {
          "ErrorStream": "C:\\Program Files\\389 Management Console\\certutil.exe - Utility to manipulate NSS certificate databasesUsage:  C:\\Program Files\\389 Management Console\\certutil.exe <command> -d <database-directory> <options>Valid commands:C:\\Program Files\\389 Management Console\\certutil.exe -H <command> : Print available options for the given commandC:\\Program Files\\389 Management Console\\certutil.exe -H : Print complete help output of all commands and optionsC:\\Program Files\\389 Management Console\\certutil.exe --syntax : Print a short summary of all commands and options-A              Add a certificate to the database        (create if needed)-B              Run a series of certutil commands from a batch file-E              Add an Email certificate to the database (create if needed)-C              Create a new binary certificate from a BINARY cert request-G              Generate a new key pair-D              Delete a certificate from the database-F              Delete a key from the database-U              List all modules-K              List all private keys-L              List all certs, or print out a single named cert (or a subset)-M              Modify trust attributes of certificate-N              Create a new certificate database-T              Reset the Key database or token-O              Print the chain of a certificate-R              Generate a certificate request (stdout)-V              Validate a certificate-W              Change the key database password--upgrade-merge Upgrade an old database and merge it into a new one--merge         Merge source database into the target database-S              Make a certificate and add to database",
          "OutputStream": "",
          "ExitCode": 1,
          "ExecutionStatusResult": "Fail"
        },
        "C:\\Program Files\\389 Management Console\\pk12util.exe": {
          "ErrorStream": "Usage:\t C:\\Program Files\\389 Management Console\\pk12util.exe -i importfile [-d certdir] [-P dbprefix] [-h tokenname]\t\t [-k slotpwfile | -K slotpw] [-w p12filepwfile | -W p12filepw]\t\t [-v]Usage:\t C:\\Program Files\\389 Management Console\\pk12util.exe -l listfile [-d certdir] [-P dbprefix] [-h tokenname]\t\t [-k slotpwfile | -K slotpw] [-w p12filepwfile | -W p12filepw]\t\t [-v]Usage:\t C:\\Program Files\\389 Management Console\\pk12util.exe -o exportfile -n certname [-d certdir] [-P dbprefix]\t\t [-c key_cipher] [-C cert_cipher]\t\t [-m | --key_len keyLen] [--cert_key_len certKeyLen] [-v]\t\t [-k slotpwfile | -K slotpw]\t\t [-w p12filepwfile | -W p12filepw]",
          "OutputStream": "",
          "ExitCode": 2,
          "ExecutionStatusResult": "Fail"
        }
      }
| Truncated
      "Diagnostics": {
        "C:\\Program Files\\389 Management Console\\certutil.exe": {
          "ErrorStream": "C:\\Program Files\\389 Management Console\\certutil.exe - Utility to manipulate NSS certificate databasesUsage:  C:\\Program Files\\389 Management Console\\certutil.exe <command> -d <database-directory> <options>Valid commands:C:\\Program Files\\389 Management Console\\certutil.exe -H <command> : Print available options for the given commandC:\\Program Files\\389 Management Console\\certutil.exe -H : Print complete help output of all commands and optionsC:\\Program Files\\389 Management Console\\certutil.exe --syntax : Print a short summary of all commands and options-A              Add a certificate to the database        (create if needed)-B              Run a series of certutil commands from a batch file-E              Add an Email certificate to the database (create if needed)-C              Create a new binary certificate from a BINARY cert request-G              Generate a new key pair-D              Delete a certificate from the database-F              Delete a key from the database-U              List all modules-K              List all private keys-L              List all certs, or print out a single named cert (or a subset)-M              Modify trust attributes of certificate-N              Create a new certificate database-T              Reset the Key database or token-O              Print the chain of a certificate-R              Generate a certificate request (stdout)-V              Validate a certificate-W              Change the key database password--upgrade-merge Upgrade an old database and merge it into a new one--merge         Merge source database into the target database-S              Make a certificate and add to database",
          "OutputStream": "",
          "ExitCode": 1,
          "ExecutionStatusResult": "Fail"
        },
        "C:\\Program Files\\389 Management Console\\pk12util.exe": {
          "ErrorStream": "Usage:\t C:\\Program Files\\389 Management Console\\pk12util.exe -i importfile [-d certdir] [-P dbprefix] [-h tokenname]\t\t [-k slotpwfile | -K slotpw] [-w p12filepwfile | -W p12filepw]\t\t [-v]Usage:\t C:\\Program Files\\389 Management Console\\pk12util.exe -l listfile [-d certdir] [-P dbprefix] [-h tokenname]\t\t [-k slotpwfile | -K slotpw] [-w p12filepwfile | -W p12filepw]\t\t [-v]Usage:\t C:\\Program Files\\389 Management Console\\pk12util.exe -o exportfile -n certname [-d certdir] [-P dbprefix]\t\t [-c key_cipher] [-C cert_cipher]\t\t [-m | --key_len keyLen] [--cert_key_len certKeyLen] [-v]\t\t [-k slotpwfile | -K slotpw]\t\t [-w p12filepwfile | -W p12filepw]",
          "OutputStream": "",
          "ExitCode": 2,
          "ExecutionStatusResult": "Fail"
        }
      }