6f411e4ab8
* Add coverage for both targets * Use var for test bins * Disable cmake-format comment fiddling * Refactor GUI source config * Use bin var for tests * Remove unused member * Add integration tests to CI * Use modern cmake args * Use max threads for build * Use better var name for CPU core count * Split build and configure steps * Combine tests into action and add a PR comment * Fixed yaml indentation in action * Pass GITHUB_TOKEN * Update coverage paths for SonarCloud * Don't ignore return codes * Add shell * Run Valgrind on integ tests * Use header for tests * Save test results in table * Move setup step outside of action * Change logic of creating PR comment * Remove header formatting * Use emojis for simplicity * Run build wrapper in build dir * Use default make target * Pass secrets * Fixed SonarScanner warnings * Don't allow unit tests to fail * Fixed typo * Update sonar scanner paths * Fixed line endings * Use step output * Improve exclusion glob * Exclude files from coverage * Restore simpler pattern * Set temp file path * Coverage tests * Re-create comment at start of job * Append table header * Add setup action * Checkout before action * Re-add projectBaseDir * Restore original sonar scanner * Use bash syntax for if * Remove unused `shell` * Add missing shell for valgrind action * Restore new sonar scanner config * Add missing shell * Run only MainWindowTests * Test with big change * More changes * Move to correct dir * Remove test code * Disable broken integ tests * Switch coverage to front of filename * Remove filter * Refactor status step * Disable segfault test * Fixed: No status showing * Add link to workflows * Add test code for coverage * Revert "Add test code for coverage" This reverts commit c42309349b64f7828f2ca89149b30c5b0f93478a. * Get workflow run URL * Add missing shell * Use dynamic URL in valgrind comment * Revert "Revert "Add test code for coverage"" This reverts commit 9cff58b7ea5c581681ae6d6660c073bd76ba99aa. * Test with commented out code * Reintroduce 6 lines for coverage * Test code to pass scanner * Test code to pass scanner (take 2) * Simplify to 2 new lines * Add another line * Trim changes to only 3 lines * Add task for all tests * Surface warning on failure * Simplify build-wrapper step and move settings from web UI to CI * Add missing line delims * Also run tests action on Windows and macOS * Add names to action steps * Add timeout for test steps * Add failure warning for integ tests * Remove space * Disable failing test on macOS * Disable problem matcher * Simplify names * Disable freezing test on Windows * Disable failing integ test on Windows * Add build-kill task * Ignore kill result on Windows * Delete test code * Update ChangeLog * Move timeout to workflow step
67 lines
1.8 KiB
YAML
67 lines
1.8 KiB
YAML
name: "Run tests"
|
|
description: "Runs both unit tests and integration tests and appends to a PR comment"
|
|
|
|
inputs:
|
|
GITHUB_TOKEN:
|
|
description: "The GitHub token to use for authentication"
|
|
required: true
|
|
|
|
job:
|
|
description: "The job name to append to the PR comment"
|
|
default: "unknown"
|
|
|
|
runs:
|
|
using: "composite"
|
|
|
|
steps:
|
|
- name: Unit tests
|
|
id: unittests
|
|
env:
|
|
QT_QPA_PLATFORM: offscreen
|
|
run: ./build/bin/unittests
|
|
shell: bash
|
|
continue-on-error: true
|
|
|
|
- name: Integration tests
|
|
id: integtests
|
|
env:
|
|
QT_QPA_PLATFORM: offscreen
|
|
run: |
|
|
./build/bin/integtests
|
|
result=$?
|
|
|
|
if [ $result -ne 0 ]; then
|
|
echo "::warning ::Integration tests failed with code: $result"
|
|
fi
|
|
shell: bash
|
|
continue-on-error: true
|
|
|
|
- name: Get test results
|
|
id: results
|
|
run: |
|
|
pass="✅ Pass"
|
|
fail="❌ Fail"
|
|
unittests_outcome="${{ steps.unittests.outcome }}"
|
|
integtests_outcome="${{ steps.integtests.outcome }}"
|
|
unittests=$( [ "$unittests_outcome" = "success" ] && echo $pass || echo $fail )
|
|
integtests=$( [ "$integtests_outcome" = "success" ] && echo $pass || echo $fail )
|
|
echo "unittests=$unittests" >> $GITHUB_OUTPUT
|
|
echo "integtests=$integtests" >> $GITHUB_OUTPUT
|
|
shell: bash
|
|
|
|
- name: Append to PR comment
|
|
uses: marocchino/sticky-pull-request-comment@v2
|
|
with:
|
|
GITHUB_TOKEN: ${{ inputs.GITHUB_TOKEN }}
|
|
header: tests
|
|
append: true
|
|
message: |
|
|
| ${{ inputs.job }} | ${{ steps.results.outputs.unittests }} | ${{ steps.results.outputs.integtests }} |
|
|
|
|
- name: Check test outcome
|
|
if: steps.unittests.outcome == 'failure'
|
|
run: |
|
|
echo "Unit tests failed"
|
|
exit 1
|
|
shell: bash
|