-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathgithub-workflow.yml
More file actions
42 lines (35 loc) · 1.26 KB
/
Copy pathgithub-workflow.yml
File metadata and controls
42 lines (35 loc) · 1.26 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
name: Agent Regression Testing
on:
pull_request:
branches: [ main ]
jobs:
test-and-gate:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v4
- name: Set up Python
uses: actions/setup-python@v5
with:
python-version: '3.12'
cache: 'pip'
- name: Install dependencies
run: |
python -m pip install --upgrade pip
pip install -r requirements.txt
pip install pytest dprovenancekit
- name: Run Pytest (Generates Candidate Trace)
env:
DPROV_DB: traces.sqlite
# Optional API keys for your agents (e.g. OPENAI_API_KEY)
run: |
# This runs your tests and generates the candidate trace in traces.sqlite
pytest
- name: DProvenanceKit Regression Gate
uses: Therealdk8890/dprovenancekit-action@v1
with:
db-path: traces.sqlite
golden-run-id: "YOUR-GOLDEN-RUN-UUID-HERE"
candidate-run-id: "YOUR-CANDIDATE-RUN-UUID-HERE" # Typically read from a file dumped by your tests
dprov-api-key: ${{ secrets.DPROV_API_KEY }}
# When dprov-api-key is provided, this action automatically pulls the
# golden run from the cloud into traces.sqlite before comparing!