Skip to content

Add delay to test reports #1299

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
tunetheweb merged 7 commits into from
Jul 31, 2026
Merged

Add delay to test reports #1299

Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
431ef43
Add delay to test reports
tunetheweb Jul 31, 2026
a1d9313
Add delay to other checks too
tunetheweb Jul 31, 2026
2ae0b09
Update test_reports.sh
tunetheweb Jul 31, 2026
6fe9e5d
Fix month
tunetheweb Jul 31, 2026
17b68d9
Increase to 10 seconds
tunetheweb Jul 31, 2026
8a84720
Handle compressed responses
tunetheweb Jul 31, 2026
abf5c59
Update to 1
tunetheweb Jul 31, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 9 additions & 3 deletions tools/scripts/test_reports.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@ then
echo "Running MacOS"
CRUX_REPORT_DATE=$(date -v -1m +%Y_%m_01)
else
CRUX_REPORT_DATE=$(date -d "-1 month" +%Y_%m_01)
CRUX_REPORT_DATE=$(date -d "$(date +%Y-%m-01) -1 month" +%Y_%m_01)
fi
else
CRUX_REPORT_DATE="${REPORT_DATE}"
Expand Down Expand Up @@ -93,32 +93,38 @@ do
FAIL_LOG="${FAIL_LOG}Incorrect Status code ${STATUS_CODE} found for ${TEST_URL}\n"
FAIL=$((FAIL+1))
fi
# Pause before the next request to avoid hitting rate limits
sleep 1
done

for TEST_URL in ${TIMESERIES_URLS}
do
NUM_TESTS=$((NUM_TESTS+1))
if curl -s "${TEST_URL}" | grep -q "${REPORT_DATE}"
if curl -s "${TEST_URL}" --compressed | grep -q "${REPORT_DATE}"
then
echo "${REPORT_DATE} found in body for ${TEST_URL}"
else
echo "${REPORT_DATE} not found in body for ${TEST_URL}"
FAIL_LOG="${FAIL_LOG}${REPORT_DATE} not found in body for ${TEST_URL}\n"
FAIL=$((FAIL+1))
fi
# Pause before the next request to avoid hitting rate limits
sleep 1
done

for TEST_URL in ${CRUX_TIMESERIES_URLS}
do
NUM_TESTS=$((NUM_TESTS+1))
if curl -s "${TEST_URL}" | grep -q "${CRUX_REPORT_DATE}"
if curl -s "${TEST_URL}" --compressed | grep -q "${CRUX_REPORT_DATE}"
then
echo "${CRUX_REPORT_DATE} found in body for ${TEST_URL}"
else
echo "${CRUX_REPORT_DATE} not found in body for ${TEST_URL}"
FAIL_LOG="${FAIL_LOG}${CRUX_REPORT_DATE} not found in body for ${TEST_URL}\n"
FAIL=$((FAIL+1))
fi
# Pause before the next request to avoid hitting rate limits
sleep 1
done

FAIL_LOG="${FAIL_LOG}\nSee latest log in [GitHub Actions](https://github.com/HTTPArchive/httparchive.org/actions/workflows/monthly-report-checks.yml)
Expand Down