testx

Introduction

testx is the test tools for prompts, llms, and vector databases.

Build

docker build -f Dockerfile -t craftslab/testx:latest .

Run

Default mode

docker run \
  -e SILICONFLOW_BASE_URL=$SILICONFLOW_BASE_URL \
  -e SILICONFLOW_API_KEY=$SILICONFLOW_API_KEY \
  -v $PWD:/home/craftslab \
  craftslab/testx:latest

Customized mode

docker run \
  -e SILICONFLOW_BASE_URL=$SILICONFLOW_BASE_URL \
  -e SILICONFLOW_API_KEY=$SILICONFLOW_API_KEY \
  -v $PWD:/tmp \
  craftslab/testx:latest eval --no-progress-bar --no-table -c /tmp/config.yml -o /tmp/output.html

Reference

• promptfoo
• promptfoo-add-ollama-provider
• promptfoo-add-support-for-ollama-options
• prompttools