Keyword-driven End-to-End (E2E) test automation suite for the Mark85 task manager (app/mark85/web + app/mark85/api + MongoDB), built with Robot Framework, Browser Library (Playwright), RequestsLibrary, pymongo, and Robocop, running end-to-end in GitHub Actions.
| Artifact | Purpose | Location |
|---|---|---|
| Test Plan | Scope, hybrid MongoDB/API seeding, traceability, and exit criteria | docs/qa/TEST_PLAN.md |
| Test Case Inventory | 18 automated Robot Framework cases across 6 suites | docs/qa/TEST_CASES.md |
| BDD Specifications | Gherkin scenarios for signup, authentication, and task CRUD | specs/features/ |
| Bug / Tech Debt Report | Analysis of Sleep 1 in tag entry & parallel user isolation |
BUG-001 |
| OpenAPI / Swagger | OpenAPI 3.0.3 contract for /users, /sessions, and /tasks |
docs/swagger/openapi.yaml |
| Postman Collection | Collection v2.1 with pm.test assertions & JWT token chaining |
docs/postman/Mark85.postman_collection.json |
- Page & Component Objects (
resources/pages/): UI locators and assertions are modularized into pages (LoginPage,SignupPage,TaskCreatePage,TasksPage) and shared components (Alert,Header,Notice). - Direct MongoDB Seeding (
resources/libs/database.py): Custom Python keyword library (Clean User From Database,Remove User From Database,Insert User From Database) connects lazily viaMONGO_URIand hashes test passwords withbcryptfor deterministic test state. - Hybrid API + UI Setup (
resources/services.resource): Authenticates viaPOST /sessionsand pre-populates tasks viaPOST /tasks(RequestsLibrary) before validating UI interactions (line-throughcompletion, duplicate alerts, DOM detachment). - Data-Driven Fixtures & Templates: Scenarios consume JSON fixtures (
resources/fixtures/tasks.json) and test password boundaries (1..5chars) via reusable keyword templates. - Automated Visual Evidence & Linting: Captures screenshots on every test teardown (
log.html) and enforces Robot Framework lint standards with Robocop (pyproject.toml).
.
├── .github/workflows/
│ └── ci.yml # CI: MongoDB 7 + Mark85 API/Web + Robocop + Robot E2E
├── app/mark85/
│ ├── api/ # Node.js Express + Mongoose REST API (port 3333)
│ └── web/ # React frontend server (port 3000)
├── docs/
│ ├── postman/ # Collection v2.1 and local environment
│ ├── qa/
│ │ ├── bug-reports/
│ │ │ └── BUG-001-sleep-and-parallel-user-collision.md
│ │ ├── TEST_CASES.md
│ │ └── TEST_PLAN.md
│ └── swagger/
│ └── openapi.yaml # OpenAPI 3.0.3 specification
├── resources/
│ ├── fixtures/tasks.json # JSON test payloads
│ ├── libs/database.py # Custom pymongo + bcrypt Robot keyword library
│ ├── pages/ # Page and UI component .resource files
│ ├── base.resource # Shared setup, fixtures, and helper keywords
│ ├── env.resource # Base URLs and browser selection
│ └── services.resource # RequestsLibrary REST API keywords
├── specs/features/ # BDD specifications in Gherkin (.feature)
├── tests/
│ ├── tasks/ # Task create, update, and delete suites
│ ├── login.robot
│ ├── online.robot
│ └── signup.robot
├── pyproject.toml # Robocop linter configuration
└── requirements.txt # Python & Robot Framework dependencies
- Python 3.10+
- Node.js
>= 20.x - MongoDB (local container via
docker run -d -p 27017:27017 mongo:7, or MongoDB Atlas URI)
# 1. Start local MongoDB container
docker run -d --name mark85-mongo -p 27017:27017 mongo:7
# 2. Configure and start Mark85 API (port 3333)
cp app/mark85/api/.env.example app/mark85/api/.env
npm --prefix app/mark85/api ci
(cd app/mark85/api && npm start)
# 3. Start Mark85 Web frontend (port 3000) in a second terminal
npm --prefix app/mark85/web ci
npm --prefix app/mark85/web startIn a third terminal:
python3 -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
rfbrowser init --with-deps chromium
# Run Robocop static linter
robocop check tests/ resources/
# Run all 18 E2E tests and store reports in results/
export MONGO_URI="mongodb://127.0.0.1:27017/"
robot -d results tests/Generated reports (results/report.html, results/log.html, results/output.xml) provide step-by-step execution traces and teardown screenshots.
Workflow ci.yml runs on every push and pull_request to main:
- Starts a
mongo:7container, Mark85 API (:3333), and Mark85 Web (:3000). - Installs Python dependencies and initializes Chromium via
rfbrowser init --with-deps chromium. - Validates Postman JSON files and runs
robocop check tests/ resources/. - Executes
robot -d results tests/(18E2E scenarios) and archivesresults/for 14 days.
Luis Fernando Brandão
QA Automation Engineer