Purpose: This repository is specifically for QA test generation using AI tools. The application code is stable and must not be modified. Focus is on generating Robot Framework tests using MCP-powered AI assistants.
This repository provides a stable application and test infrastructure used by different AI agents to generate Robot Framework test suites. All agents use the same base environment; the application remains unchanged while tests evolve.
… Getting Started … Development Workflow … Architecture … Testing … Troubleshooting …
Use SSH to clone from GitHub:
git clone git@github.com:your-org/ai-tools-eval.git
cd ai-tools-evalAll branches are for test case generation. Create a branch identifying the round, AI tool, and model.
Pattern: <Round>/<Tool>/<Model>
Examples:
git checkout -b round1/claude-code/sonnet-4
git checkout -b round2/github-copilot/sonnet-45Commit and push as usual (don't merge to main):
git add -A
git commit -m "test: add books API and UI test suite"
git push -u origin round1/claude-code/sonnet-4This environment is started with the one-step helper only. No other run modes are needed.
./quick-start.shAfter running the script, reload VS Code to activate MCP servers in the IDE:
- Open Command Palette → "Developer: Reload Window" (or restart VS Code)
What this starts and why:
- Books API and UI (
books-service) on http://localhost:8000 — baseline application under test (do not modify) - Database initialization (
initialization) — creates tables, migrates, and seeds sample data - Robot Framework MCP (
robotframework-mcp) — executes Robot tests on demand via MCP - RF Docs MCP (
rf-docs-mcp) — answers Robot Framework keyword/library documentation queries via MCP
Useful endpoints after startup:
- Web UI: http://localhost:8000
- API docs (OpenAPI): http://localhost:8000/docs
To stop everything later:
docker-compose down- Tests go under
robot_tests/; results appear inrobot_results/. - Do not change application code in
fastapi_demo/; focus on tests and documentation. - Robot Framework MCP details live in RobotFramework-MCP-server; see that folder's README/SETUP for deeper dives.
… Getting Started … Development Workflow … Architecture … Testing … Troubleshooting …
Next: Getting Started