Skip to content

Conversation

815are
Copy link
Contributor

@815are 815are commented Oct 6, 2025

Version for Integration test for fiori MCP using promptfoo -> https://github.com/SAP/open-ux-tools/tree/feat/mcpServerPromptFooIntTest/packages/fiori-mcp-server/test/integration

Current commands/scripts:

  1. pnpm test:promptfoo - run tests single time;
  2. pnpm test:promptfoo:multiple - run each test 5 times;
  3. view:promptfoo - opens promptfoo view with test runs history;

Structure:

integration
├── assertions - contains custom assertion function to validate snapshots
├── extensions - contains extension points to handle beforeEach/beforeAll to copy fresh project before running test scenario
├── provider - custom promptfoo provider which uses @sap-ai-sdk and add tools from fiori mcp server
├── scenarios - contains prmotfoo config yaml file and tests separated into subfolders
├── snapshots - contains snapshots files which then used by assertion
├── test-data
│   ├── copy - copied project during test execution
│   └── original - contains all original apps which will be copied when test is executed(if project is listed in config of test)
└── types - separate folder for reusable types, currently only constants with folder paths

Current tests -> https://github.com/SAP/open-ux-tools/tree/feat/mcpServerPromptFooIntTest/packages/fiori-mcp-server/test/integration/scenarios

image

Additional change in https://github.com/SAP/open-ux-tools/blob/main/packages/fiori-mcp-server/src/types/input.ts - description for ExecuteFunctionalityInputSchema is updated as sometimes parameters was not passed within parameters object, but outside of parameters property

very first version
@815are 815are added the fiori-mcp @sap-ux/fiori-mcp label Oct 6, 2025
Copy link

changeset-bot bot commented Oct 6, 2025

🦋 Changeset detected

Latest commit: 852635f

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 1 package
Name Type
@sap-ux/fiori-mcp-server Minor

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

815are added 2 commits October 6, 2025 20:03
project path
dependencies resolution update
@815are 815are force-pushed the feat/mcpServerPromptFooIntTest branch from 3ee8e61 to ccb9083 Compare October 8, 2025 10:38
changeset
@815are 815are marked this pull request as ready for review October 17, 2025 10:10
@815are 815are requested a review from a team as a code owner October 17, 2025 10:10
gitignore after folder rename
Copy link

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

fiori-mcp @sap-ux/fiori-mcp

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant