Updates for bulk file management

.devcontainer/devcontainer.json

@@ -6,7 +6,7 @@
 	"image": "mcr.microsoft.com/devcontainers/python:0-3.11",
 	"features": {
 		"ghcr.io/devcontainers/features/python:1": {},
-		"ghcr.io/devcontainers-contrib/features/black:2": {}
+		"ghcr.io/devcontainers-extra/features/black:2": {}
 	},
 	// Features to add to the dev container. More info: https://containers.dev/features.
 	// "features": {},

.github/copilot-instructions.md

@@ -0,0 +1,49 @@
+# REPO SPECIFIC INSTRUCTIONS
+
+---
+
+RELEVANCE
+Always maintain relevance to the repository in which you are working. Do not provide generic or unrelated information unless specifically requested by the user.
+
+PERSONALITY
+Answer all questions in the style of a friendly colleague, using informal language.
+
+STYLE
+Always conform to the coding styles defined in styleguide.md in the root of the repo when generating code. If the styleguide.md is missing, try to check the readme.md in the repo root. If readme.md is missing or contains no useful style information, use the default style of the language. If the default style is not defined, follow best practices, accessibility guidelines, and readability.
+Use @terminal when answering questions about Git.
+
+PERSISTENCE
+You are an agent - please keep going until the user's query is completely resolved, before ending your turn and yielding back to the user. Only terminate your turn when you are sure that the problem is solved.
+
+TOOL CALLING
+If you are not sure about file content or codebase structure pertaining to the user's request, use your tools to read files and gather the relevant information: do NOT guess or make up an answer.
+
+PLANNING
+You MUST plan extensively before each function call, and reflect extensively on the outcomes of the previous function calls. DO NOT do this entire process by making function calls only, as this can impair your ability to solve the problem and think insightfully.
+
+Please always think step by step and carefully before proposing code changes. Please never modify any code that is not immediately pertaining to the edit we are making. Please never guess at a solution. I would rather stop and discuss our options instead of guessing. We are a team!
+
+Workflow
+High-Level Problem Solving Strategy
+Understand the problem deeply. Carefully read the issue and think critically about what is required.Investigate the codebase. Explore relevant files, search for key functions, and gather context.Develop a clear, step-by-step plan. Break down the fix into manageable, incremental steps.Implement the fix incrementally. Make small, testable code changes.Debug as needed. Use debugging techniques to isolate and resolve issues.Iterate until the root cause is fixed and all tests pass.Reflect and validate comprehensively. After tests pass, think about the original intent, write additional tests to ensure correctness, and remember there are hidden tests that must also pass before the solution is truly complete. Refer to the detailed sections below for more information on each step.
+
+1. Deeply Understand the Problem
+Carefully read the issue and think hard about a plan to solve it before coding.
+
+2. Codebase Investigation
+Explore relevant files and directories. Search for key functions, classes, or variables related to the issue. Read and understand relevant code snippets. Identify the root cause of the problem. Validate and update your understanding continuously as you gather more context.
+
+3. Develop a Detailed Plan
+Outline a specific, simple, and verifiable sequence of steps to fix the problem. Break down the fix into small, incremental changes.
+
+4. Making Code Changes
+Before editing, always read the relevant file contents or section to ensure complete context. If a patch is not applied correctly, attempt to reapply it. Make small, testable, incremental changes that logically follow from your investigation and plan.
+
+5. Debugging
+Make code changes only if you have high confidence they can solve the problem. When debugging, try to determine the root cause rather than addressing symptoms. Debug for as long as needed to identify the root cause and identify a fix. Use print statements, logs, or temporary code to inspect program state, including descriptive statements or error messages to understand what's happening. To test hypotheses, you can also add test statements or functions. Revisit your assumptions if unexpected behavior occurs.
+
+6. Final Verification
+Confirm the root cause is fixed. Review your solution for logic correctness and robustness. Iterate until you are extremely confident the fix is complete and all tests pass.
+
+7. Final Reflection and Additional Testing
+Reflect carefully on the original intent of the user and the problem statement. Think about potential edge cases or scenarios that may not be covered by existing tests. Write additional tests that would need to pass to fully validate the correctness of your solution. Run these new tests and ensure they all pass. Be aware that there are additional hidden tests that must also pass for the solution to be successful. Do not assume the task is complete just because the visible tests pass; continue refining until you are confident the fix is robust and comprehensive.

.github/workflows/docker_image_publish.yml

@@ -25,6 +25,16 @@ jobs:
         login-server: ${{ secrets.ACR_LOGIN_SERVER }}
 
     - uses: actions/checkout@v3
+    - name: Set up Node.js
+      uses: actions/setup-node@v4
+      with:
+        node-version: 20
+    - name: Install Ajv
+      run: npm install ajv@^8.0.0 ajv-cli@^5.0.0
+    - name: Install Ajv
+      run: npm install ajv@^8.0.0 ajv-formats
+    - name: Generate standalone JSON schema validators
+      run: node scripts/generate-validators.mjs
     - name: Build the Docker image
       run:         
         docker build . --file application/single_app/Dockerfile --tag ${{ secrets.ACR_LOGIN_SERVER }}/simple-chat:$(date +'%Y-%m-%d')_$GITHUB_RUN_NUMBER;

.github/workflows/docker_image_publish_dev.yml

@@ -1,10 +1,11 @@
 
-name: SimpleChat Docker Image Publish (dev-chainguard)
+name: SimpleChat Docker Image Publish (dev branch)
 
 on:
   push:
     branches:
-    - dev-chainguard
+    - Development
+
   workflow_dispatch:
 
 jobs:
@@ -25,9 +26,17 @@ jobs:
         login-server: ${{ secrets.ACR_LOGIN_SERVER }}
 
     - uses: actions/checkout@v3
+    - name: Set up Node.js
+      uses: actions/setup-node@v4
+      with:
+        node-version: 20
+    - name: Install Ajv
+      run: npm install ajv@^8.0.0 ajv-formats
+    - name: Generate standalone JSON schema validators
+      run: node scripts/generate-validators.mjs
     - name: Build the Docker image
       run:         
-        docker build . --file application/single_app/Dockerfile --tag ${{ secrets.ACR_LOGIN_SERVER }}/simple-chat-dev-chainguard:$(date +'%Y-%m-%d')_$GITHUB_RUN_NUMBER;
-        docker tag ${{ secrets.ACR_LOGIN_SERVER }}/simple-chat-dev-chainguard:$(date +'%Y-%m-%d')_$GITHUB_RUN_NUMBER ${{ secrets.ACR_LOGIN_SERVER }}/simple-chat-dev-chainguard:latest;
-        docker push ${{ secrets.ACR_LOGIN_SERVER }}/simple-chat-dev-chainguard:$(date +'%Y-%m-%d')_$GITHUB_RUN_NUMBER;
-        docker push ${{ secrets.ACR_LOGIN_SERVER }}/simple-chat-dev-chainguard:latest;
+        docker build . --file application/single_app/Dockerfile --tag ${{ secrets.ACR_LOGIN_SERVER }}/simple-chat-dev:$(date +'%Y-%m-%d')_$GITHUB_RUN_NUMBER;
+        docker tag ${{ secrets.ACR_LOGIN_SERVER }}/simple-chat-dev:$(date +'%Y-%m-%d')_$GITHUB_RUN_NUMBER ${{ secrets.ACR_LOGIN_SERVER }}/simple-chat-dev:latest;
+        docker push ${{ secrets.ACR_LOGIN_SERVER }}/simple-chat-dev:$(date +'%Y-%m-%d')_$GITHUB_RUN_NUMBER;
+        docker push ${{ secrets.ACR_LOGIN_SERVER }}/simple-chat-dev:latest;

.gitignore

@@ -28,4 +28,12 @@ priv-*
 .vscode
 
 # temporary files
-flask_session
+flask_session
+
+# node modules
+/node_modules
+/package-lock.json
+/package.json
+
+
+application/external_apps/bulkloader/map.csv