Add azmcp storage datalake directory list-paths command #639

Copilot · 2025-07-17T19:23:17Z

Implements a new command to list paths within a specific directory in Azure Data Lake Storage Gen2, complementing the existing file-system level path listing.

Changes Made

Core Implementation

New Command: azmcp storage datalake directory list-paths
Parameters:
- --account-name (required): Storage account name
- --file-system-name (required): Data Lake file system name
- --directory-name (required): Directory within the file system
- --subscription (required): Azure subscription
- --tenant (optional): Azure tenant ID

Technical Details

Added StorageOptionDefinitions.Directory option definition
Created BaseDirectoryOptions extending BaseFileSystemOptions
Implemented DirectoryListPathsCommand using DataLakeDirectoryClient.GetPathsAsync()
Added ListDataLakeDirectoryPaths() method to IStorageService and StorageService
Registered new command group directory under storage datalake

Key Difference from Existing Command

The existing azmcp storage datalake file-system list-paths lists all paths at the file system root level using DataLakeFileSystemClient. This new command uses DataLakeDirectoryClient to list paths within a specific directory, enabling more granular exploration of Data Lake hierarchies.

# Existing: List all paths in file system
azmcp storage datalake file-system list-paths --account-name myaccount --file-system-name myfs --subscription mysub

# New: List paths in specific directory  
azmcp storage datalake directory list-paths --account-name myaccount --file-system-name myfs --directory-name mydirectory --subscription mysub

Testing & Documentation

✅ Comprehensive unit tests with parameter validation and error handling
✅ Integration test added to existing Storage live test suite
✅ Updated azmcp-commands.md with command syntax and examples
✅ Added example prompts to README.md and e2eTestPrompts.md
✅ Updated CHANGELOG.md with feature description

Result Format

Returns the same DataLakePathInfo structure as the file-system command:

{
  "paths": [
    {
      "name": "subdirectory1",
      "type": "directory", 
      "size": null,
      "lastModified": "2024-01-01T00:00:00Z",
      "etag": "\"0x8D123456789ABCD\""
    },
    {
      "name": "file1.txt",
      "type": "file",
      "size": 1024,
      "lastModified": "2024-01-01T00:00:00Z", 
      "etag": "\"0x8D123456789ABCE\""
    }
  ]
}

Fixes #638.

Warning

Firewall rules blocked me from connecting to one or more addresses

I tried to connect to the following addresses, but was blocked by firewall rules:

1oavsblobprodcus350.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
1p7vsblobprodcus324.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
4zjvsblobprodcus390.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
7tjvsblobprodcus341.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
d0svsblobprodcus381.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
fdpvsblobprodcus345.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
gbsvsblobprodcus365.vsblob.vsassets.io
- Triggering command: dotnet restore --no-cache (dns block)
gervsblobprodcus329.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
h6tvsblobprodcus346.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
imzvsblobprodcus368.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
jrqvsblobprodcus343.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
k0ivsblobprodcus356.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
k4kvsblobprodcus344.vsblob.vsassets.io
- Triggering command: dotnet restore --no-cache (dns block)
- Triggering command: /home/REDACTED/work/_temp/ghcca-node/node/bin/node --enable-source-maps /home/REDACTED/work/_temp/copilot-developer-action-main/dist/index.js (dns block)
kh4vsblobprodcus325.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
kxqvsblobprodcus376.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
l7avsblobprodcus319.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
ljcvsblobprodcus317.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
m16vsblobprodcus374.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
pdfvsblobprodcus380.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
pe3vsblobprodcus354.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
pe4vsblobprodcus351.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
rcxvsblobprodcus328.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
sqdvsblobprodcus333.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
st8vsblobprodcus339.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
u3hvsblobprodcus371.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
ukkvsblobprodcus352.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)
x3yvsblobprodcus370.vsblob.vsassets.io
- Triggering command: dotnet build (dns block)
- Triggering command: dotnet restore --no-cache (dns block)

If you need me to access, download, or install something from one of these locations, you can either:

Configure Actions setup steps to set up my environment, which run before the firewall is enabled
Add the appropriate URLs or hosts to my firewall allow list

💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

Co-authored-by: xiangyan99 <[email protected]>

xiangyan99 · 2025-07-17T19:44:22Z

src/Areas/Storage/Services/StorageService.cs

+        ValidateRequiredParameters(accountName, fileSystemName, directoryName, subscriptionId);
+
+        var dataLakeServiceClient = await CreateDataLakeServiceClient(accountName, tenant, retryPolicy);
+        var fileSystemClient = dataLakeServiceClient.GetFileSystemClient(fileSystemName);


This should be using GetDirectoryClient(directoryName)

Fixed in 6ca4341. Updated the StorageService to use dataLakeServiceClient.GetDirectoryClient(fileSystemName, directoryName) directly instead of going through the file system client.

xiangyan99 · 2025-07-17T19:45:48Z

src/Areas/Storage/Services/StorageService.cs

+
+    public async Task<List<DataLakePathInfo>> ListDataLakeDirectoryPaths(
+        string accountName,
+        string fileSystemName,


ListDataLakeDirectoryPaths does not need the input fileSystemName

Fixed in 00c8399. Removed the fileSystemName parameter and updated the method to accept a directoryPath that includes the file system (e.g., "filesystem/directory"). The method now parses this path internally to extract the file system and directory components.

xiangyan99 · 2025-07-17T19:46:27Z

docs/azmcp-commands.md

+# List paths in a Data Lake directory
+azmcp storage datalake directory list-paths --subscription <subscription> \
+                                           --account-name <account-name> \
+                                           --file-system-name <file-system-name> \


file-system-name is not needed.

Fixed in 00c8399. Removed the --file-system-name parameter from the command. The directory-name parameter now accepts a full path including the file system (e.g., "filesystem/directory").

… code review Co-authored-by: xiangyan99 <[email protected]>

xiangyan99 · 2025-07-17T19:52:20Z

src/Areas/Storage/Services/IStorageService.cs

        RetryPolicyOptions? retryPolicy = null);
+    Task<List<DataLakePathInfo>> ListDataLakeDirectoryPaths(
+        string accountName,
+        string fileSystemName,


fileSystemName is not needed

I've already removed the fileSystemName parameter from the interface in commit 00c8399. The method now takes a directoryPath parameter that includes both filesystem and directory (e.g., "filesystem/directory"). Internally, we parse this to get the fileSystemName and directoryName for the Azure SDK's GetDirectoryClient method. Could you clarify what specific fileSystemName reference should be removed?

…requested in code review Co-authored-by: xiangyan99 <[email protected]>

Initial plan

d9ceaf2

Copilot AI assigned Copilot and xiangyan99 Jul 17, 2025

github-project-automation bot added this to Azure MCP Server (OLD) Jul 17, 2025

github-project-automation bot moved this to Untriaged in Azure MCP Server (OLD) Jul 17, 2025

Copilot started work on behalf of xiangyan99 July 17, 2025 19:23 View session

Copilot AI and others added 3 commits July 17, 2025 19:33

Add directory list-paths command structure and implementation

3fb4c4c

Co-authored-by: xiangyan99 <[email protected]>

Add unit and integration tests for directory list-paths command

255e0e9

Co-authored-by: xiangyan99 <[email protected]>

Add comprehensive documentation for directory list-paths command

a3c8985

Co-authored-by: xiangyan99 <[email protected]>

Copilot AI changed the title ~~[WIP] Add azmcp storage datalake directory list-paths command~~ Add azmcp storage datalake directory list-paths command Jul 17, 2025

Copilot AI requested a review from xiangyan99 July 17, 2025 19:41

Copilot finished work on behalf of xiangyan99 July 17, 2025 19:41

xiangyan99 reviewed Jul 17, 2025

View reviewed changes

Copilot started work on behalf of xiangyan99 July 17, 2025 19:44 View session

xiangyan99 reviewed Jul 17, 2025

View reviewed changes

Fix StorageService to use GetDirectoryClient directly as suggested in…

6ca4341

… code review Co-authored-by: xiangyan99 <[email protected]>

Copilot AI requested a review from xiangyan99 July 17, 2025 19:49

Copilot finished work on behalf of xiangyan99 July 17, 2025 19:49

Copilot started work on behalf of xiangyan99 July 17, 2025 19:49 View session

xiangyan99 reviewed Jul 17, 2025

View reviewed changes

Remove fileSystemName parameter from directory list-paths command as …

00c8399

…requested in code review Co-authored-by: xiangyan99 <[email protected]>

Copilot AI requested a review from xiangyan99 July 17, 2025 19:59

Copilot finished work on behalf of xiangyan99 July 17, 2025 19:59

Copilot started work on behalf of xiangyan99 July 17, 2025 19:59 View session

Copilot finished work on behalf of xiangyan99 July 17, 2025 20:12

xiangyan99 closed this Jul 17, 2025

github-project-automation bot moved this from Untriaged to Done in Azure MCP Server (OLD) Jul 17, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add azmcp storage datalake directory list-paths command #639

Add azmcp storage datalake directory list-paths command #639

Uh oh!

Copilot AI commented Jul 17, 2025 •

edited

Loading

Uh oh!

xiangyan99 Jul 17, 2025

Uh oh!

Copilot AI Jul 17, 2025

Uh oh!

xiangyan99 Jul 17, 2025

Uh oh!

Copilot AI Jul 17, 2025

Uh oh!

xiangyan99 Jul 17, 2025

Uh oh!

Copilot AI Jul 17, 2025

Uh oh!

xiangyan99 Jul 17, 2025

Uh oh!

Copilot AI Jul 17, 2025

Uh oh!

Uh oh!

Add azmcp storage datalake directory list-paths command #639

Add azmcp storage datalake directory list-paths command #639

Uh oh!

Conversation

Copilot AI commented Jul 17, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Changes Made

Core Implementation

Technical Details

Key Difference from Existing Command

Testing & Documentation

Result Format

I tried to connect to the following addresses, but was blocked by firewall rules:

Uh oh!

xiangyan99 Jul 17, 2025

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jul 17, 2025

Choose a reason for hiding this comment

Uh oh!

xiangyan99 Jul 17, 2025

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jul 17, 2025

Choose a reason for hiding this comment

Uh oh!

xiangyan99 Jul 17, 2025

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jul 17, 2025

Choose a reason for hiding this comment

Uh oh!

xiangyan99 Jul 17, 2025

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jul 17, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Copilot AI commented Jul 17, 2025 •

edited

Loading