a0deploy export causes rate limit errors with auth0 account

[ofirisland]

Checklist

• I have looked into the README and have not found a suitable solution or answer.
• I have looked into the documentation and have not found a suitable solution or answer.
• I have searched the issues and have not found a suitable solution or answer.
• I have upgraded to the latest version of this tool and the issue still persists.
• I have searched the Auth0 Community forums and have not found a suitable solution or answer.
• I agree to the terms within the Auth0 Code of Conduct.

Description

Hi,
We're using a0deploy to create a full connections backup on a cronjob, great tool.
Whenever a0deploy runs, it causes the Auth0 Management rate limit to hit multiple times.

1. Is it possible to add a parameter to control/limit the request rate?
2. The best would be to not having to export the whole connections each run, but iterate only on changed/added items.

Expectation

Allow a0deploy to run without hitting the rate limit

Reproduction

Run a0deploy export --debug --format yaml --output_folder . on an auth0 account with large amount of connections (total run time ~10 minutes)

Deploy CLI version

Latest

Node version

22

[kushalshit27]

Hi, @ofirisland
Thank you for reporting this issue! Our team is will investigating the issue. We need some information around this.

Are you using only connections with export command ?

...large amount of connections...

How many connections , any approx number ?

[ofirisland]

We are using the export command as provided, so it's not constrained only for connections.
I've taken a look into the logs and we can see using the timestamps the areas that take the most of the request quota.
Looks like retrieving the DB takes ~1:30m and retrieving SCIM ~5m

06:57:14 2025-09-11T06:57:14.118Z - info: Retrieving databases data from Auth0
06:58:44 2025-09-11T06:58:44.596Z - info: Reviewing connections for SCIM support. This may take a while...
6:58:44 2025-09-11T06:58:44.596Z - info: Reviewing connections for SCIM support. This may take a while...
06:58:44 2025-09-11T06:58:44.596Z - debug: Getting SCIM configuration from connection REDACTED
06:58:44 2025-09-11T06:58:44.597Z - debug: Getting SCIM configuration from connection REDACTED
06:58:44 2025-09-11T06:58:44.597Z - debug: Getting SCIM configuration from connection REDACTED
06:58:44 2025-09-11T06:58:44.639Z - warn: Insufficient scope, "read:scim_config". Required "read:scim_config", "create:scim_config", "update:scim_config" and "delete:scim_config".
06:58:44 If you are not using SCIM, you can keep these permissions disabled and ignore this warning.
06:58:44
06:58:44 2025-09-11T06:58:44.646Z - warn: Insufficient scope, "read:scim_config". Required "read:scim_config", "create:scim_config", "update:scim_config" and "delete:scim_config".
06:58:44 If you are not using SCIM, you can keep these permissions disabled and ignore this warning.
06:58:44
06:58:44 2025-09-11T06:58:44.652Z - warn: Insufficient scope, "read:scim_config". Required "read:scim_config", "create:scim_config", "update:scim_config" and "delete:scim_config".
06:58:44 If you are not using SCIM, you can keep these permissions disabled and ignore this warning.
06:58:44
07:04:03 2025-09-11T07:04:03.881Z - info: Retrieving connections data from Auth0

[kushalshit27]

Hi, @ofirisland
We are working on a retry mechanism that could help the CLI operate without hitting the rate limit.

[ofirisland]

That'd be great thank you!

[mhautala]

I hope this backoff / retry functionality will be in import too. It seems rate limits fail Auth0 deploy client imports easily on development and staging tenants.