Memory optimization suggestion

[saguiitay]

Package

OpenTelemetry

Is your feature request related to a problem?

Setting CardinalityLimit to a high number (e.g 50K) might result in OutOfMemory exceptions.
We're allocating AggregatorStore's metricPoints and currentMetricPointBatch, even if the metric is never emitted.

What is the expected behavior?

We could:

1. Allocate the metricPoints and currentMetricPointBatch arrays lazily (upon first usage)
2. Allocate metricPoints and currentMetricPointBatch with a smaller size, and scale them as needed - after all CardinalityLimit is a LIMIT, not necessarily the expected size.

Which alternative solutions or features have you considered?

We just used a much lower value for CardinalityLimit, with the hope we're not losing any data.

Additional context

No response

Tip

_{React with 👍 to help prioritize this issue. Please use comments to provide useful context, avoiding +1 or me too, to help us triage it. Learn more here.}